Consider archiving/consolidating results files for upload about centinel

[rpanah]

This can be implemented by creating bzipped tarballs. tarfile can be used here.

[ben-jones]

@rpanah, @gsathya we may also want to consider doing something to compress results, because the results from running centinel on centinel.noise.gatech.edu over the weekend take up 3 GB (I must have set this to run every minute or something because it generated over 4000 results files)

[rpanah]

@ben-jones I agree. During the summer, I tried to do this by bzipping HTML contents (and bzipping each individual result file) prior to sending. There may be a better way to do it.

[ben-jones]

@rpanah, I like the idea of doing bzip or tar.gz the contents (both of these are built into python), but we will get the best compression by putting stuff together into the same archive. We even want to consider doing an additional compression/archiving scheme on the server side (on BISmark, we aggregate every hour and compress into a single archive) This also works better for the files system.

[ben-jones]

@rpanah, would you be willing to implement this?

[rpanah]

@ben-jones sure.

[rpanah]

@ben-jones I'll work on it over the weekend.

[rpanah]

Addressed by #73.