nagyv / s3stat

An open-source s3stat service clone

S3 Stat

This python module uses the really nice goaccess <http://goaccess.io/> utility to provide you with an amazing Amazon log file analyser tool that is relatively easy to install, and is extremely easy to extend.

Documentation

Please, read the docs on PyPi <https://pypi.python.org/pypi/s3stat>

ToDo

• provide a command that adds logging to specified buckets and cloudfront distributions

Sponsored by

• Vidzor Studio LLC <http://vidzor.com>

s3stat's Issues

Examples of customization are wrong.

In the example you define the method "process" in the custom S3 class, this should be "process_results"

Needs clearer documentation on parameters

Default location is logs/. Just 'logs' does not work, as it's not the full prefix. The trailing slash is required. Took me a while to debug this.

Unclear definition of date type

When calling the constructor the date type is expected to be a string of "YYYY-MM-DD" based of the documentation, but when creating a custom i had to use a datetime object:

from datetime import datetime
...
mytask = MyS3Stat("the_bucket", "S3-logs/", datetime(2014, 07, 16), ("xxx", "xxx"))

time_format not included in generated goaccess config file

Without this user is prompted to enter time format

I added

time_format %H:%M:%S

to config file generation

log downloading might be easily improved

e.g. http://blog.hownowstephen.com/post/50743415449/gevent-tutorial
or basic threading