gnulnx / django-mongolog Goto Github PK

View Code? Open in Web Editor NEW

15.0 15.0 4.0 874 KB

A Simple Mongo Based Logger for Django

Home Page: http://gnulnx.github.io/django-mongolog/

License: GNU General Public License v3.0

Python 59.31% HTML 7.55% JavaScript 13.51% CSS 19.54% Shell 0.09%

django-mongolog's People

Contributors

Stargazers

Watchers

Forkers

aniketmaithani tb-lib hbs-hbx muhashil

django-mongolog's Issues

Look at traceback for better stack trace formatting

Check out the python traceback module: https://docs.python.org/2/library/traceback.html

Look at other badges

https://github.com/romgar/django-dirtyfields

wording of ValueError upon misnamed logger

I encountered the following error when I misunderstood the purpose of the logger argument to Mongolog.find(logger="badger"...), where I entered the Mongo collection name badger instead of the different logger name "mustelidae" or whatever:

ValueError at /path/to/error/url/
No BaseMongoLogHandler could be found.  Did you add on to youy logging config?

Given this:

results = Mongolog.find(
    logger='badger',
    query={
        'msg.jobid': str(jobid),
    },
    project={
        '_id': 0,
        'output': '$msg.output',
        'jobid': '$msg.jobid',
        'cmd': '$msg.cmd'
    },
)

If the badger logger isn't found in Django logging settings, perhaps a more instructive error message would be: "Please check that LOGGERS["loggers"]["badger"] is defined in your Django settings and that it points to a logging handler of class mongolog.SimpleMongoLogHandler.

CHANGELOG

Start a CHANGELOG

Tests for simple Log record format

Need unit tests for the simple log record format

ml_purge backup issue

the ml_purge command assumes localhost when calling mongodump during the backup.

This ticket is to add support for passing in host and port for command and using it in all instances of mongo related calls.

Make check_keys recursive

Currently this method only goes two layers deep. This ticket should address this by making it a recursive function that goes 'n' levels deep to replace all keys having a '.' or a '$'.

Check minimum version we are compatible with.

Currently in setup.py we have:

install_requires=(
        'django>=1.7.10',
    ),

This can almost certainly be a lower version and should be adjusted accordingly.

Tests and TravisCI

Get some tests working and hook them up to the travisci

"msg" doesn't support with python format

I don't realy know why the "msg" doesn't support with python format, eg: %s, %d, etc.
I want to record all logs of django request in mongodb,
Here is the result example in mongodb;

But, when I test it in ./manage.py shell, it worked fine.

@gnulnx, can you correcting my logging please?
Here is my LOGGING.

import datetime

NOW = datetime.datetime.now()
DAY_NAME = NOW.strftime('%A').lower()

MAXIMUM_FILE_LOGS = 1024 * 1024 * 10  # 10 MB
BACKUP_COUNT = 5

LOGGING = {
    'version': 1,
    'disable_existing_loggers': False,
    'formatters': {
        'standard': {
            'format': '[%(levelname)s] %(asctime)s %(name)s: %(message)s'
        },
    },
    'handlers': {
        'default': {
            'level': 'DEBUG',
            'class': 'logging.handlers.RotatingFileHandler',
            'filename': 'logs/default.log',
            'maxBytes': MAXIMUM_FILE_LOGS,
            'backupCount': BACKUP_COUNT,
            'formatter': 'standard',
        },
        'mongolog': {
            'level': 'DEBUG',
            'class': 'mongolog.SimpleMongoLogHandler',

            # Set the connection string to the mongo instance.
            'connection': 'mongodb://localhost:27017',

            # define mongo collection the log handler should use.  Default is mongolog
            # This is useful if you want different handlers to use different collections
            'collection': 'mongolog',
            'formatter': 'standard',
        },
        'request_debug_handler': {
            'level': 'DEBUG',
            'class': 'logging.handlers.RotatingFileHandler',
            'filename': 'logs/request_debug.log',
            'maxBytes': MAXIMUM_FILE_LOGS,
            'backupCount': BACKUP_COUNT,
            'formatter': 'standard',
        },
        'request_error_handler': {
            'level': 'ERROR',
            'class': 'logging.handlers.RotatingFileHandler',
            'filename': 'logs/request_error.log',
            'maxBytes': MAXIMUM_FILE_LOGS,
            'backupCount': BACKUP_COUNT,
            'formatter': 'standard',
        },
        'mail_admins_handler': {
            'level': 'ERROR',
            'class': 'django.utils.log.AdminEmailHandler',
            'email_backend': 'django.core.mail.backends.smtp.EmailBackend'
        },
    },
    'root': {
        'handlers': ['default', 'mongolog'],
        'level': 'DEBUG'
    },
    'loggers': {
        'django.request': {
            'handlers': [
                'mongolog',
                'request_debug_handler',
                'request_error_handler',
                'mail_admins_handler'
            ],
            'level': 'DEBUG',
            'propagate': False
        },
    }
}

investigate simplejson

Take a look at the simple json package and see if it makes sense to use it instead

See this stack discussion: http://stackoverflow.com/questions/712791/what-are-the-differences-between-json-and-simplejson-python-modules

Connecting to MongoDB Atlas

Can we use MongoDB Atlas for this Django mongolog? I've changed my connection URL to the Atlas URL but I got this error when I tried to run my app.

ValueError: Unable to configure handler 'mongolog': No replica set members match selector "Primary()"

Thank you..

{
  code: 11000, 
  errmsg: 'E11000 duplicate key error collection: mongolog.mongolog index: uuid_1 dup key: { : "e5a55c46a3b759839df3d1ea99ea813f" }', 
  index: 0
}

Start a Google Group for the project

title say's it all