jordan-wright / dumpmon Goto Github PK

I like this tool a lot, but it lacks one important feature.
That is backup or cache.

I know you there is an option to do that locally, but I want to see it remotely on the website itself (dumpmon.com?)
Or at least post a copy of the dump to another pastebin-like site, so you don't lose the origianl post in case it gets removed, which it usually does if the paste is 'sensetive'

thoughts?

Hey there,

Big fan of dumpmon here! Lately I 've been thinking of contributing to the project and I was trying to think of new features to add. Since you 're planning 2.0 version here are my thoughts:

• More info needs to be logged. Author, titles, date (very important). The previous months I noticed occasional large leaks from govt. organisations. After a few weeks a huge compromise was announced. Keeping track of dates can be useful.
• Adding some optional limits to the mix. Regexes could be selected from command line options or a configuration file (e.x someone may not be interested in cisco dumps)
• Better dump parsing. Keywords, domains etc. Maybe ElasticSearch is better for that? Adding a Kibana (or a custom web) interface could also provide more dynamic filtering and easier monitoring. For example, an organization wants to monitor mail dumps concerning only their domains.

Cheers!

Python 3.3.2
Twitter 1.10.0
beautifulsoup4 4.2.1
requests 1.2.3
pymongo 2.5.2

[user@localhost dumpmon]$ python dumpmon.py

Traceback (most recent call last):
  File "dumpmon.py", line 12, in <module>
    from lib.Pastebin import Pastebin, PastebinPaste
  File "/data/apps/dumpmon/lib/Pastebin.py", line 1, in <module>
    from .Site import Site
  File "/data/apps/dumpmon/lib/Site.py", line 1, in <module>
    from Queue import Queue
ImportError: No module named 'Queue'

I found this: https://code.google.com/p/python-llfuse/issues/detail?id=19 saying that Queue has been renamed to queue in Python 3.

I'm very confused about whether dumpmon requires Py3 or Py2 since the Twitter library doesn't seem to work properly in Py2 but does in Py3.

Need to start getting the titles and authors of pastes. Currently there's no way to tie pastes to their authors.

Love the software. Been following it on Twitter for some time.

I am having issues getting my own instances to get up and running. Dependencies are installed. The script will get up and run but it's not discovering dumps.

I am watching the @dumpmon, I see my instance "Checking" those same links but with no hits. I validated that it was over the email thresh-hold from the config.

Have you thought about allowing user to use other database types i.e mysql/mairadb,PostgreSQL,SQLite

I came along this repository by searching for a Telegram Bot API token regular expression. After checking the token format from a SO answer, i found a possible incorrectness in the 'telegram_bot' regex format.

In lib/regexes.py line 15:

change the regex from:

r'\d{9}:[0-9A-Za-z_-]{35}'

to:

r'^[0-9]{8,10}:[0-9A-Za-z_-]{35}$'

The line was last edited on this issue -> #15

The related SO answer ( which i also later adjusted ) is this https://stackoverflow.com/questions/61868770/tegram-bot-api-token-format

I'm currently running dumpmon on a google cloud instance and everything works successfully for a few minutes but then the script stops checking pastebin URLs and only prints out "Retrieving Pastebin ID's" until I stop the script and change the IP address. Is Pastebin blacklisting my dumpmon instance due to excessive amounts of requests? I have a pastebin pro account and have whitelisted my IP, but I'm still facing this issue.

Using python-twitter doesn't seem to resolve names...I'm used to using tweepy, so I'm sure I'm just an idiot, but I would appreciate some input here. The module loads just fine, but functions Twitter and Oauth can't be found. Perhaps there's a version mismatch? Any help appreciated.

Python 2.7.3 (default, Sep 26 2012, 21:51:14) 
[GCC 4.7.2] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import twitter
>>> names = dir(twitter)
>>> print globals()
{'__builtins__': <module '__builtin__' (built-in)>, 'twitter': <module 'twitter' from '/usr/local/lib/python2.7/dist-packages/python_twitter-1.0.1-py2.7.egg/twitter.pyc'>, '__package__': None, 'names': ['ACCESS_TOKEN_URL', 'AUTHORIZATION_URL', 'Api', 'CHARACTER_LIMIT', 'DEFAULT_CACHE', 'DirectMessage', 'Hashtag', 'List', 'REQUEST_TOKEN_URL', 'SIGNIN_URL', 'Status', 'StringIO', 'Trend', 'TwitterError', 'Url', 'User', '_FileCache', '_FileCacheError', '__author__', '__builtins__', '__doc__', '__file__', '__name__', '__package__', '__version__', 'calendar', 'datetime', 'gzip', 'httplib', 'md5', 'oauth', 'os', 'parse_qs', 'parse_qsl', 'rfc822', 'simplejson', 'sys', 'tempfile', 'textwrap', 'time', 'urllib', 'urllib2', 'urlparse'], '__name__': '__main__', '__doc__': None}

Currently, there's no ability to add a url ad-hoc into the queue. This might need to be a separate tool, but it'd be nice to find a way to incorporate this directly into dumpmon.