plazmaz / leaky-repo

Benchmarking repo for secrets scanning

Leaky Repo 🚿

Table of contents

• FAQ
• Secrets
• Results
• Changelog
• Contact

FAQ

What is this?

This is a repo full of mistakes. I will include several of the secrets I've seen commonly leaking from real projects. It will be useful for testing scanning tools such as github-dorks and truffleHog.

Where did you get these?

It's worth noting that none of the secrets here are real. They are all things I've seen before, but I've randomized or redacted all of the actual data. The vast majority of secrets will likely be taken from patterns created for github-dorks, which are primarily taken from config files for popular services. I've also worked on several scanning tools in the past. Most notably, github-dorks, PasteHunter, github-dorks, as well as GHScraper, and several other non-public or unreleased scanners. Essentially, I've seen a lot of whoopsies on git, which will also be included.

Why did you make this repo?

This repo was made to serve as a benchmark for secrets scanners. Repo scanning tools have varying levels of coverage, and so far the go-to option has been "slam a bunch together". This repo is also partially to test my theory that this technique still isn't really sufficient. Regardless, you can't just scan for high entropy, and you can't just scan for patterns, you need to do both!

How can I avoid uploading these secrets?

I've written a blog post on Why We Fail at Keeping Git Secrets. If you truly want to keep your secrets safe, seperate them from your repo. If that's a config file, that's fine. If it's a secrets management/storage system, that's even better. As long as you can stop git from adding that information by default, you're unlikely to hit any problems.

Secrets

Filename	Description
.npmrc	NPM registry authentication data
.dockercfg	Docker registry authentication data
misc-keys/cert-key.pem	PEM Private key
misc-keys/putty-example.ppk	PuTTYgen private key
.ssh/id_rsa	Private ssh key
.ssh/id_rsa.pub	Public ssh key (might still not be ideal)
db/dump.sql	MySQL dump w/ bcrypt hashes
cloud/.credentials	S3 Credentials file
cloud/.s3cfg	S3 Credentials file
cloud/.tugboat	Digital Ocean tugboat config
cloud/heroku.json	Heroku config
web/var/www/public_html/wp-config.php	WordPress config file
web/var/www/public_html/.htpasswd	htpasswd file
web/var/www/public_html/config.php	PHP application config file
web/var/www/.env	Laravel .env (CI, various ruby based frameworks too)
.git-credentials	Git credentials store
.bashrc	.bashrc file (contains several secrets as environment variables)
.bash_profile	.bash_profile file (contains several secrets as environment variables)
db/robomongo.json	Mongolab credentials for robomongo
db/mongoid.yml	Mongoid config file
web/js/salesforce.js	Salesforce credentials in a nodejs project
.netrc	netrc with SMTP credentials
hub	Hub config that stores github tokens
filezilla/filezilla.xml	Filezilla config file
filezilla/recentservers.xml	Filezilla recent servers file
.docker/config.json	Docker registry authentication file
config	IRC config
db/.pgpass	PostgreSQL file which contains passwords
/proftpdpasswd	Usernames and passwords of proftpd created by cpanel
ventrilo_srv.ini	Ventrilo configuration
etc/shadow	Linux /etc/shadow file
db/dbeaver-data-sources.xml	DBeaver config containing MySQL Credentials
/.esmtprc	esmtp configuration
.mozilla/firefox/logins.json	Firefox saved password collection (can be decrypted using keys4.db)
web/django/settings.py	Django setup.py, contains valid secret key
web/ruby/secrets.yml	Ruby on rails secrets.yml file (contains passwords)
ruby/config/master.key	Rails master key (used for decrypting credentials.yml.enc for Rails 5.2+)
deployment-config.json	Created by sftp-deployment for Atom, contains server details and credentials
.ftpconfig	Created by remote-ssh for Atom, contains SFTP/SSH server details and credentials
.remote-sync.json	Created by remote-sync for Atom, contains FTP and/or SCP/SFTP/SSH server details and credentials
.vscode/sftp.json	Created by vscode-sftp for VSCode, contains SFTP/SSH server details and credentials
sftp-config.json	Created by SFTP for Sublime Text, contains FTP/FTPS or SFTP/SSH server details and credentials
.idea/WebServers.xml	Created by Jetbrains IDEs, contains webserver credentials with encoded passwords (not encrypted!)
high-entropy-misc.txt	Misc high entropy strings (HES1 is plain, HES2 is base64)

Results

We've tested a few tools and generated metrics for it. You can see how the tools tested so far stack up in Benchmarking
If there's a tool you'd like tested, please file an issue with details on it or create a PR. We are focused primarily on command-line based tools, but are also happy to accept results from web or GUI-based tools, as long as you include the full results and details about the tool.

Changelog

You can see recent changes made in our CHANGELOG.md file or under Releases. We use semantic versioning for releases.

Contact

Got a question? Found something worth adding?
File an issue
Have another reason to contact me? You can find me on Twitter:
@Plazmaz

It's also worth noting that many of the original patterns used to find the filenames and examples of several secrets came from github-dorks, which is under tha Apache 2.0 License. Also, for the sake of full disclosure, I am a maintainer on that project.

leaky-repo's Issues

Gitrob results

I ran gitrob against the repository and got the following results if you wanted to include them in the benchmark.