Coder Social home page Coder Social logo

leaktopus's People

Contributors

itamarplay avatar rotemplay avatar rotemreiss avatar shaked avatar snyk-bot avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

leaktopus's Issues

Scans fail with AssertionError

Some of the scans are failing with a raised unexpected: AssertionError('unsupported encoding: None') error.

Stack trace:

worker_1         | [2022-07-15 15:05:51,508: ERROR/ForkPoolWorker-4] Task leaktopus.common.scanner_async.github_fetch_pages[8497600a-d2ac-4ce5-a4a4-cfcd745cb0c2] raised unexpected: AssertionError('unsupported encoding: None')
worker_1         | Traceback (most recent call last):
worker_1         |   File "/home/python/.local/lib/python3.9/site-packages/celery/app/trace.py", line 405, in trace_task
worker_1         |     R = retval = fun(*args, **kwargs)
worker_1         |   File "/app/leaktopus/app.py", line 41, in __call__
worker_1         |     return TaskBase.__call__(self, *args, **kwargs)
worker_1         |   File "/home/python/.local/lib/python3.9/site-packages/celery/app/trace.py", line 697, in __protected_call__
worker_1         |     return self.run(*args, **kwargs)
worker_1         |   File "/app/leaktopus/common/scanner_async.py", line 212, in github_fetch_pages
worker_1         |     gh_results_filtered = filter_gh_results(merged_pages, organization_domains)
worker_1         |   File "/app/leaktopus/common/scanner_async.py", line 434, in filter_gh_results
worker_1         |     content = result.decoded_content.decode()
worker_1         |   File "/home/python/.local/lib/python3.9/site-packages/github/ContentFile.py", line 59, in decoded_content
worker_1         |     assert self.encoding == "base64", f"unsupported encoding: {self.encoding}"
worker_1         | AssertionError: unsupported encoding: None

I'm investigating the issue and will provide a fix ASAP.

Leaks enhancement task fails

Leaktopus is not enriching the leaks with additional data such as contributors and secrets.
This was caused by
Commit 5a3b2e4e45ea5a55116c5d50b7a7b7bba07ddeaf
. The commit commented the usage in TruffleHog and the import of TruffleHog wasn't removed as well, which broke the code execution with the following error:

worker_1         | [2022-07-05 05:55:28,002: ERROR/ForkPoolWorker-2] Task leaktopus.common.leak_enhancer.enhance_repo[XXXXXXX] raised unexpected: ModuleNotFoundError("No module named 'truffleHog'")
worker_1         | ModuleNotFoundError: No module named 'truffleHog'

A fix will be deployed soon.

compose is not configured correctly

๐Ÿ‘‹
I'm trying to run this but the compose dies of various reasons each time; here's a kibana throw example:

[2022-07-03T09:20:08.469+00:00][FATAL][root] Error: [config validation of [xpack.security].enabled]: definition for this key is missing

Do you mind sharing your full setup?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.