tnmch / cybercrowl

CyberCrowl is a python Web path scanner tool

Hey 👋, I'm TnMch

I'm currently a Security engineer @Contentsquare based in 🗼 Paris. I am working on some projects, learning a couple new Hacking techniques, and trying to make the world a safer place.

⚡️ A Few Quick Facts

• 🔭 I’m currently working on CyberCrowl.
• 👨‍💻 CTFer with Super-Guesser.
• 👀 I’m interested in web application penetration testing.
• 💞️ I’m looking to collaborate on bug bounty
• 💬 Ping me about security.

cybercrowl's Issues

Display list of found files at end

It would be nice to display only the dirs, that were found and not the 404s at the end of the scan.

UnboundLocalError: local variable 'size' referenced before assignment

First time trying to use this against my server, and I keep getting this error.

Windows 10, Python 2.7

Script stop when connect error

Traceback (most recent call last):
File "cybercrowl.py", line 492, in
main()
File "cybercrowl.py", line 475, in main
crowl(list, url, args)
File "cybercrowl.py", line 338, in crowl
ress = requests.get(f_url, headers=headers ,allow_redirects=False, proxies=proxies, verify=False)
File "/usr/local/lib/python2.7/site-packages/requests/api.py", line 72, in get
return request('get', url, params=params, **kwargs)
File "/usr/local/lib/python2.7/site-packages/requests/api.py", line 58, in request
return session.request(method=method, url=url, **kwargs)
File "/usr/local/lib/python2.7/site-packages/requests/sessions.py", line 508, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python2.7/site-packages/requests/sessions.py", line 618, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python2.7/site-packages/requests/adapters.py", line 490, in send
raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', BadStatusLine("''",))

Solving HTTP redirection

I noticed while trying CyberCrowl on some websites that if there's HTTP redirection it just print the new URL and doesn't continue crowling.
Here's an example comparing two websites :