Error in getemails module about torbot

[waisuan]

Hello. Submitted a pull request for this one. Let me know what you think! Thanks.

[PSNAppz]

Traceback (most recent call last): File "torBot.py", line 186, in <module> main(conn=True) File "torBot.py", line 162, in main emails = getemails.getMails(html_content) File "/home/psn/Documents/TorBoT/modules/getemails.py", line 24, in getMails links = soup.find_all('a') AttributeError: 'NoneType' object has no attribute 'find_all'

Need a fix asap

[waisuan]

Hmmm . Doesn’t seem to be related to my changes. Will take a look.

[waisuan]

Do you have a way of replicating the error, @PSNAppz ? I'm not getting anything on my side.

[PSNAppz]

@waisuan Try this one
python3 torBot.py -u https://www.helloaddress.com/ -m
It has one mail id in the page but its returning 0 found.
But on the other hand this one is working perfect
python3 torBot.py -u https://www.asianpaints.com/contact-us.html -m

[waisuan]

I'm not getting any errors for both links...

[PSNAppz]

See its returning 0 . It should return 1

[waisuan]

@PSNAppz -- I did a bit of debugging and I suspect that the issue at hand here is not bug-related. It would seem that the site that you have cited as an example is (probably) blocking visits from Tor nodes.

You would get an "Access Denied" error when accessing the page on Tor but OK on any other non-Tor browsers:-

For more info on this:: https://tor.stackexchange.com/questions/6646/why-do-i-get-access-denied-at-certain-web-sites-when-i-didnt-last-year

[waisuan]

You can confirm this by turning https://github.com/DedSecInside/TorBoT/blob/dev/torBot.py#L108 off and running the crawler. You should be able to see the "mail" then.

[KingAkeem]

Has this issue been fixed?

[PSNAppz]

@waisuan Ok. @KingAkeem Seems like a problem which cannot be fixed on our side.