aquarthur / urlscanio

CLI tool which uses URLScan to scan websites and download corresponding screenshots and DOMs.

Hi there 👋

• 🔭 I’m currently working on making lounges more accessible than ever via LoungeBuddy!
• ⚡ Fun fact: did you know a plateau is the highest form of flattery?

urlscanio's Issues

Error

OS : windows 10
python version: 3.10

I have created a login in URLscanio and started using the URLscanio scan options.
I plan to automate my work via Python (https://pypi.org/project/urlscanio/#files-urlscanio 0.2.2).
So I downloaded the Python script module (urlscanio 0.2.2) and installed it on my machine. While running the script, I got the below error:

C:\Users\sraj\AppData\Local\Programs\Python\Python310>urlscanio -i http://templatelab.com/
Traceback (most recent call last):
File "C:\Users\sraj\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
return run_code(code, main_globals, None,
File "C:\Users\sraj\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in run_code
exec(code, run_globals)
File "C:\Users\sraj\AppData\Local\Programs\Python\Python310\Scripts\urlscanio.exe_main.py", line 7, in
File "C:\Users\sraj\AppData\Local\Programs\Python\Python310\lib\site-packages\src\urlscanio_main.py", line 15, in main
api_key = os.environ["URLSCAN_API_KEY"]
File "C:\Users\sraj\AppData\Local\Programs\Python\Python310\lib\os.py", line 680, in getitem
raise KeyError(key) from None
KeyError: 'URLSCAN_API_KEY'

Where can I edit the script and add my own URLSCAN_API_KEY ?
please help to resolve this error

Feature request: Search and Raw scan results

Hello,

I'm looking to automate some work for my team and leverage the urlscan.io dataset. Your tool had almost all of the functions I needed except for an ability to search the urlscan.io dataset and also an easy way to get the raw scan results.

I will submit a PR shortly for an implementation I'm now using out-of-band. If you like it, let me know how to proceed. I would love to get this in your next pip version.

Thanks,

Sean

Any ideas how to do this?

This tool requires an environment variable named URLSCAN_API_KEY containing your API key. Optionally, you may also set an environment variable called URLSCAN_DATA_DIR to specify where the screenshots and DOM should be downloaded. If not set, they will be downloaded in the directory you run urlscanio from.

It is recommended to use .bashrc or .zshrc for this. If using PowerShell, add URLSCAN_API_KEY and URLSCAN_DATA_DIR to your user profile.

Where could i find simple explanation how to use .bashrc for "this"? This stuff looks darn overcomplicated comparing to urlscan.io website.