aquarthur / urlscanio Goto Github PK
View Code? Open in Web Editor NEWCLI tool which uses URLScan to scan websites and download corresponding screenshots and DOMs.
Home Page: https://pypi.org/project/urlscanio/
License: MIT License
CLI tool which uses URLScan to scan websites and download corresponding screenshots and DOMs.
Home Page: https://pypi.org/project/urlscanio/
License: MIT License
OS : windows 10
python version: 3.10
I have created a login in URLscanio and started using the URLscanio scan options.
I plan to automate my work via Python (https://pypi.org/project/urlscanio/#files-urlscanio 0.2.2).
So I downloaded the Python script module (urlscanio 0.2.2) and installed it on my machine. While running the script, I got the below error:
C:\Users\sraj\AppData\Local\Programs\Python\Python310>urlscanio -i http://templatelab.com/
Traceback (most recent call last):
File "C:\Users\sraj\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
return run_code(code, main_globals, None,
File "C:\Users\sraj\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in run_code
exec(code, run_globals)
File "C:\Users\sraj\AppData\Local\Programs\Python\Python310\Scripts\urlscanio.exe_main.py", line 7, in
File "C:\Users\sraj\AppData\Local\Programs\Python\Python310\lib\site-packages\src\urlscanio_main.py", line 15, in main
api_key = os.environ["URLSCAN_API_KEY"]
File "C:\Users\sraj\AppData\Local\Programs\Python\Python310\lib\os.py", line 680, in getitem
raise KeyError(key) from None
KeyError: 'URLSCAN_API_KEY'
Where can I edit the script and add my own URLSCAN_API_KEY ?
please help to resolve this error
This tool requires an environment variable named URLSCAN_API_KEY containing your API key. Optionally, you may also set an environment variable called URLSCAN_DATA_DIR to specify where the screenshots and DOM should be downloaded. If not set, they will be downloaded in the directory you run urlscanio from.
It is recommended to use .bashrc or .zshrc for this. If using PowerShell, add URLSCAN_API_KEY and URLSCAN_DATA_DIR to your user profile.
Where could i find simple explanation how to use .bashrc for "this"? This stuff looks darn overcomplicated comparing to urlscan.io website.
Hello,
I'm looking to automate some work for my team and leverage the urlscan.io dataset. Your tool had almost all of the functions I needed except for an ability to search the urlscan.io dataset and also an easy way to get the raw scan results.
I will submit a PR shortly for an implementation I'm now using out-of-band. If you like it, let me know how to proceed. I would love to get this in your next pip version.
Thanks,
Sean
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.