header_looker's People
header_looker's Issues
if a domain gives a 404, do a google search site: to get possible legitimate urls
seperate table for individual CSP statements
create a separate relational table for csp data
handle 405 response codes
some servers don't allow head requests and give a 405 code
In some cases, the URL in the database does not respond with all the security headers but a linked page does
If the code could scrape the url given looking for links that might have security headers, we could find more security headers. It could populate a table with a many to one relationship with target_urls where each target URL could have multiple pages.
The relationship actually looks like this:
One Domain has many Apps. One App has many URLs
remove db_select and db_delete
these operations would be done in database command line. No reason to code python database clients for everything
create a separate relational table for distinct URLs
need a table to hold targets
so we don't have to repeat target text in each line of main headerz table
so we can eliminate duplicates
add field for http status code from response
certain urls cause script to hang
getresponse() got an unexpected keyword argument 'buffering'
During handling of the above exception, another exception occurred:
...
...
...
keyboard interrupt
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.