Comments (3)
I like seeing website-stalker is being used in the wild!
That page is generated via JavaScript within the browser. When using the Developer Tools you can inspect the plain sources. Also with website-stalker you can get the plain sources without any editors.
The content of interest is simply not there yet and will be loaded via JavaScript.
Doing something like that requires basically a whole browser. Theoretically this is possible to do but its a huge effort and prone to strange cases. Also I don't know the state of stuff like that with Rust.
Also: This would introduce a lot of traffic as many things will be crawled each time instead of just a single URL. That's way less friendly to the webserver.
What helps me in these cases: Developer Tools Network Tab.
There is some loaded content (Fetch/XHR) which contains the information of interest.
In your case it seems to be https://bugs.chromium.org/prpc/monorail.Issues/GetIssue but with a POST body which contains the "arguments".
Having the ability to supply some body and do a POST request instead of a GET request might be interesting but I don't know how many usecases for that might be. (= If its worth the additional complexity.)
Something that can be added for sure are JSON related editors (prettify / key selection somewhat like jq)
from website-stalker.
A new editor json_prettify
was introduced in 73814fb which will be available in v0.12.
There is no POST request or json key selection like jq does yet.
It probably would be a little bit more complicated and so far I hadn't the need for it personally.
from website-stalker.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
from website-stalker.
Related Issues (20)
- consider switching to `git-repository` crate HOT 2
- Current main can't parse it's own example config HOT 1
- Replace integrated git support by usage of the existing git executable HOT 1
- Overriding filename? HOT 7
- Check robots.txt HOT 2
- Allow override of 'sites/' HOT 7
- Commit per Domain or all HOT 1
- Create issue for the changes with link for the commit HOT 2
- Latest version breaks Github Action HOT 8
- Sorting/Ordering is changed, but no change in content HOT 11
- One commit per host HOT 1
- Remove `check` sub-command HOT 2
- command editor
- Self-signed certificate not recognized HOT 6
- Commit message based on changed site
- Allow grouping of links HOT 2
- Use environment variable for `from` HOT 2
- Default extension HOT 1
- html_prettify: sort class and style attributes HOT 1
- Select parts of a json
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from website-stalker.