Coder Social home page Coder Social logo

Comments (3)

EdJoPaTo avatar EdJoPaTo commented on September 23, 2024

I like seeing website-stalker is being used in the wild!

That page is generated via JavaScript within the browser. When using the Developer Tools you can inspect the plain sources. Also with website-stalker you can get the plain sources without any editors.
The content of interest is simply not there yet and will be loaded via JavaScript.

Doing something like that requires basically a whole browser. Theoretically this is possible to do but its a huge effort and prone to strange cases. Also I don't know the state of stuff like that with Rust.
Also: This would introduce a lot of traffic as many things will be crawled each time instead of just a single URL. That's way less friendly to the webserver.

What helps me in these cases: Developer Tools Network Tab.
There is some loaded content (Fetch/XHR) which contains the information of interest.
In your case it seems to be https://bugs.chromium.org/prpc/monorail.Issues/GetIssue but with a POST body which contains the "arguments".

Having the ability to supply some body and do a POST request instead of a GET request might be interesting but I don't know how many usecases for that might be. (= If its worth the additional complexity.)

Something that can be added for sure are JSON related editors (prettify / key selection somewhat like jq)

from website-stalker.

EdJoPaTo avatar EdJoPaTo commented on September 23, 2024

A new editor json_prettify was introduced in 73814fb which will be available in v0.12.

There is no POST request or json key selection like jq does yet.
It probably would be a little bit more complicated and so far I hadn't the need for it personally.

from website-stalker.

stale avatar stale commented on September 23, 2024

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

from website-stalker.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.