Comments (4)
Could you support a ruleset.yaml feature to block and modify URL paths?
I think this would make contributing easier for the layperson, as figuring out a bypass can be done with just the browser devtools without writing code.
For example, to bypass tagesspiegel.de,
you would append ?amp=1
to the end of the URL to get the Google AMP link, then block the following requests:
- https://cdn.privacy-mgmt.com/wrapperMessagingWithoutDetection.js
- https://widgets.opinary.com/a/tagesspiegel.js
I think this would be easier than writing javascript to wait for the blocker modal, then remove it, when this is a feasible bypass method.
from ladder.
Seems like the way to request the AMP version of a site is not standard. Some sites do it via a special path like /amp/
, and others via URL query ?amp=1
, and others still by subdomain amp.example.com
.
The googleCache flag abstraction is nice, but I think it hides the implementation in such that it would make it harder for a new contributor to modify the ruleset by understanding other people's rules. Easier to learn by example if you can see exactly what is going on. Without a ruleset contribution guide, it's monkey-see monkey-do.
Anyway, I've submitted a PR that should allow you to modify the URL.
from ladder.
It seems they block the user-agent.
To bypass this block you might use this rule.
- domain: tagesspiegel.de
headers:
user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/119.0.0.0 Safari/537.36
content-security-policy: "script-src 'self';"
But it seems they have no backdoor for search engines.
from ladder.
Sounds good. Or a AMP flag, similar to the googleCache flag.
from ladder.
Related Issues (20)
- Idea: API should return structured article json HOT 27
- Request Header Fields Too Large HOT 7
- Improvement: add benchmarking and testing suite HOT 2
- Ruleset testing HOT 4
- Ladder malforms https links HOT 7
- Unraid docker app HOT 1
- The 'package' line in go.mod doesn't have the URL HOT 1
- Looking for the curl --compressed equivalent in Ladder HOT 2
- Should Ladder's UI behave differently for mobile?
- Medium.com blocked by cloudflare HOT 4
- To deploy on my own VPS HOT 2
- Catch-All rule to add "Access-Control-Allow-Origin: *" to all responses? HOT 1
- http: no Host in request URL HOT 1
- Ladder should restrict proxying local/reserved IP addresses HOT 1
- Feature request: Possibility to set up number of threads spawned HOT 1
- Bug: ENV "LOG_URLS" has stopped working
- Public instances ? HOT 7
- Error loading website with basic auth
- Homebrew formula? HOT 1
- Feature request: FlareSolverr integration
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ladder.