clearurls / rules

Rules database of the ClearURLs WebExtension.

ClearURLs Rules

ClearURLs is an add-on based on the new WebExtensions technology and is optimized for Firefox and Chrome based browsers.

This repo manages the rules for the ClearURLs addon. By using the GitLab and GitHub CI/CD, we automatically create checksum files for the rules and make them available through GitLab and GitHub Pages.

Contribute

If you have any suggestions or complaints, please create an issue or email us rules.support (at) clearurls.xyz (this mail will automatically create a new issue in this repo).

Download Rules

The rules and the corresponding hash file are available on GitLab and GitHub Pages under the following URLs:

GitLab

• data.minify.json: https://rules1.clearurls.xyz/data.minify.json
• rules.minify.hash: https://rules1.clearurls.xyz/rules.minify.hash

GitHub

• data.minify.json: https://rules2.clearurls.xyz/data.minify.json
• rules.minify.hash: https://rules2.clearurls.xyz/rules.minify.hash

rules's Issues

tiktok rules miss some things

Hi there,

I noticed the extension misses some things on Tiktok

I went to this account: https://www.tiktok.com/@lollipapiofficial?lang=en (it doesn't seem to be being shortened; earlier today, it was being shortened to "https://www.tiktok.com/@lollipapiofficial?"

Clicking on a video, I get https://www.tiktok.com/@lollipapiofficial/video/6980789784704732422?lang=en&is_copy_url=1&is_from_webapp=v1

URL not shortened on techcrunch.com

ClearURL's is enabled, but the link to the website opens / or refreshes as:

• https://techcrunch.com/2021/09/06/protonmail-logged-ip-address-of-french-activist-after-order-by-swiss-authorities/?guccounter=1&guce_referrer=aHR0cHM6Ly93d3cudGhldmVyZ2UuY29tLw&guce_referrer_sig=AQAAACslNIKX-0gBqFYP-1Hxyu1dg80OojvZLtLOB_INlDDOKr329PlngC2kl47UPRUIQUJc3UuI2QKDYWO0hMtQf9FlbwYVQYL7QeduG-MFnR5ZDxj-slnW77Q0K8dcJw0RKeL_uNDu13IavEaNk07JCQdt1OJYPAH6sjCnYkbb-8rt

It should look like this:

• https://techcrunch.com/2021/09/06/protonmail-logged-ip-address-of-french-activist-after-order-by-swiss-authorities/

On a general note, where can we help improve the algorithm or report these link bugs ?

The test page at https://test.clearurls.xyz/ works correctly as notes say.

🛒 Aliexpress rules need enhancement

still have these parameters,pls fix

example 1:
https://www.aliexpress.com/item/4001147595415.html?pvid=61933b68-35f5-4820-98d0-0eaef897172d&_t=gps-id:pcDetailBottomMoreOtherSeller,scm-url:1007.33416.213724.0,pvid:61933b68-35f5-4820-98d0-0eaef897172d,tpp_buckets:668%230%23131923%230_668%23888%233325%2312_23416%230%23213724%230_23416%234721%2321967%23832_23416%234722%2321972%238_668%232846%238109%231935_668%235811%2327177%2329_668%232717%237561%23355_668%231000022185%231000066058%230_668%233422%2315392%23473_4452%230%23226710%230_4452%233474%2315675%23357_4452%234862%2324463%23590_4452%233098%239599%23112_4452%235108%2323442%23551_4452%233564%2316062%23817

Skimresources, Skimlinks, Redirectingat etc

There are a bunch of auto affiliate services that many websites use to gain affiliate revenue from, ex:

https://go.skimlinks.com/?id=45704X1167592&xs=1&sref=https%3A%2F%2Fthewirecutter.com%2F&xcust=AwEAAAAAAAAAAbln&url=https://www.theteaspot.com/products/peppermint-mint-herbal-tea?variant=11937575600164

http://go.redirectingat.com/?id=355X561&test=off&xcust=bb4f7ea08d1511eb9a185217dadf8f510INT&url=https%3A%2F%2Ftry.cynch.com%2Fgrilling10

They all have the common pattern of appending a &url= at the end of themselves. They also tend to be blocked by tools such as ublock.

False positive: Sendle shipment tracking URLs

Sendle shipment tracking URLs are stripped inappropriately.

• Before processing URL: https://track.sendle.com/tracking?ref={referenceNumber}
• After processing URL: `https://track.sendle.com/tracking
• Rule: (?:%3F)?ref_?

This results in Sendle showing the following error:

Looks like that number isn’t quite right. Check the reference number you were given and try again.

URL not shortened on facebook marketplace

How the URL looks like:

• https://www.facebook.com/marketplace/item/1030767454337102/?referral_code=marketplace_top_picks&referral_story_type=top_picks&tracking=%7B%22qid%22%3A%22-7798517114374619577%22%2C%22mf_story_key%22%3A%22532089594268198849%22%2C%22commerce_rank_obj%22%3A%22%7B%5C%22target_id%5C%22%3A532089594268198849%2C%5C%22target_type%5C%22%3A6%2C%5C%22primary_position%5C%22%3A0%2C%5C%22ranking_signature%5C%22%3A1966095020037505024%2C%5C%22commerce_channel%5C%22%3A501%2C%5C%22value%5C%22%3A0%2C%5C%22upsell_type%5C%22%3A21%2C%5C%22grouping_info%5C%22%3Anull%7D%22%7D

How the URL should look like:

• https://www.facebook.com/marketplace/item/1030767454337102/

[Rule] "?auto_subscribed=false" in github.com #204

Part to remove- ?auto_subscribed=false
Example - "https://github.com/home-assistant?auto_subscribed=false"

Problem with logging in to YouTrack

With ClearURLs enabled one could not log in to YouTrack because the form disappears. If one disables ClearURLs, everything is back to normal. Example: https://issues.hibernatingrhinos.com.

chinese wechat (weixin) url tracking param

It only needs these parameters: __biz, sn, idx, mid

https://mp.weixin.qq.com/s?__biz=MzA5NjI1NTE5Mw==&mid=2658864866&idx=1&sn=ef531df79d991ce4a57ff1311abca534&chksm=8b3d4354bc4aca42db044e65ab85df43e114ef6006963f676aa4264fb4a91cbca86a62dfcd80&scene=0&xtrack=1&key=9d3ca08bb5be9f04934549c8e4e4a996c30aa942366114adccc22c64816231bea07f025c7317b89bf7a3fc21cfc2fdcecd2ba072d018940841d34f393111a3d3cb9d5f6e26c22ba0c52acb1a87070111c0fd497cbcaa639cc3545bea37c9f6d6343731671d5deb9426c3c7d2bc4b4c9cdef298e1ab462c5ebcd2ce9c4c358e12&ascene=1&uin=MjYxODQ5NzE0MA%3D%3D&devicetype=Windows+10+x64&version=62090529&lang=zh_CN&exportkey=A9SSQkB1xNFL4HWXt%2FnY9z8%3D&pass_ticket=vw%2FaWcNgC4RDQz1%2FU0vgcgiQ9%2FEaIBm31G9H5eNbrRxEZto6oaf%2BaOgWNCLfot47&wx_header=0

--->

https://mp.weixin.qq.com/s?__biz=MzA5NjI1NTE5Mw==&mid=2658864866&idx=1&sn=ef531df79d991ce4a57ff1311abca534

googleadservices.com

Please add a rule to clear URLs that comes as Google ad result (inside googleadservices.com redirect URL) like this:

https://www.googleadservices.com/pagead/aclk?sa=L&ai=DChcSEwjlyrnc6-H4AhVBE9QBHQ28CfEYABAHGgJvYQ&ae=2&dsh=1&agsac=gOR7j1M2-y8&cit=CkUKCQjwwo-WBhCCARI0AAu83Y4ij_2JwodI2xucTSB9Sd7MafcWp-40_ewsppOKyx95eTgXmwJZL7tRfHoEwKlGhBoCiCPw_wcB&ohost=www.google.com&cid=CAESa-D28LVhzCKpy-2qOlmyUThfG1PhrXARwi5SmpoSAn2gAXo7bP64-dfXRuX3igFjDjOa2rwD83GDOoUGhI7sl0R6frwpKrLWwcdPocNIlriC-lxfFNZ_TXVCxOmayT-db_ydJVMbYUOtMuvl&sig=AOD64_2NMGw9wdf0Oktc8OZ0MuU2JZtksA&ved=2ahUKEwinn63c6-H4AhUls5UCHQ2hCCUQkPAFegQIBhAB&dct=1&adurl=&ms=CoACabQOAoUy_sq_rwMbUidN34DcLg0c0tNG2P6y8NVm1JAlRCHa9QtfreVwahwhtYfjaFfYoDyNP6-zSfe-0OItXVYWfqHCkn8DB2xGObl7nGMzSUkKOflDS3efO-JWeOPmBzw3dlxwUoj7EaK0TltRG5Wz57SKt2FseUZsJukrqS3LCFgnIpye2q3Rkh_pcRu97fr_Cuj9sNu1hvuWfv1T31Bsfk0nDkUY8TshRCi3YzbWKIM5xzEKqSvNi9YIeM0zkuF2VMFRB7HpkNl83-kyExhE2yZglJqzPoH4knaA7xFA7IcMCsSIF2sB35Ao8uuWfhwse5c9xax_roQHYFPFogqAAnP4mb8X1rbE9Ir15TcQwXi-Whrdwjp8aOnffamEmrbCENmZfI6aZrnyEsEWJCIV2wD3ceBk1w-zGOdl3Ryv8MrFPqHqE6bBsoudnwFHBUFoJt14LlkxOH4_nBe0UiiCIONGr3jCSLukPxXpe_SUurGAgNNWOsr69IICGY_aPWx-lw-qea2YcjbBRILQr_56ZJ10IKMFiKfyxGsNC3YhwHicHtRXTflTmCSmNCD-g-CPfjzNYcIJjwFd0TFgo780v3O2zdo4IKQCBvca6T7C3cT9J22qXSNi30Fxv63x3V2dmTORQGWYv2QmkZC7HQipbMkqws7grUtdSwZFnqi-bRESEA9VaDYpSQq8cjJETARSw3w

Make a template for issues

Example:

Issue template: URL not shortened correctly

Which URL is being displayed:

Here you describe or paste what is the URL looking like, when it's not shortened

How should URL look like:

Here you describe or paste what is the URL supposed to be like, when it's shortened

More context:

Anything more we should know about this case?

idk something like that...

Breakage due to rule ([\/\?#]|(&|&))+((?:%3F)?[a-z]?mc=[^&]*)

Before processing
https://www.billiger.de/common/modules/api/cmodul?p=yjYblVw3QdoiOd6cmEd_bUi1B6UChvGUWp3gHtOoiOHQcU7xlGrfr9YMw6AXc6x4w5-Hgh0zm6Nc3CowW-vLRKqFLMneWjQnNibYfIDTF5fXt7W0lisK-U9GTdKm06lkw&mid=2057097209&mc=J7v95zhIqPl9&id=2057097209

After processing
https://www.billiger.de/common/modules/api/cmodul?p=yjYblVw3QdoiOd6cmEd_bUi1B6UChvGUWp3gHtOoiOHQcU7xlGrfr9YMw6AXc6x4w5-Hgh0zm6Nc3CowW-vLRKqFLMneWjQnNibYfIDTF5fXt7W0lisK-U9GTdKm06lkw&mid=2057097209&id=2057097209

Rule
([\/\?#]|(&|&))+((?:%3F)?[a-z]?mc=[^&]*)

Cheers

DW links

Hi, I've noticed that the add on doesn't clear the URLs from DW site. For example:
https://www.dw.com/en/germany-well-prepared-for-afghanistan-pullout-says-lawmaker/a-57216844?maca=en-rss-en-all-1573-rdf

Facbook __ctf__[0] param

Extension does not remove __cft__[0] param from FB url, i.e. https://www.facebook.com/ChmielnaDeptakiem/posts/943278472970978?__cft__[0]=AZVDjkAKDaOBrK5Q3KjYWycYjiv5AHZxLqELoBVYtgPQf9Hy-iV3kF3Cb3qUFMTw0kEoCb5Fc56L4BtVenaAsySk1phrdXvYHnRJH82olb286fJxj_3fizOFCzsd8jthKMZbXxUd3hy7m1b2PrVktuLJ&__tn__=%2CO%2CP-R

Exception Needed for sftc.org

When visiting this URL, the page redirects, and places in a "referrer" URL query string. It is required, but is removed by clearurls default rules. The result is that the captcha page redirects the user to a 404 after completion, rather than the original intended destination. An exception needs to be added.

Visit: http://webapps.sftc.org/ci/CaseInfo.dll

URL before sanitization: https://webapps.sftc.org/captcha/captcha.dll?referrer=https%3A%2F%2Fwebapps.sftc.org%2Fci%2FCaseInfo.dll%3F

I believe this is the rule portion which is causing issues:

"globalRules": {
            "urlPattern": ".*",
            "completeProvider": false,
            "rules": [

...

                "(?:%3F)?referrer",

ebay resolution page problem when clicking a link on gmail

Before processing:
https://www.google.com/url?q=https://rover.ebay.com/rover/0/e11569.m44.l1495/7?euid%3D975847943a7b4d9281f2d87bd21a567a%26loc%3Dhttp%253A%252F%252Fres.ebay.de%252Fws%252FeBayISAPI.dll%253FResolveCPSCase%2526caseId%253D5249352673%2526ssPageName%253DADME%253AX%253ACPSSEB%253AUS%253A1495&source=gmail&ust=1603369300211000&usg=AFQjCNGd5-iF3xBuoSp2L_v5QTqS2OSoYw

After processing:
https://rover.ebay.com/rover/0/e11569.m44.l1495/7?euid=975847943a7b4d9281f2d87bd21a567a&loc=http://res.ebay.de/ws/eBayISAPI.dll?ResolveCPSCase&caseId=5249352673&ssPageName=ADME:X:CPSSEB:US:1495

Rule:
This url is redirected

If I disable CleanURLs filter, then the URL described in Before processing works as intended.

Issues with tracking part inside URL

Hello,

An url is ending by "/id1-id2-news-article-name-topic?utm_term=Autofeed&xtref=twitter.com&utm_medium=Social&utm_source=Twitter#Echobox=15981719XX" use by 20minutes.fr

Some website keep the file extension like "/id1-id2-news-article-name-topic.html?utm_term=Autofeed&utm_medium=Social&utm_source=Twitter&Echobox=1598170XXX#xtor=CS3-5083" use by lexpress.fr and votreargent.lexpress.fr or
"/id1-id2-news-article-name-topic.html?utm_term=Autofeed&utm_medium=Social&utm_source=Twitter#Echobox=1598164XXX" use by lemonde.fr and programme-tv.net or
"/id1-id2-news-article-name-topic/index.html?utm_term=" use by edition.cnn.com or
"/id1-id2-news-article-name-topic.php?utm_term=Autofeed&utm_medium=Social&utm_source=Twitter&Echobox=1598168XXX#xtor=CS1-32-%5BEchobox%5D" use by lepoint.fr

Another tracking expression : "/id1-id2-news-article-name-topic?taid=5f422dd0f8e3570001c61XXX&utm_campaign=trueAnthem%3A+Trending+Content&utm_medium=trueAnthem&utm_source=twitter" use by reuters.com

Another tracking expression : "/id1-id2-news-article-name-topic/?
utm_source=twitter&utm_medium=social&utm_campaign=editorial&utm_term=health_covid-19&linkId=97827XXX" use by time.com

Another tracking expression : "/id1-id2-news-article-name-topic/?mbid=social_twitter&utm_brand=wired&utm_medium=social&utm_social-type=owned&utm_source=twitter" use by wired.com

Another tracking expression : "/id1-id2-news-article-name-topic?ncid=tweetlnkfrhpmg00000XXX" use by huffingtonpost.fr

Another tracking expression : "/id1-id2-news-article-name-topic.php#xtor=AD-1481423XXX" use by leparisien.fr

Another tracking expression : "id1-id2-news-article-name-topic#xtor=XXX-X" use by programme-television.org

Another tracking expression : "/id1-id2-news-article-name-topic/?utm_campaign=twitter&utm_medium=twitter&utm_source=twitter" use by journaldugeek.com

Another tracking expression : "/id1-id2-news-article-name-topic?utm_campaign=theverge&utm_content=chorus&utm_medium=social&utm_source=twitter" use by theverge.com

Another tracking expression : "/id1-id2-news-article-name-topic?mod=eXtX" use by wsj.com

Another tracking expression : "/id1?utm_campaign=link_post&utm_medium=social&utm_source=Twitter" use by 9gag.com

Another tracking expression : "/id1-id2-news-article-name-topic/?utm_medium=SocialFlow&utm_source=NYPMetroTwitter&utm_campaign=SocialFlow" or "/id1-id2-news-article-name-topic/?utm_source=NYPTwitter&utm_medium=SocialFlow&utm_campaign=SocialFlow" or "/id1-id2-news-article-name-topic/?utm_campaign=SocialFlow&utm_medium=SocialFlow&utm_source=NYPSportsTwitter&sr_share=twitter" use by nypost.com

Another tracking expression : "/id1-id2-news-article-name-topic?at_campaign=64&at_custom3=%40BBCWorld&at_custom2=twitter&at_medium=custom7&at_custom1=%5Bpost+type%5D&at_custom4=DFXXX682-XXXX-11EA-XXXX-04343A982XXX" use by bbc.com

Another tracking expression : "/id1-id2-news-article-name-topic?utm_source=twitter&utm_medium=social&utm_campaign=20200XXXX" use by dealabs.com

Another tracking expression : "/id1-id2-news-article-name-topic?xtor=rss-450&utm_medium=Social&utm_source=Twitter&utm_campaign=dlvr.it" use by liberation.fr

Another very rare expression, I put the full link : "https://www.washingtonpost.com/gdpr-consent/?next_url=https%3a%2f%2fwww.washingtonpost.com%2fpolitics%2ftrumps-suggestion-of-deploying-law-enforcement-officials-to-monitor-polls-raises-specter-of-intimidation%2f2020%2f08%2f21%2f4ff6407a-e3bb-11ea-8dd2-d07812bf00f7_story.html%3futm_source%3dtwitter%26utm_medium%3dsocial%26utm_campaign%3dwp_main&utm_source=twitter&utm_medium=social&utm_campaign=wp_main" so this part need to be remove "%3futm_source%3dtwitter%26utm_medium%3dsocial%26utm_campaign%3dwp_main&utm_source=twitter&utm_medium=social&utm_campaign=wp_main"

Is it possible to remove these tracking parts ?

Regards

[REQUEST] add bilibili.com

hope to add rule of bilibili

before:
https://www.bilibili.com/video/BV13d4y1F7rw/?vd_source=649e9c6eb3856b252cecea4e6dfa2109

after:

https://www.bilibili.com/video/BV13d4y1F7rw/

HereMaps unusable with ClearURLs enabled

Hey,
while ClearURLs is enabled it is basically impossible to use https://wego.here.com.
Could you add a rule to fix that?
Thank you!

AXS Ticketing

Hi!

I noticed that I had to turn off ClearURLs filtering to be able to buy tickets for any show (I'm using Brave Browser which is built off Chromium).

Example URL:

http://shop.axs.com/?c=axs&e=154910168852036683&t_locale=en-US

Error message: "Your session has expired" upon load.

I believe AXS relies on some weird utm stuff which ultimately breaks their site if you are using this extension.

Is there any way I can write a rule in my settings to ignore from running on certain URLs? I was looking for an exemption/ignore url option in settings but did not find any.

For now I will just have to turn filtering off while using AXS.

Thank you!

twitter tracking parameter not removed

Example: https://twitter.com/pichuboo/status/1451372407655071747?t=ZE3U5N82pY-lifLdzX0dvQ&s=19
Any s= gets removed properly, but the t= tracking parameter never gets removed, even if s= is not used. About a month ago, it was actually removing both for a week or so, now it only does one.

Fiverr.com search filter seller details broken

When searching by seller details, the search is saved and taken from the ref parameter (e.g. https://www.fiverr.com/categories/lifestyle/personal-stylists?ref=seller_location%3ADE)
This Parameter should therefore be preserved.

Add `_gl=` paramter to globalRules ( used by Google Analytics )

Hi ! I want to add in data.json to $.globalRules. rules[] _gl= parameter .

It has been used by Google Analytics for cross site measurement.
official document: https://developers.google.com/gtagjs

Tracking in twitter urls & twitter's "copy url"

The s query parameter identifies which device you're on (s=20 is the destkop website, s=19 is the android twitter mobile app) while t is an unknown query parameter very likely used for tracking, even when signed out. This occurs when you click "Copy link to Tweet" in the twitter UI.

Examples:

• https://twitter.com/dril/status/922321981?s=20&t=XJwTpqZjfNIltbt_Dt_hxg
• https://twitter.com/dril/status/922321981?t=OUQWKTJun_1PHj9mVRSvZw&s=19
• https://twitter.com/jack/status/20?s=20&t=ksx0KrMgYm-0gmdQk3UIjQ
• https://twitter.com/jack/status/20?t=fbfMCHbAyrg4S2VfF85uTg&s=19

Someone else who's noticed this:
https://twitter.com/luca/status/1432780065109155855

[amazon.*] Remove everything after node=*

Example -
Remove the bold - amazon.in/b?node=1375425031**&pd_rd_w=VmgjR**

HTTP/2 401 at Google auth confirmation due to ZX rule

Env: Linux, FF dev 107.0b1, ClearURLs 1.25.0
Steps to reproduce:

1. Set non-english locale! - with English(US) everything goes fine
2. Go to https://workspace.google.com/marketplace and try to install any app.
3. Get error XHR POST https://accounts.google.com/signin/oauth/consent/approval?hl=ru&_reqid=30157&rt=j [HTTP/2 401 Unauthorized 71ms] in logs and "Подтверждение не отправлено, попробуйте еще раз"

ClearURL log:
https://signaler-pa.clients6.google.com/punctual/multi-watch/channel?VER=8&gsessionid=XXXXX&key=XXXXXXXX&RID=rpc&SID=XXXXXXXXX&CI=0&AID=76&TYPE=xmlhttp&zx=isc9oXXwevf0&t=1 -- ZX rule applied ( ||google.*^$removeparam=zx )
https://lh3.googleusercontent.com/XXXX_XXXXX -- ETag header removed
turning ETag clearing off has no effect

Remove / at end if not at the end of TLD [Maybe Useless Request]

/ is added at the end of TLD like gitlabs.com/ by default but if / is at the end of path example- gitlab.com/xxx/xxx**/** it should be removed.

Remove . at the end of TLD.

Example - https://www.itprotoday.com**.**/windows-10/add-open-command-window-here-windows-10-context-menu

Constantly Reloads page with "+" after ?search=, replacing it with " "

On the page
https://www.uptodate.com/contents/diclofenac-systemic-patient-drug-information?search=diclofenac+sodium&source=panel_search_result&selectedTitle=3~105&usage_type=panel&display_rank=3&showDrugLabel=true

the + after ?search=diclofenac keeps getting replaced with %20 and getting replaced back with + and constantly reloading the page 25+ times before stopping. Turning off filtering stops the issue from occurring, but there is no entry in the log.

Unfortunately the link is paywalled.

page continuously reloads amazon

https://www.amazon.com/s?keywords=Men%27s+Wrist+Watches&bbn=6358540011&rh=n%3A6358540011%2Cp_n_feature_nine_browse-bin%3A5021361011&dc&c=ts&ts_id=6358540011

Looked for men's, luxury wrist waches and this made the page loop

False positive on transparencyreport.google.com

Check out https://transparencyreport.google.com/safe-browsing/search?url=clearurls.xyz

xiaomi url tracking param

https://app.mi.com/details?id=com.hicorenational.antifraud ---> download the app --->

https://app.mi.com/download/1339835?id=com.hicorenational.antifraud&ref=appstore.mobile_download&nonce=8890465161464351415%3A27015405&appClientId=2882303761517485445&appSignature=46Bb5zyWPQeuN3N9E85bq00zOPj2w7p3grfZXXXV1Uw

---->

https://app.mi.com/download/1339835

meet.google.com breakage when removing ETag

STR:
Join a google meeting meeting with ETag removing and the screen is blank, no video, no share screen, no chat, no controls.
Join a google meeting meeting without ETag removing and everything works.

Cheers

[REQUEST] To add awin1.com to the filter list

Hello,

Can you filter awin1.com ?
For example:
https://www.awin1.com/cread.php?awinmid=27982&awinaffid=268929&clickref=1301027947&ued=https%3A%2F%2Fwww.castorama.fr%2Fensemble-sous-vasque-l-80-cm-plan-vasque-miroir-ondise%2F3663338096724_CAFR.prd

gives
https://www.castorama.fr/ensemble-sous-vasque-l-80-cm-plan-vasque-miroir-ondise/3663338096724_CAFR.prd

Thank you

LinkedIn Job Tracking URL link

Hello,

ClearURLs extension doesn't seem to work on LinkedIn whenever I open a job in new tab.

Website: linkedin.com

Browser: Firefox 102

URL: https://www.linkedin.com/jobs/view/junior-data-engineer-m-f-d-at-artefact-3172716058?trackingId=ermfwjPmAAPoxJ6tKVCugQ%3D%3D&position=1&pageNum=0

How the URL could have been: https://www.linkedin.com/jobs/view/junior-data-engineer-m-f-d-at-artefact-3172716058

Add Bandcamp track/album rules

Links to Bandcamp albums and tracks can have tracking garbage at the end wich can just be cut.

Uncleaned:
https://noagreements.bandcamp.com/track/save-me-disavowed?from=search&search_item_id=2443005792&search_item_type=t&search_match_part=%3F&search_page_id=2248967963&search_page_no=0&search_rank=1&logged_in_menubar=true

Clean:
https://noagreements.bandcamp.com/track/save-me-disavowed

This is a VERY ugly RegEx for it: (^https:\/\/[\S]+.bandcamp.com\/(?:track|album)\/[^\/\?]+)\?[\s\S]*$
Only the first capturing group will be kept, the rest discarded

Breaks Hipay payment forms

Some online shops are using Hipay as a payment provider. Hipay has a payment form loaded as an iframe and the extension seems to be stripping the parameters from their main page.

This makes the payment form unusable.

Problem occurred on the website https://www.materiel.net/ that loads Hipay through this URL (example) : https://secure.materiel.net/bundles/hipay?v=1Q5akuis1dVA9FDgqklbtZQXib6WmxydtIO8-mVn6601.

With the extension enabled, Hipay fails (with errors in the console) and the form controls are readonly. With the extension disabled, the form works as intended.

?lang=en in Twiiter [Rule]

https://twitter.com/twitter?lang=en

Broken 'I'm feeling lucky' button on Google

Hi,

The "I'm Feeling Lucky" button is broken.
https://www.google.com/search?q=%s&btnI=I'm+Feeling+Lucky
but there is a rule that block btnI

[Specification] Question about completeProvider

The spec for completeProvider says:

If you want to specify rules, exceptions, and/or redirections, the value of completeProvider must be false.

It means that ClearURLs will ignore any custom rule (e.g rules, exceptions) if this field is set to true in some provider.

So why this provider has some exceptions and redirections set? They aren't getting ignored in this context?

Alternative mirror for data and rules.hash files.

Could you please provide an (non-google cloud hosted) alternative mirror for https://kevinroebert.gitlab.io/?

Specifically for https://kevinroebert.gitlab.io/ClearUrls/data/data.minify.json and https://kevinroebert.gitlab.io/ClearUrls/data/rules.minify.hash. And also the test page if possible.

A github.io mirror would be fine.

Thank you.

Not working for me, either the extension or the tool

Hi,
Today this doesn't seem to be working for me at all. I have tried both firefox and chrome, but my URLs are not getting cleared. Everything seems up to date.

I even tried clicking the tools icon to manually clear a url. Here is what I pasted
https://dothebay.com/p/low-key-parks-san-francisco-near-me?mc_cid=b0e0xxxxxx&mc_eid=6459xxxxxx
And when I click Clean URLs, I get: Here you can find the cleaned URLs:
...and the exact same URL appears below.

I certainly expect mc_cid and mc_eid to be cleared since I have "Allow referral marketing" switched OFF. Is something down today? Is there someway I can manually insist that mc_cid and mc_eid tags get cleared?

Thanks! Love the tool...usually. :)

[amazon.*] remove everything after dp/*/

Example -
Remove all bold - https://www.amazon.com/Sceptre-Professional-Monitor-DiaplyPort-Speakers/dp/B07H8P9QX2/**139-8736318-0808209?content-id=amzn1.sym.7f0cf323-50c6-49e3-b3f9-63546bb79c92&psc=1**

https://www.amazon.in/Acer-Predator-Triton-PT315-52-Windows/dp/B09D89MZLV?refinements=p_n_pattern_browse-bin%3A8609969031%2Cp_n_feature_twenty-six_browse-bin%3A27399069031&sp_csd=d2lkZ2V0TmFtZT1zcF9hdGZfYnJvd3Nl&psc=1

https://www.amazon.in/dp/B09YY59TQJ?psc=1&pd_rd_w=CU2Pj&content-id=amzn1.sym.2d591cad-b72c-4edb-a913-c75b0cb961d6&pf_rd_r=7VE86SMDSK8GGRS5DK45&pd_rd_r=c862c21d-9ba2-4a34-9917-b4c14289def7&sp_csd=d2lkZ2V0TmFtZT1zcF9kZXRhaWw

Rules for Flipkart & Desidime To Remove Tracking Element

As title suggest, there is lots of tracking element on Flipkart.com (An e-Commerce Website) & a Website called Desidime.com (E-Commerce Coupon/Deal Sharing Platform) which kinda breaks when visiting external pages.

Hope you can look into both of these and add relevant rules.

Add a rule for Quizlet

I suggest to add a rule to block this:
quizlet.com/SOMETHING/learn ?funnelUUID= 2dd2e953-6c9b-4fb2-9057-fd1d22bb56bf

Amazon ClearUrls rule not sufficiently shortening url

Trying the following url:

https://www.amazon.ca/ECOVACS-X1-Self-Empty-Auto-Clean-Navigation/dp/B09NPKWDRX/ref=sr_1_1_sspa?crid=3D1K4MEK1XDXA&keywords=x1+omni+vacuum&qid=1659903328&sprefix=omni+vac%2Caps%2C98&sr=8-1-spons&psc=1&spLa=ZW5jcnlwdGVkUXVhbGlmaWVyPUEyNkQyWERQWUtGRDNZJmVuY3J5cHRlZElkPUEwMzIwNDg3MUxCNUFJSU1SMUlVMCZlbmNyeXB0ZWRBZElkPUExMDQyNTk1M0QxWFhJVFJLMzdRUCZ3aWRnZXROYW1lPXNwX2F0ZiZhY3Rpb249Y2xpY2tSZWRpcmVjdCZkb05vdExvZ0NsaWNrPXRydWU=

only shortens to this:

https://www.amazon.ca/ECOVACS-X1-Self-Empty-Auto-Clean-Navigation/dp/B09NPKWDRX?psc=1&spLa=ZW5jcnlwdGVkUXVhbGlmaWVyPUEyNkQyWERQWUtGRDNZJmVuY3J5cHRlZElkPUEwMzIwNDg3MUxCNUFJSU1SMUlVMCZlbmNyeXB0ZWRBZElkPUExMDQyNTk1M0QxWFhJVFJLMzdRUCZ3aWRnZXROYW1lPXNwX2F0ZiZhY3Rpb249Y2xpY2tSZWRpcmVjdCZkb05vdExvZ0NsaWNrPXRydWU%3D

This does not sufficiently shorten the url. It can be further shortened to

https://www.amazon.ca/ECOVACS-X1-Self-Empty-Auto-Clean-Navigation/dp/B09NPKWDRX

[google.com]spell=1

Description of the rule - Remove &spell=1 google search URL tracking field - &spell=1 site - [www.google.com]

Example URL
https://www.google.com/search?q=gatito&spell=1

Add Ebay rule

ClearUrls doesn't clean Ebay links.

Example, with the ClearUrls turned on, Ebay link was un-shortened like this:
https://www.ebay.com/itm/275502931620?amdata=cksum%3A2755029316203cd5cd341d8246a1986f018025e88adb%7Cenc%3AAQAHAAABMJE7%252BNyUclXdoFXnbx3NvlJX7YMqFr8NJCcyHQud2Z04j2uZxgnHXbb2ZalpwbGsJ4D%252FcbSkMz8IpnsCPJ7ydREm8lqmL0kHB523%252FFCl%252BP6DeF3%252FH0fvjK92zzkJTwEE8SKxVpRs4yKQu%252F57tqCXgY8xqKB9%252F6UbjuXv47UZYBqgXpQyBP1Wq3KdtCY3KvL0EIJvLA25vjRfQ1cmN%252Bh9y5y8hpmE1VzM0vatndrRPG5IjxN4gQREok4x2%252F4fer%252FFf4Bn93oiPWb5sLYljUa1P8czdw7RZQ6uO5ZFLmiEe0qXKYBbZx7tsrUuSN3ASRyVcMrn8NoEJ7T918Zlk9VelcRqyyqaFezyJx37JBLFQgtQLpYkHW7P94BXYxciksxBvE4jnQxBpHTqdzp1SoeTq5s%253D%7Campid%3APLX_CLK%7Cclp%3A2047675

Ebay link, when shortened, should look like this:
https://www.ebay.com/itm/275502931620

Facebook events / not shortened

ClearURLs doesn't clean the URLs of facebook events.

Link:

• https://www.facebook.com/events/404844691603368/?acontext=%7B%22source%22%3A%2229%22%2C%22ref_notif_type%22%3A%22event_calendar_create%22%2C%22action_history%22%3A%22null%22%7D&notif_id=1657093942549720&notif_t=event_calendar_create

How the link should look like:

• https://www.facebook.com/events/404844691603368/

microsoftedgewelcome.microsoft.com breakage when removing form parameter

The $removeparam=/^form=/i,domain=bing.com|microsoft.com filter removes the form parameter from https://microsoftedgewelcome.microsoft.com/en-us/privacy?form=MA13E7, causing an infinite redirect.