DMCA Takedown Notice about dhtcrawler2

[ralyodio]

should move this project to codeberg

[BiatuAutMiahn]

host own gitea like torrent-csv! google cloud instance free tier would be enough if cloud is must

again with this nonsense?

[BiatuAutMiahn]

I guess since they keep taking down the domain DCMA complaints are going here? If im not mistaken this repo is not the same owner running btdig.com

I guess since they keep taking down the domain DCMA complaints are going here? If im not mistaken this repo is not the same owner running btdig.com

Even if it was, this is just code, its not got any of the said files in question. They need to go bother someone else with this nonsense.

codeberg?

[ralyodio]

https://codeberg.org/

lol too easy. i should ave guessed the URL :) but thanks. ill take a peek myself.. new to me

[ralyodio]

Is there anyway to just run the scraper and insert into custom db?

[BiatuAutMiahn]

not sure, I got sick of messing with SQL. Instead I grabbed every manetico db I could (500GB+ uncompressed), and pulled all of the hashes, names, file sizes etc and just keep it in a python dict (<5GB uncompressed pickle file). Then I hacked together a scraper from a few different implementations out there, and finally a search function. 25M+ hashes, after each search I will scrape against trackers from trackerlist to see whats alive. Also every now and again I'll import torrents-csv to get latest info. when I generate a magnet I'll have it add only trackers that have the hash

In the unlikely event the code repo is taken down by bots, i am sure to keep a local copy. I had one clone of another repo removed on me..

[BiatuAutMiahn]

In the unlikely event the code repo is taken down by bots, i am sure to keep a local copy. I had one clone of another repo removed on me..

I've been running gitea on my server and everytime I find a repo that I value, I'll migrate it to gitea, I have it set to sync/pull the repos every 24h. In the event that a DMCA takes place, I'll still have the code

I've been running gitea on my server and everytime I find a repo that I value, I'll migrate it to gitea, I have it set to sync/pull the repos every 24h. In the event that a DMCA takes place, I'll still have the code

i use fossil at home, i should do that too. Right now i just wait until i get release notices, sync, then download a zip, and store it away.

I have had a couple of source repos vanish, unrelated to DMCA and just a pissed off onwer, so i started doing it long ago.