amndeep7 / commentface_counting Goto Github PK

scraping the css ain't doing it since it only gets the current batch of commentface names. we need to search against all of them.

we're just relying on the pushshift search for all results, but this is including lots of spurious hits like for 'mentioned', etc.

need to add some sort of check to see if it's being used as a commentface

idea 1: just do a filter on the results on my end to make sure that all of them start with # which should make the results almost accurate

idea 2: do a full regex to ensure it matches commentface syntax to get like 99% of the way there but probably not 100% cause of things like putting the commentface in the title text for some random link

https://github.com/mattpodolak/pmaw

multithreaded is cool. it might just be waiting on IO that's making this hella slow and not just ratelimiting

also i'm hoping that this might be a drag and drop replacement

https://old.reddit.com/r/anime/comments/qmyd9x/casual_discussion_fridays_week_of_november_05_2021/hjxv66e/?context=3