I use a RSS feed reader to read articles from specific websites, frequently the same news is reported in multiple websites. This code will use a LLM to identify duplicates and delete it from the article database
lokeshsubramany / deduplicate_rss_with_llm Goto Github PK
View Code? Open in Web Editor NEWI use a RSS feed reader to read articles from specific websites, frequently the same news is reported in multiple websites. This code will use a LLM to identify duplicates and delete it from the article database
License: Other