Comments (2)
Downloader for Reddit attempts to avoid duplicates in two ways.
First, it sets the last downloaded date for a user or subreddit to the latest post date taken from that user or sub and will not download anything posted before that date during subsequent runs.
The other way is that it keeps a list of every url that it downloads and will not download the same url twice with one caveat. The urls are tracked per user or subreddit. So if say a link is posted to pics that is also posted to earthporn at the same url, the downloader will not detect that and will download both.
The other instance of duplicate content downloads that I have found is that sometimes the same image is posted to a subreddit multiple times but by different users and at different urls. There is no way to avoid this.
But as for avoiding content downloaded with another app, there is no way to automatically avoid these duplicates. The closest thing I can recommend is that you can set DFR's 'Restrict downloads by custom date' to the date that you stopped using the other app, and it will only download posts made after that date.
from downloaderforreddit.
"Restrict downloads by custom date' to the date that you stopped using the other app, and it will only download posts made after that date."
thanks for the tip!
from downloaderforreddit.
Related Issues (20)
- Crash when downloading users HOT 3
- Reddit new API restrictions. Will it impact DownloaderForReddit? HOT 1
- Downloading "pauses" intermittently HOT 3
- Some downloaded files are named `None`
- How can I download comments I left under other people's posts? HOT 1
- Downloader for Reddit doesn't seem to capture shortened reddit links HOT 1
- Extremely slow download speed and high runtime HOT 8
- Getting more crashes since Reddit API change. HOT 7
- Invalid User Names HOT 9
- App Crashes When Viewing Failed Downloads
- Slow download/validation speed. HOT 3
- Cannot Download Files, and Attempting to change Settings Crashes Program
- Deleted Imgur pictures is saved as .mp4
- Download saved posts
- New version HOT 1
- Feature: Open in Reddit
- Failed auth still sign in as None's Reddit account
- BUGS: Crashing and multiple issues with users
- can't launch HOT 1
- Use config.toml for all lists and not just default
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from downloaderforreddit.