chaphasilor / opendirectorydownloader-gui

OpenDirectoryDownloader as a web service ✨

OpenDirectoryDownloader GUI

This repository returns a server meant to expose the functionality provided by KoalaBear84/OpenDirectoryDownloader through a web service.

A public instance is running at https://open-directory-downloader.herokuapp.com (subject to change).

If you try to scan a site and it doesn't find any links (or the results are otherwise wrong), please open an issue with OpenDirectoryDownloader here.
If you encounter any issues with the tool itself, please let me know by opening an issue in this repository or contacting me directly.

opendirectorydownloader-gui's Issues

Add option to upload finished scans to the discovery server

Just create another checkbox (checked by default) that makes the server upload the results after a successful scan.
Users can deselect the option for privacy.

Disable the option if the user enters auth credentials (because then it's not a true OD anymore). Show a tooltip why the option is disabled in that case.

Implement keepalive requests

Send keepalive requests both via HTTP (to keep the dyno from sleeping while a scan is active) and over the websocket (to prevent the socket being terminated in e.g. Firefox)

'commandEnd' response doesn't stop the timer

ODD errors aren't handled properly

• ODD errors are handled pretty poorly
• The frontend doesn't handle error responses at all

Application error

Herokuapp shows an application error on the site. Fix it please.

Include credits when copying to clipboard

The credits text is not shown on the website right now, which is probably okay (although the ODD repo really should be linked).

But when copying the results to the clipboard, it's easy to just add the credits in there so people always take them with them :P

Save scan history

Use IndexedDB or localStorage to remember and show previous scans, in case the user wants to access them.

Set a size limit so that large scans aren't completely saved, but only the markdown portion.

Use Notification API to let user know once a scan is finished

Request the permission after the user started a scan.
Show a card with a short explanation and a button while a scan is running and the user hasn't granted permissions.
Add a button to dismiss the card for this session.

For now, the regular notifications API is enough, but later on Web Push could be used so that users can close the page and receive a notification once the scan is done (this of course requires a bit more work in the backend)