kararty / darah

Discord Auto Record Archiver Heroine

Hi there 👋

Personal profile (You're here): @KararTY

School profile: @Karar-Al

Work profile: @AlRemahy

darah's Issues

Feature request?

Hi KararTY,

I think this is more of a feature request rather than an issue but I don't use github a lot and I'm not sure where else to put it.. Close this up if it's not the place for it.

With the zipped backups, I'd like for the ability to combine them? I really enjoy the incremental backup feature using CRON but I don't like having more than one zip in the archive folder. I know myself or others will delete posts and that may mean a previous backup zip may have a post which the latest backup doesn't have.

Alternatively the service could continually run and archive all posts as they're made?

Thanks for your hard work with this archiver, myself and i'm sure others really appreciate you putting the effort into making this.

New Discord Developer's Terms of Service.

https://www.reddit.com/r/discordapp/comments/6sq866/the_developer_terms_of_service_have_just_been/
This script breaks the discord developer's terms of service. Need to add disclaimer.

SIGINT not working on Windows

DARAH/src/discord.js

Line 129 in 10e1111

process.on('SIGINT', function () {

Doesn't work on Windows Powershell.

Upcoming features list - VERSION 3.6

Version 3.6

Follow dev branch for updates.

• Proper incremental archives. + Separate directory for every guild.
  (#11 ?)
• Option to archive only selected channels.
  (Discussed via PMs)
• If auto is enabled, keep track of new messages (Messages after script came online) that are deleted and put them into their separate array in the outputted files. (#11 ?)
• Add the rest of the available fields. (TTS, NONCE, TYPE, EMBEDS and SYSTEM)
  • Archive embeds.
  • TTS, NONCE, TYPE, SYSTEM
• Add "ALL" option archival to settings variable "guildID".

Fixed bugs

• MAJOR: Typo at edited timestamp variable.
• MAJOR: content returns better results than cleanContent.

Should be released before March 7th, but no promises.

Crash backups have duplicate downloads

Initial crash backup testing suggests that emojis may be duplicated and re-downloaded, but as a new entry in the array.

Edit: All files are duplicated.
Need to implement some kind of manifest check to prevent duplicate downloads.

Support big servers

After every 1000th message, push to file _.json, on runtime. That means I need to keep count of how many messages there are.

Example:

let counter = {
  ChannelID_1: {
    at: 0,          // Every 1000
    iterator: 1  // + 1 this value.
  },
  // ...
}

/** Make sure to clean object[channel.id] every 1000th message
  * to make sure RAM isn't heavily used.
  */

Also add new field to settings.js atEveryXNewFile: 1000 so people can change the amount of messages to keep in every file.

Allow archival after stopping.

Currently DARAH will clear the cache and restart. This is super painful since Discord can sometimes time out and completely stop an operation on a huge server that would take hours to rearchive. I think it would be useful to allow DARAH to continue from cache.