shalvah / downloadthisvideo

Twitter bot for easily downloading videos/GIFs off tweets

shalvah

Shalvah (yes, me😝) on your command-line.

npm install -g shalvah

shalvah

Seriously, I got bored of websites and turned my personal site into a Node package. ¯_(ツ)_/¯

There's still a website, though. It makes use of this package. Oh, and I wrote a thing about how I built this package.

downloadthisvideo's Issues

Twitter linking is broken

I can click "Enable notifications" and it asks to sign in to Twitter to authorize the action. I go through the authorization and the redirect takes me to localhost on port 8080.

Investigate Redis connection issues

This error was observed at 03:04:39 on 20 March 2019:

ERR max number of clients reached

Around that time, AWS Lambda says there were 309 concurrent invocations. (a local maximum, but not the highest that day). The Redis instance logs show no unusual activity.

This can probably be mitigated by using connection pooling (which is not trivial to implement in a serverless environment.

Add support for Vines

Downloading Vine videos doesn't work. The app throws a NoVideoInTweet error, because no media entities show up in the tweet object.

Sample tweet containing Vine:

{
    "created_at": "Wed Jul 04 01:28:00 +0000 2018",
    "id": 1014319887248961500,
    "id_str": "1014319887248961536",
    "full_text": "Running away from ur responsibilities like https://t.co/JgisIc1c1f",
    "truncated": false,
    "display_text_range": [
        0,
        66
    ],
    "entities": {
        "hashtags": [],
        "symbols": [],
        "user_mentions": [],
        "urls": [
            {
                "url": "https://t.co/JgisIc1c1f",
                "expanded_url": "http://vine.co/v/iV3lbUwgYDX",
                "display_url": "vine.co/v/iV3lbUwgYDX",
                "indices": [
                    43,
                    66
                ]
            }
        ]
    },
    "source": "<a href=\"https://buffer.com\" rel=\"nofollow\">Buffer</a>",
    "in_reply_to_status_id": null,
    "in_reply_to_status_id_str": null,
    "in_reply_to_user_id": null,
    "in_reply_to_user_id_str": null,
    "in_reply_to_screen_name": null,
    "user": {
        // ...
    },
    "geo": null,
    "coordinates": null,
    "place": null,
    "contributors": null,
    "is_quote_status": false,
    "retweet_count": 11134,
    "favorite_count": 19079,
    "favorited": false,
    "retweeted": false,
    "possibly_sensitive": false,
    "lang": "en"
}

You can see that the Vine video shows up as a url, rather than as media. We could return the expanded_url property, but that only links to the Vine page.

Useful resources

• https://stackoverflow.com/questions/14549745/how-to-get-vine-video-url - Seems to be outdated. None of these methods work anymore.
• http://www.vpeeker.com/video - Apparently, vine uses its custom CDN now (the video_url property). The trick is obtaining that,

Twitter livestream vids aren't downloadable

Does not work on this live broadcast that was made on the Twitter app: https://twitter.com/amybarnes_usa/status/1119078666552664067

PWA support

Hi Shalvah, I was thinking instead of opening the browser every time, wouldn't it be nice if the web app is made an installable PWA?

i18n capabilities

Related issue:
#15

Why is it that hard?

1. Check the mentioner's language (profile or account or something)
2. Original post language (maybe some metadata, or custom detection logic from the tweet body.
3. A custom bot parameter e.g.: @this_vid en or @this_vid_en or @this_vid lang:en or something

I do not want to fork the repository. I might open a pull request with a solution, but I need your guidance!

1. Twitter mention API provides a user object and there is a lang field in it.
2. The code is looking for the referenced tweet as well and twitter status lookup API provides a similar (if not the same) user object with a lang field

So as far as I see we can accomplish the i18n-ing. I can create a pull request.
Any extra info @shalvah?

Massive edit:

https://developer.twitter.com/en/docs/tweets/data-dictionary/overview/user-object

lang | null | Value will be set to null. Still available via GET account/settings as language

Oh what a pity!

Set up monitoring and alerting via CloudWatch

At the least, we need to monitor unexpected errors and alert when they pass a certain threshold.

Add FAQ page

See https://twitter.com/theshalvah/status/1074762709261012992.

We'll link to these FAQs in the bot's bio, on download pages, and possibly throw it in the occasional reply.

Render time units properly

On downloads page, it currently shows "1 hours ago", "1 days ago". Need to fix this.

Automated replies don't show up under the tweet and in notifications

Even though the bot has replied to a tweet (and the reply count reflects this), the reply does not show up when you click on the tweet, neither is a notification dispatched. The only way to view the reply is if you're following the bot, in which case it shows up on your timeline.

Can i change the language?

Hi there
Is it possible to change language?

Add Travis CI

So deploys don't need to depend on the maintainer's machine

How To install

Hello, I'm having trouble installing. I sent a message to the producer, no response. How can I install? What files should I configure other than the .env file?

Add favicon and Title to /beta/USERNAME

Currently, /beta/USERNAME doesn't show any <title>, instead just a URL - this may be confusing for some users, and showing something like "This_Vid - @USERNAME" might be a better idea. Furthermore, no favicon is included, which means in some browsers the site might look slightly off.

I completely understand that these are pedantic issues and I completely understand if you close the issue, it'd just be nicer as formatting 😉

No check for being blocked

If you're going to make an account that lets people just freeboot stuff without consent, you could at least make it opt-out