chuckmac / tadpoles-scraper Goto Github PK

Hi
thanks for this scraper, could save me a few hours of clicking 2 years of links

Starting Tadpoles Scraper...
-- Authenticating [email protected]
Authentication Error

x2 checked my user and password it is correct.
anything else

Bright horizons "my bright day" app accounts don't work, but I think they run tadpoles too. Can the script be edited to use their domain?

Awesome that I found this - saved me many hours of saving images as my child is moving schools and leaving tadpoles. Will do a bit of digging to see if I can add - would be very useful if you could also save the associated text with the tadpoles image entry with an identically named .txt file.

I'd like to propose changing the supported file types to include PDF files.

Locally I added this in the large if-else if block around line 196:

} else if (response.headers['content-type'] == 'application/pdf') {
    filename = dirbase + filebase + '.pdf'
    fs.writeFileSync(filename, response.data)
}

The caveat with the change is that it is always re-downloaded -- so some extra work would be needed in the "maybe"-named functions. I'm happy to submit a PR for this as well.

First, outstanding. This saved me so much time, downloading and EXIF-ing thousands of photos from TadPoles spread out over years. Couldn't have been a more perfect fit for my need.
The only thing I ran into was my TadPoles account is linked through Google and not a dedicated email/password combo. I worked around this by creating a new Tadpoles account with a non-gmail address (e.g. comcast.net) and then requesting an account migration from the TadPoles' site to my new account, from my gmail. The migration took a few hours, and appears to have effectively cloned the entire set from my gmail Tadpoles to my comcast Tadpoles account. The data exists in both now. So, this is just a recommendation that you could add something to this effect to the documentation, because I'm sure many others are using gmail / google authentication. Thanks again!

Anyone know how to fix this error?:

Error: Cannot find module '@ronomon/utimes'

Thanks so much for making this, it's a life saver. The release archive no longer seems to be able to satisfy its dependencies, but it's also not doing much work because it just contains the source files anyway. Might be worth removing that release to avoid confusion (I personally spent ages trying to get it to work...).

Also, npm wanted to upgrade Axios for me, but doing so causes Axios errors that break the "Admit" step in the script, so may be be worth calling that out in the instructions.

Thanks again!

The JSON date for the "last" (or most recent) event is never downloaded. I feel this is due to the Tadpoles API treating the JSON date as an exclusive boundary rather than an inclusive boundary. I've tested this hypothesis locally by modifying line 292 in index.js:

lastitem = info.data.last_event_time

... to:

lastitem = info.data.last_event_time + 1000

Doing this change allowed the most recent event image to be detected in the "events" JSON payload, and was downloaded locally.

I'm happy to submit a PR for this as well.