Coder Social home page Coder Social logo

adamelso / albumgrab Goto Github PK

View Code? Open in Web Editor NEW
11.0 11.0 4.0 83 KB

CLI tool to automatically crawl and download all photos on a media platform without having to visit and save each photo manually, saving time (and sanity) - Uses: PHP 7; V8 JS; Symfony 3 components; Blackfire Player

License: MIT License

PHP 82.43% Gherkin 17.57%

albumgrab's People

Contributors

adamelso avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

albumgrab's Issues

Built in support for Facebook in multiple languages

In order to avoid having to explicitly pass in the option `--next="Next"` to Albumgrab
As a user
I want Facebook in my detected language to be automatically recognized by Albumgrab

This can be done by iterating over all possible translations for the word Next, starting with English, then followed by the most popular languages for Facebook. Note that this will differ from the most popular languages worldwide.

Get Error

When I try to download the pictures i get the following error:

[InvalidArgumentException]
The current node list is empty.

can you help?

New Facebook adaptor

Travis tests are now broken because Facebook have changed their DOM.

This is would be a good opportunity to rewrite the main command.

Upgrade Goutte to 2.0

This uses Guzzle 4 and requires PHP 5.4, but fits in with the current requirements.

Package as a single executable file

By adding a box.json file and packaging the app as a single PHAR file, this will allow the tool to be used without needing to install Composer or Git.

Use Blackfire Player

From the documentation:

Blackfire Player is a powerful Web Crawling, Web Testing, and Web Scraper library for PHP. It provides a nice API to crawl HTTP services, assert responses, and extract data from HTML/XML/JSON responses

This will replace direct use of Goutte.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.