medialab / artoo Goto Github PK

Plus polymorphism for saveCsv method.

If one wants to change page and keeps some persistent state, it will be necessary to create a chrome extension injecting artoo in every page.

With cheerio and request.

Function taking a list of urls and doing something on it. Useful to scrape a bunch of ajax accessible things. Asynchronous or not.

No escaping for the time being.

Save helpers from storage.

artoo.to(url)

//text

Scope issues when using the function as callback

A remote database accessible through a server (localhost for instance), to collect some data that localstorage or downloads could not handle correctly.

Especially store to store.engine to have autoTypes.

Possibility to load masks from remote servers.

For instance:

artoo.loadMask('facebook', cb);

would load selectors and helpers already coded by others and helping to scrape the content of the site.

A client-side spider crawling through several urls thanks to artoo's context.

Keep a persistent state for artoo enabling it to keep a script working through different pages.

Can be loaded from local Storage or remote.

Document how not to be crippled by chrome download safeguards.

• Changing pages and crawling with context
• Overcoming CSP

Remains for series parallel.

Possibility to load artoo if not loaded before.