andrewvc / ee-datasets Goto Github PK

It's probably worth importing some of it in some way. I'm not sure if this is the appropriate repository for it, but I thought I would bring it up.

Here's a link to some of the datasets: https://developers.google.com/freebase/data

Other projects use a subset of this data for their examples, like cayley with the file 30kmoviedata.nt.gz.

Admittedly, there are tons and tons of datasets on the internet, there may be some that are of more interest for Elasticsearch.

Really, I was looking for more not small and not large datasets, but those of the medium-sized variety (say 100,000 entries).

Hi Andrew,

I tried to reuse your loader for nested data (more than one level) and data having timestamps and I kind of had a hard time with this.

If you look at my data in the fork (companies.X.eloader) those files do not upload to ES properly. Would you have any advice / data cleaning tool to make this work?

Thx,
Sam

when I've ran import command it showed me a warning:

java -jar elastic-loader.jar http://localhost:9200 datasets/movie-db.eloader                                                         [20:27:01]
[INFO] Reading from datasets/movie-db.eloader
[INFO] DELETE /movie_db (bytes 0)
[WARN] Could not execute statement at line 1: Ignoring error due to TRY. Error: clj-http: status 404
[INFO] PUT /movie_db (bytes 352)
[INFO] BULK INDEX /movie_db/movie

is it just warning or something really went wrong while importing?