likeastore / elaster Goto Github PK

js-bson: Failed to load c++ bson extension, using pure JS version
/home/ec2-user/elaster/node_modules/mongojs/index.js:494
var p = Proxy.create({
TypeError: Proxy.create is not a function
at Function.connect (/home/ec2-user/elaster/node_modules/mongojs/index.js:494:17)
at module.exports (/home/ec2-user/elaster/source/db/index.js:8:15)
at Object. (/home/ec2-user/elaster/source/elaster.js:6:25)
at Module._compile (module.js:417:34)
at Object.Module._extensions..js (module.js:426:10)
at Module.load (module.js:357:32)
at Function.Module._load (module.js:314:12)
at Module.require (module.js:367:17)
at require (internal/module.js:16:19)

When I run elaster I get:

I:\Projeler\nodejs\elaster\node_modules\elasticsearch\src\lib\log.js:65
Log.prototype.listenerCount = function (event) {
^

RangeError: Maximum call stack size exceeded
at Log.listenerCount (I:\Projeler\nodejs\elaster\node_modules\elasticsearch\src\lib\log.js:65:40)
at Function.EventEmitter.listenerCount (events.js:399:20)
at Log.listenerCount (I:\Projeler\nodejs\elaster\node_modules\elasticsearch\src\lib\log.js:68:25)
at Function.EventEmitter.listenerCount (events.js:399:20)
at Log.listenerCount (I:\Projeler\nodejs\elaster\node_modules\elasticsearch\src\lib\log.js:68:25)
at Function.EventEmitter.listenerCount (events.js:399:20)
at Log.listenerCount (I:\Projeler\nodejs\elaster\node_modules\elasticsearch\src\lib\log.js:68:25)
at Function.EventEmitter.listenerCount (events.js:399:20)
at Log.listenerCount (I:\Projeler\nodejs\elaster\node_modules\elasticsearch\src\lib\log.js:68:25)
at Function.EventEmitter.listenerCount (events.js:399:20)

Hi,

I have { [Error: No Living connections] message: 'No Living connections' } which is weird because I am sure Elastic search is running:

$ curl http://localhost:9200/

{
  "status" : 200,
  "name" : "Delilah",
  "cluster_name" : "elasticsearch_vikti",
  "version" : {
    "number" : "1.6.0",
    "build_hash" : "cdd3ac4dde4f69524ec0a14de3828cb95bbb86d0",
    "build_timestamp" : "2015-06-09T13:36:34Z",
    "build_snapshot" : false,
    "lucene_version" : "4.10.4"
  },
  "tagline" : "You Know, for Search"
}

node: v0.12.7
elasticsearch: 1.6.0
mongo: 3.0

Any idea on this ?

Ran elastic and it found 0 documents to export. There a millions of documents to export. How is it that it found none? Is there a config setting I could have possibly screwed up?

Firstly, thanks for making elaster 👍 !

I have a question - does elaster do a partial or whole update for existing documents?

./elaster
var collections = config.collections.map(function (c)
My config
module.exports = {
mongo: {
connection: 'mongodb://192.168.1.208:27017/publicdb'
},

    elastic: {
            host: {
                    host: 'http://192.168.1.143:9200'
            },

            requestTimeout: 5000
    },

    collections:  {
            name: 'org_name',
            index: 'org_name',
            type: 'collection',
            fields: ['_id','fullName','_etag'],
            mappings: {
                    'org_name': {
                            'properties': {
                                    'fullName': {
                                            'type': 'string'
                                    }
                            }
                    }
            }
    }

};

What am I doing wrong?
P.S. I`m speak rus)

@alexbeletsky
If I have a field in a mongodb collection, can I feed this as a parent_id, as per the bulk API, and push the rest of the fields to a documents in elasticsearch using elaster? If so, would you be able to give me the right form of the configuration?
I see you mention highland.js in one of your other issues. If this might be an alternative tool to getting this done, would you be able to point me to a working example?
Many thanks for your input.

Hey im having this error
RangeError: Maximum call stack size exceeded
at Log.listenerCount (/home/ec2-user/projects/elaster/node_modules/elasticsearch/src/lib/log.js:65:40)
at Function.EventEmitter.listenerCount (events.js:447:20)
at Log.listenerCount (/home/ec2-user/projects/elaster/node_modules/elasticsearch/src/lib/log.js:68:25)
at Function.EventEmitter.listenerCount (events.js:447:20)
at Log.listenerCount (/home/ec2-user/projects/elaster/node_modules/elasticsearch/src/lib/log.js:68:25)
at Function.EventEmitter.listenerCount (events.js:447:20)
at Log.listenerCount (/home/ec2-user/projects/elaster/node_modules/elasticsearch/src/lib/log.js:68:25)
at Function.EventEmitter.listenerCount (events.js:447:20)
at Log.listenerCount (/home/ec2-user/projects/elaster/node_modules/elasticsearch/src/lib/log.js:68:25)
at Function.EventEmitter.listenerCount (events.js:447:20)

Does elaster use bulk indexing? or indexes each document separately?

Also will it be possible to ignore errors? Because of some rogue documents with wrong mappings the entire export gets cancelled.