Can transporter be used to sync a target collection with ElasticSearch? about transporter

[nstott]

There is functionality in place right now to do what you need (if i'm understanding you :)
all that would be needed I imagine is something like this

a config file that looks something similar to:

nodes:
  mongo:
    type: mongo
    uri: mongodb://localhost/admin
  es:
    type: elasticsearch
    uri: https://user:[email protected]:10291/thisgetsignored

and then run transporter on the command line:
transporter eval --config config.yaml 'Source({name:"mongo", namespace:"B.A"}).save({name:"es", namespace: "C.D"})'

[nstott]

Hi,
I'm not entirely sure what you mean with this
If you are asking whether it's possible to take entire documents from different mongo sources and index them into elasticsearch, then that is definitely possible with transporter now, it's just a matter of sepcifying multiple sources in your application.js

however if you're looking at merging documents from different sources into a single document and then indexing that in elasticsearch, that's something that is definitely on the roadmap. Internally we're calling these 'joins', and are looking for good semantics to manage these sorts of operations. When we release this feature, we'll likely be able to take any document and merge it with data from any other source, not necessarily a source from the same database

[kurttheviking]

@nstott thanks for the quick reply; i appreciate it!

In short, yes...it's useful to think of it as a join. I think my question can be reduced to: Is it possible now, or soon in the future, to simply say: "Sync only documents from collection A in database B into Index C of Elasticsearch database D" (The application code can handle the necessary "joining".)

[kurttheviking]

perfect, that's what i was looking for. thank you!

[nstott]

let me know how it goes!