runtime configuration Elasticsearch cluster URL about snow-owl

[cmark]

Hi @martinmart92,

Well, with the current implementation you have three options:

1. Mount a customized snowowl.yml file for each Snow Owl docker container instance (eg. using volume mounts) where you specify the repository.index.clusterUrl parameter to the desired value.
2. Mount an external file just like in the first option, but use environment variables to specify the values. See this portion of the documentation: https://docs.b2i.sg/snow-owl/index-1/index-1#environment-variable-substitution
3. Build a custom image where you can customize the settings you want via env vars baked into the default snowowl.yml config file.

I hope this helps.
Let me know if you have any further questions.
Cheers,
Mark

[martinmart92]

Hi @cmark thanks for your answer, I am actually trying the third option, and I am looking into the syntax:

I added a new line at the end of the /usr/share/snowowl/configuration/snowowl.yml file:
repository.index.clusterUrl: https://vpc-es-snowowl-some-path.eu-west-1.es.amazonaws.com

would that be correct?
In an first test, when starting the docker container, I saw the following logs containing Embedded elasticsearch is up and running. :

WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by com.b2international.index.Activator (file:/usr/share/snowowl/plugins/com.b2international.index_7.2.0.201911141538.jar) to field java.lang.reflect.Field.modifiers
WARNING: Please consider reporting this to the maintainers of com.b2international.index.Activator
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
[2019-11-18T12:54:52.128] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.hibernate.validator.internal.util.Version                    HV000001: Hibernate Validator 5.1.1.Final 
[2019-11-18T12:54:52.740] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          Home path: /usr/share/snowowl 
[2019-11-18T12:54:52.741] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          Config path: /usr/share/snowowl/configuration 
[2019-11-18T12:54:52.741] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          Data path: /usr/share/snowowl/resources 
[2019-11-18T12:54:52.742] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          loaded plugin [com.b2international.snowowl.core.attachments.AttachmentPlugin] 
[2019-11-18T12:54:52.743] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          loaded plugin [com.b2international.snowowl.core.internal.SnowOwlPlugin] 
[2019-11-18T12:54:52.743] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          loaded plugin [com.b2international.snowowl.core.internal.validation.ValidationPlugin] 
[2019-11-18T12:54:52.743] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          loaded plugin [com.b2international.snowowl.core.rate.ApiPlugin] 
[2019-11-18T12:54:52.743] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          loaded plugin [com.b2international.snowowl.core.repository.RepositoryPlugin] 
[2019-11-18T12:54:52.744] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          loaded plugin [com.b2international.snowowl.datastore.oplock.impl.LockPlugin] 
[2019-11-18T12:54:52.744] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          loaded plugin [com.b2international.snowowl.identity.IdentityPlugin] 
[2019-11-18T12:54:52.744] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          loaded plugin [com.b2international.snowowl.snomed.cis.SnomedIdentifierPlugin] 
[2019-11-18T12:54:52.744] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          loaded plugin [com.b2international.snowowl.snomed.core.SnomedPlugin] 
[2019-11-18T12:54:52.744] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          loaded plugin [com.b2international.snowowl.snomed.reasoner.SnomedReasonerPlugin] 
[2019-11-18T12:54:52.744] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 snowowl                                                          Initializing... 
[2019-11-18T12:54:53.009] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 identity                                                         Configured identity providers [file@/usr/share/snowowl/configuration/users] 
[2019-11-18T12:54:54.835] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.env.NodeEnvironment                            using [1] data paths, mounts [[/ (overlay)]], net usable_space [88.5gb], net total_space [99.9gb], types [overlay] 
[2019-11-18T12:54:54.842] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.env.NodeEnvironment                            heap size [5.9gb], compressed ordinary object pointers [true] 
[2019-11-18T12:54:54.843] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.node.Node                                      node name [elastic-snowowl], node ID [nXPl1IqsT5isfWYamgCytw] 
[2019-11-18T12:54:54.844] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.node.Node                                      version[6.8.2], pid[1], build[unknown/unknown/b506955/2019-07-24T15:24:41.545295Z], OS[Linux/4.14.146-119.123.amzn2.x86_64/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/11.0.5/11.0.5+10-LTS] 
[2019-11-18T12:54:54.844] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.node.Node                                      JVM arguments [-Xms6g, -Xmx6g, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dosgi.noShutdown=true, -Dosgi.classloader.type=nonparallel, -Dosgi.console=2501, -XX:+AlwaysLockClassLoader, -Djetty.port=8080, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+HeapDumpOnOutOfMemoryError, -Djdk.security.defaultKeySize=DSA:1024, -Djava.io.tmpdir=/usr/share/snowowl/work/tmp, -Dosgi.install.area=/usr/share/snowowl, -Dosgi.configuration.area=/usr/share/snowowl/work] 
[2019-11-18T12:54:55.014] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.plugins.PluginsService                         no modules loaded 
[2019-11-18T12:54:55.015] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.plugins.PluginsService                         loaded plugin [org.elasticsearch.analysis.common.CommonAnalysisPlugin] 
[2019-11-18T12:54:55.015] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.plugins.PluginsService                         loaded plugin [org.elasticsearch.index.rankeval.RankEvalPlugin] 
[2019-11-18T12:54:55.015] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.plugins.PluginsService                         loaded plugin [org.elasticsearch.index.reindex.ReindexPlugin] 
[2019-11-18T12:54:55.016] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.plugins.PluginsService                         loaded plugin [org.elasticsearch.join.ParentJoinPlugin] 
[2019-11-18T12:54:55.016] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.plugins.PluginsService                         loaded plugin [org.elasticsearch.painless.PainlessPlugin] 
[2019-11-18T12:54:55.016] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.plugins.PluginsService                         loaded plugin [org.elasticsearch.percolator.PercolatorPlugin] 
[2019-11-18T12:54:55.016] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.plugins.PluginsService                         loaded plugin [org.elasticsearch.search.aggregations.matrix.MatrixAggregationPlugin] 
[2019-11-18T12:54:55.016] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.plugins.PluginsService                         loaded plugin [org.elasticsearch.transport.Netty4Plugin] 
[2019-11-18T12:54:57.983] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.discovery.DiscoveryModule                      using discovery type [single-node] and host providers [settings] 
[2019-11-18T12:54:58.460] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.node.Node                                      initialized 
[2019-11-18T12:54:58.460] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.node.Node                                      starting ... 
[2019-11-18T12:54:58.575] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.transport.TransportService                     publish_address {127.0.0.1:9300}, bound_addresses {127.0.0.1:9300} 
[2019-11-18T12:54:58.622] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.http.netty4.Netty4HttpServerTransport          publish_address {127.0.0.1:9200}, bound_addresses {127.0.0.1:9200} 
[2019-11-18T12:54:58.622] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 org.elasticsearch.node.Node                                      started 
[2019-11-18T12:54:58.633] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 elastic.snowowl                                                  Waiting for pending cluster tasks to finish. 
[2019-11-18T12:54:58.664] INFO  [elastic-snowowl][masterService#updateTask][T#1] org.elasticsearch.gateway.GatewayService                         recovered [0] indices into cluster_state 
[2019-11-18T12:54:58.714] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 elastic.snowowl                                                  Waiting for pending cluster tasks to finish. 
[2019-11-18T12:54:58.714] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 elastic.snowowl                                                  Embedded elasticsearch is up and running. 
[2019-11-18T12:54:58.724] INFO   Container: 7cdf83ef-c9bf-450d-aa97-76c5fefbd676 index.validations                                                Preparing 'validations' indexes... 

what would show the log if the separate Elasticsearch were used?
thanks!

[martinmart92]

splitting with multi-lines YML format (instead of one line) did work! closing