Node coming up with latest deployed application version after being down about vespa

[kkraune]

Great question! you will be monitoring https://docs.vespa.ai/en/operations-selfhosted/monitoring.html#/state/v1/health

When nodes come up again, they will get the latest config from the config server. There are ways to inspect detailed config, see https://docs.vespa.ai/en/operations-selfhosted/config-proxy.html#inspecting-config - I have not seen teams using this, though, it is maybe on a too detailed level.

As long as the nodes query the same set of config servers, they will start using the most recent config, and /state/v1/health will be OK once started.

[bratseth]

You can also use the convergence API to check when the deployment is complete.

[107dipan]

@bratseth - We are currently using the convergence API to check the same. But if one node is down during application deployment our deployment is marker failed since the convergence API return it returns false.
If it is guaranteed that whenever a down node comes back up, it shows healthy only with the latest deployed application we can ignore the result from the convergence API when one of the nodes is down since it is guaranteed that node will come back up with the latest.

[bratseth]

Yes, that is guaranteed.

[107dipan]

Thanks a lot!