Comments (11)
at least from k8s side,
As long as the PVC is not deleted, the actual data is safe, but backups are always the best practice.
Create a dump and back it up elsewhere before upgrading.
from meilisearch-kubernetes.
When working with K8S pods which is stateless service.
It's so good if I we can create/export (download)/import dumbs remotely.
from meilisearch-kubernetes.
For whom it may help. I found a manual way to do the upgrade. The official guide https://www.meilisearch.com/docs/learn/update_and_migration/updating#update-to-the-latest-meilisearch-version works in principle with some modifications.
- Just to be on the safe side: Stop the services that actually use meilisearch (gitea in my case)
kubectl -n gitea exec -it meilisearch-0 -- sh
and dump the database as described.mv /meili_data/data.ms /meili_data/data.ms.old
(actually works without terminating meilisearch)- deploy the new container
kubectl -n gitea exec -it meilisearch-0 -- sh
and import the dump as described.- kill the container to force the restart of meilisearch
- bring the services back that depend on meilisearch
from meilisearch-kubernetes.
And what would be the suggested way to restore such a backup then?
Because currently using --import-dump takes a lot of time which causes the Probes to trigger errors and restarts
I was hoping there was a way to check the progress of an import but I could not find any.
Please advice.
Environment:
- GKE v1.22.13
- Meilisearch version: 1.1.0
from meilisearch-kubernetes.
Hello @jankenr. Sorry for not getting back to you sooner. The backup method for an update is to create a dump. Importing the dump can take time, depending on your dataset. While the task queue is unavailable during a dump import. To monitor the progress of the import, you can always refer to the logs. Can you please let me know the error you trigger during the import?
from meilisearch-kubernetes.
@oluademola , we had a similar issue with upgrading. How can we restore dumps to an updated instance if the probes fail due to version mismatch with existing data on the PVC?
from meilisearch-kubernetes.
@NarHakobyan @jankenr did you ever figure out a better solution for this?
from meilisearch-kubernetes.
Any update for this? i want to migrate to new version because of security patches, but i won't take many times to making dumps and import dump in my cluster, but i can do that even without using kubernetes
from meilisearch-kubernetes.
Today I tried to update the helm chart from version 0.3.0 to 0.4.0 which includes updating meilisearch from 1.5 to 1.6. The meilisearch-0 pod crashed, and the logs told me that the database is not compatible and gave me a link to an upgrade guide.
However, the guide tells that I have to restore the database dump with the new version. But as the container immediately crashes, and I therefore cannot connect with 'kubectl exec': How should I do that? Any advice?
from meilisearch-kubernetes.
We also faced this problem and solved it with a, more or less, way too hacky workaround by using init containers with custom scripts. They check if the database must be migrated, does so if necessary and saves the "state" in simple files. It works, but this is miles away from being the way it should be for a real production environment.
We can share the scripts, or even the whole Kubernetes manifests, but if so it must be clear that these come without any warranty and you're responsible to check and adjust them to fit your needs. At the moment this is all we can give back to this project, but we also hope that the need for a "native" implementation is important to compete on the market when it comes to running Meilisearch in a stable and scalable way.
from meilisearch-kubernetes.
Hello ! I am trying to take dump using curl but my pod is getting crashed with OOMKilled.
I want to upgrade the meilisearch version from v0.27.1 and to upgrade to a new version, I need dump. But when I am executing dump command using Curl, my pod is getting OOM killed . I tried with 5GBs of RAM but still getting OOM killed. There is nothing under dumps folder too.
In the folder /meili_data, I have approx 10 Gbs of data. I don't know why I have file data.mdb. I don't have data.ms
4.0K ./VERSION
60.0K ./auth
9.4G ./data.mdb
4.0K ./dumps
18.8M ./indexes/c763f298-caeb-4a49-9d33-23160e556eda
18.8M ./indexes
4.0K ./instance-uid
8.0K ./lock.mdb
16.0K ./lost+found
4.0K ./updates/updates_files
8.0K ./updates
from meilisearch-kubernetes.
Related Issues (20)
- BUG: Chart renders Invalid YAML when Ingress option is enabled HOT 7
- No namespace property in PersistentVolumeClaim HOT 3
- Helm installation not working HOT 1
- Update to 0.28.1 HOT 1
- Please update to support v.0.29 HOT 1
- Extra curly brace in helm chart ingress template HOT 1
- Add possibility to mount additional volumes on StatefulSet
- Upgrading link leads to 404 HOT 11
- Restart Meilisearch if the configuration has changed
- Make it possible to add labels to Pods exclusively
- Add support to the maintainers list
- Artifact Hub Official status HOT 2
- Remove the possibility to set `replicaCount` to a value other than "1"? HOT 1
- Log output seems to be going to stderr HOT 1
- Run helm-docs on new PRs HOT 1
- Chart updates which require a manual backup restore should be major updates? HOT 4
- Hugging Face embedders not supported without modifying the helm file
- Chart Support for initContainers
- Option to set namespace for ServiceMonitor
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from meilisearch-kubernetes.