Comments (7)
@pkruithof which version of Meilisearch? There's a memory leak issue with 1.8 and up. So I'm using 1.7.6 now instead.
from meilisearch.
Hey @pkruithof 👋
@iamriajul is right there is a leak in v1.8.0 and v1.8.1. We are investigating in this Discord channel and on this GitHub issue. At this point we think we have found the root cause and are deploying a fix soon.
Sorry for the inconvenience 😞
from meilisearch.
v1.8.3 with the fix has been released @iamriajul
from meilisearch.
An open issue regarding this in the sysinfo
repo: GuillaumeGomez/sysinfo#207
from meilisearch.
Hello @iamriajul
Thanks for the report. This is indeed an issue we know
For example when using K8s, by default Meilisearch uses
- the RAM of the node
- the CPU of the pod
The workaround is indeed to set your limit manually.
from meilisearch.
The workaround is indeed to set your limit manually.
I was going to report an issue, but I found this comment so I'm asking it here instead: we're trying out Meilisearch in our K8S cluster, and found that it kept on increasing memory usage over time. Up to the point it gets restarted by K8S. We've set the MEILI_MAX_INDEXING_MEMORY
environment variable to 1300Mb
(the memory resources are set to 1000Mi/1.95Gi
), but it still shows a sawtooth graph:
The --help
output shows that it's picking up the variable at least:
--max-indexing-memory <MAX_INDEXING_MEMORY>
Sets the maximum amount of RAM Meilisearch can use when indexing. By default, Meilisearch uses no more than two thirds of available memory
[env: MEILI_MAX_INDEXING_MEMORY=1300Mb]
[default: "10.42 GiB"]
I would have expected the line to drop — or at least stabilise — around the 1.4G mark. Is this not working correctly, or are we doing something wrong here?
from meilisearch.
Ah, I didn't know that. We're using version 1.8 indeed. Do you have more information about the leak and if/when it's fixed? Maybe we'll have to downgrade for now as well.
from meilisearch.
Related Issues (20)
- Federated search
- Tasks processing seems to block at some point
- Language settings
- Document DB compression
- Exp - Update documents with a function
- Upgrade dependencies
- Improve usage of the rest embedder HOT 3
- Vector store feature: improve test coverage HOT 2
- [investigation] LMDB RAM consumption is not restricted HOT 1
- RFC: make `documentTemplate` mandatory and remove `{{fields}}` syntax
- Missing apt package for ubuntu jammy HOT 1
- Improve the intersection and unions in the search pipeline
- Update minimal ubuntu version supported by Meilisearch
- Stop opening indexes to only check if they exists HOT 1
- [Experimental] Webhook and health route improvements
- Catch the `MDB_TXN_FULL` error and reduce the batch size to eventually succeed
- Meilisearch: Self-hosted cloud deployment network connection stalling
- About two major LMDB optimisation tricks HOT 1
- Update version in Cargo.toml for v1.8.4 HOT 1
- AI quality-of-life improvements for v1.10
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from meilisearch.