A 8G .aof file lead redis loading so slowly... about redis

[GoogleCodeExporter]

The aof data file is almost 10GB, if somebody need, I can send to you by email.

Original comment by [email protected] on 29 Aug 2011 at 2:11

[GoogleCodeExporter]

Can you post INFO output of the instance when it is running (not necessarily 
with a fully loaded database)? You mention the size of the AOF is about 8G, 
what is the in-memory size of the data set?

My guess is that you approach and reach the 32G limit of physical memory while 
loading the AOF. The "maxmemory" directive is only enforced *after* the entire 
AOF is loaded, because commands may be dependent and Redis may not remove keys 
before the entire state is restored. 

Original comment by [email protected] on 30 Aug 2011 at 5:14

[GoogleCodeExporter]

Pieter, do you think the maxmemory directive was set later while the server was 
already running? Otherwise the synthesized DELs should not lead to the use of 
more memory than expected since eviction will be performed while reading the 
AOF file thanks to this DELs commands.

We need some info about how the RSS is growing while Redis is loading the file 
perhaps.
Also, the INFO command works while the AOF is being loaded, so sampling Redis 
with INFO while the loading is happening is a very good idea.

Cheers,
Salvatore

Original comment by [email protected] on 14 Sep 2011 at 3:52

• Changed state: User-Wait