ajaykhetan / cachesinvestigation

Caches investigation

Guava cache vs EhCache

---

Linux

Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz(8 CPUs)

32 Gb RAM

1. Time execution

Operation	EhCache	Guava cache
put 100	194.16 μs	352.42 μs
put 10_000	4.505 ms	2.469 ms
put 1_000_000	579.31 ms	352.65 ms
get 100	99.85 μs	264.43 μs
get 10_000	4.07 ms	2.89 ms
get 1_000_000	408.88 ms	296.34 ms

Guava cache loses only when small number of elements but when number of elements more then time execution of Guava cache implementation is better almost half.

How I tested I run every test 20 times and get last 10 values. First 10 values I skipped because I think this is not correct values because computer is dispersing

Test example

	
        @Test
        public void testGuavaCachePut1_000_000(){
            measure(MEASURE_TIMES, () -> {
                final int size = 1_000_000;
                final GuavaCache guavaCache = new GuavaCache(size);

                final Stream<DomainObject> domainObjects = generatePayload(size);
                calculateTimeExecuting(domainObjects, guavaCache::push);

                Assert.assertTrue("Error GuavaCache size different:", guavaCache.size() == size);
                guavaCache.cleanUp();
            });
       }
	

         public void measure(int times, Runnable testSuite){
             for(int i = 0; i < times; i++){
                 testSuite.run();
             }
         }
	

2. Thread safe

Both are thread-safe caches

3. Docs

Guava cache - https://github.com/google/guava/wiki/CachesExplained

EhCache - http://www.ehcache.org/documentation/

Documentation for EhCache obviously better than in Guava cache. Google provide us only wiki on github with examples but EhCache provides us full documentation with explanation and a lot of examples

4. Community

https://github.com/google/guava

https://github.com/ehcache/ehcache3

Both guava cache and ehcache are now being developed it can be seen by stars and numbers who watched projects of course guava has better statistic because there are a lot of direction except the cache

5. Features

Feature	EhCache	Guava cache
Generics	no	yes
Transformation asMap	no	yes
Cache Manager	yes	no
CacheLoader	yes	yes
Extensions	yes	yes
Eviction by Size	yes	yes
Eviction by Time	yes	yes
Statistics	yes	yes

All tests are here

---

Benchmark result

Result "com.investigation.guava.benchmark.GuavaCacheBenchmark.push":`

• 290.596 ±(99.9%) 128.686 ns/op [Average]
• (min, avg, max) = (157.674, 290.596, 388.434), stdev = 85.118
• CI (99.9%): [161.911, 419.282] (assumes normal distribution)

Result "com.investigation.guava.benchmark.GuavaCacheBenchmark.getPut":

• 388.225 ±(99.9%) 334.280 ns/op [Average]
• (min, avg, max) = (188.616, 388.225, 790.026), stdev = 221.106
• CI (99.9%): [53.945, 722.505] (assumes normal distribution)

Result "com.investigation.guava.benchmark.GuavaCacheBenchmark.get":

• 101.170 ±(99.9%) 312.169 ns/op [Average]
• (min, avg, max) = (17.823, 101.170, 684.813), stdev = 206.480
• CI (99.9%): [≈ 0, 413.339] (assumes normal distribution)

Result "com.investigation.ehcache.benchmark.EhCacheBenchmark.push":

• 672.224 ±(99.9%) 735.043 ns/op [Average]
• (min, avg, max) = (357.479, 672.224, 1959.890), stdev = 486.185
• CI (99.9%): [≈ 0, 1407.267] (assumes normal distribution)

Result "com.investigation.ehcache.benchmark.EhCacheBenchmark.getPut":

• 878.802 ±(99.9%) 887.920 ns/op [Average]
• (min, avg, max) = (526.381, 878.802, 2347.393), stdev = 587.304
• CI (99.9%): [≈ 0, 1766.722] (assumes normal distribution)

Result "com.investigation.ehcache.benchmark.EhCacheBenchmark.get":

• 134.799 ±(99.9%) 90.149 ns/op [Average]
• (min, avg, max) = (59.389, 134.799, 260.582), stdev = 59.628
• CI (99.9%): [44.650, 224.949] (assumes normal distribution)

Benchmark	Mode	Cnt	Score	Error	Units
EhCacheBenchmark.get	avgt	10	176.414	± 129.249	ns/op
EhCacheBenchmark.getAdd	avgt	10	456.254	± 456.254	ns/op
EhCacheBenchmark.add	avgt	10	360.040	± 360.040	ns/op
GuavaCacheBenchmark.get	avgt	10	417.519	± 1852.250	ns/op
GuavaCacheBenchmark.getAdd	avgt	10	301.317	± 156.990	ns/op
GuavaCacheBenchmark.add	avgt	10	121.100	± 52.495	ns/op
CoffeineCacheBenchmark.get	avgt	10	68.528	± 73.959	ns/op
CoffeineCacheBenchmark.getAdd	avgt	10	101.232	± 66.103	ns/op
CoffeineCacheBenchmark.add	avgt	10	139.562	± 84.309	ns/op
CQEngineCacheBenchmark.get	avgt	10	2778.847	± 10868.407	ns/op
CQEngineCacheBenchmark.getAdd	avgt	10	1925.592	± 2387.369	ns/op
CQEngineCacheBenchmark.add	avgt	10	552.958	± 659.467	ns/op

Виктор Гамов — JCache и распределенные кэши: беспредел!

---

In order to run benchmarking

• mvn clean install -DskipTests
• java -jar target/benchmarks.jar

More examples: http://tutorials.jenkov.com/java-performance/jmh.html