graalvm / clamh

CLAMH (Cross-LAnguage Microbenchmark Harness) is a language-independent benchmark harness design and the implementation of that design for different languages.

Quick links

Full CLAMH User's Guide (md)

What is CLAMH?

CLAMH is

1. A language-independent benchmark harness design

2. The implementation of that design for different languages.

The CLAMH design closely follows the design of JMH, the preeminent benchmark harness for Java. Since the Java Micro-benchmark Harness (JMH) already achieves the goals of CLAMH for the Java language, the runnable benchmark files generated by CLAMH for other languages are designed to be directly comparable to JMH benchmarks for Java.

Quick Start

See the "Quick Start" section in the CLAMH User's Guide (links above) to get started.

Language Support

At the moment, CLAMH supports C++, Java, and Javascript.

Platform/Compiler/VM Support

CLAMH has been tested on RedHat Enterprise Linux, Ubuntu Linux, Windows cygwin, and MacOS, on x86 and aarch64 hardware.

CLAMH-C++ has been tested with gcc and clang.

CLAMH-Java has been tested with HotSpot JDKs 8, 11, 15, and 16, and GraalVM.

CLAMH-JS has been tested with node.js.

clamh's Issues

Link to http://d3s.mff.cuni.cz/publications/download/KaliberaBulejTuma-BenchmarkPrecision.pdf is dead

Hi:

I was curious about the paper linked in the user guide, unfortunately, the links give a 404 (http://d3s.mff.cuni.cz/publications/download/KaliberaBulejTuma-BenchmarkPrecision.pdf).

What's the title of the paper?

And since I am already here, I was wondering whether you saw Cross-Language Compiler Benchmarking
Are We Fast Yet? and whether you consider any of the suggestions in there useful for cross-language benchmarking.