leon0399 / benchmarks

World's complete programming language benchmark

Complete Benchmark

World's complete programming language benchmark.

Results

Important

This project is not intended to be the sole source for your decisions. Each programming language has its own unique advantages and disadvantages, and performance is only one aspect. Some languages may be more suitable for different projects due to their ecosystem, established best practices, and other factors. Always consider the specific needs and context of your project before making a decision.

See RESULTS.md

Running benchmark

Docker

Run full suite

docker-compose run benchmark python3 ./benchmark.py run

Run specific languages only

docker-compose run benchmark python3 ./benchmark.py run --lang rust go php

Run specific scripts only

docker-compose run benchmark python3 ./benchmark.py run --script primes/Simple linpack/Linpack recursion/Tak

Tip

You can combine options above

Running manually

python3 ./benchmark.py

benchmarks's Issues

Sweep: write `mandelbrot/Simple` in Python

Details

Implement mandelbrot/Simple benchmark in Python, and put it into python/mandelbrot/Simple.py.

You MUST implement it exactly in the same way as in other languages examples: php/mandelbrot/Simple.php, javascript/mandelbrot/Simple.js, ruby/mandelbrot/Simple.rb. Add script to python/benchmark.yaml

Here are other examples of out Python code: python/primes/Atkin.py. Use it to se how collect and report execution time.

Checklist

• Create python/mandelbrot/Simple.py ✓ 5bbec68 Edit
• Running GitHub Actions for python/mandelbrot/Simple.py ✓ Edit
• Modify python/benchmark.yml ✓ 3607879 Edit
• Running GitHub Actions for python/benchmark.yml ✓ Edit

C++ Regexp libraries benchmark

Idea: https://habr.com/ru/articles/812953/

Libraries:

• stdlib
• https://github.com/kokke/tiny-regex-c
• https://github.com/ximtech/Regex
• https://github.com/boostorg/regex
• https://github.com/intel/hyperscan
• https://github.com/google/re2
• https://github.com/hanickadot/compile-time-regular-expressions
• https://github.com/PCRE2Project/pcre2

Loop in Collatz benchmark using gcc

Current behavior

Program goes to infinite loop (on 113382 iteration), which does not happen, when program compiled using clang

Expected behavior

Not to loop 🤷

Steps to reproduce

c-plus-plus $ make all
c-plus-plus $ ./collatz/MaxSequence-gcc

Way to measure performance without startup overhead

Add coroutine test

https://habr.com/ru/articles/830354/

Sweep: Implement Linpack in Rust

Details

Implement Linpack in Rust, and place it in rust/linpack/Linpack.rs. Implement all the required functions
See go/linpack/Linpack.go, javascript/linpack/Linpack.js, php/linpack/Linpack.php, go/linpack/Linpack.go for algorithm. You MUST implement it algorithmically exactly in the same way as in examples, but with Rust.
See rust/primes/Atkin.rs, rust/mandelbrot/Simple.rs for other Rust samples.
Make sure to update rust/benchmark.yml accordingly

Checklist

• Create rust/linpack/Linpack.rs ✓ 0ffe8a8 Edit
• Running GitHub Actions for rust/linpack/Linpack.rs ✓ Edit
• Modify rust/benchmark.yml ✓ dfb80a3 Edit
• Running GitHub Actions for rust/benchmark.yml ✓ Edit

Sweep: implement primes/Simple in Python

Details

Implement primes/Simple benchmark in Python, and put it into python/primes/Simple.py.

You MUST implement it exactly in the same way as in other languages examples: php/primes/Simple.php, javascript/primes/Simple.js, ruby/primes/Simple.rb. Add script to python/benchmark.yaml

Here are other examples of out Python code: python/primes/Atkin.py. Use it to se how collect and report execution time.

Checklist

• Create python/primes/Simple.py ✓ eb5f257 Edit
• Running GitHub Actions for python/primes/Simple.py ✓ Edit
• Modify python/benchmark.yml ✓ b3eed5f Edit
• Running GitHub Actions for python/benchmark.yml ✓ Edit

Sweep: Add primes/Simple benchmark in Go

Details

Details

Implement primes/Simple benchmark in Go, and put it into go/primes/Simple.go.

You MUST implement it exactly in the same way as in other language examples, without any optimizations: php/primes/Simple.php, c-plus-plus/mandelbrot/Simple.cpp. Add script to go/benchmark.yaml. Exact logical implementation is required to correctly compare multiple languages against each other.

Here are other examples of our Go code: go/treap/Naive.go. Use it to see how collect and report execution time.

Sweep: Add `primes/Simple` benchmark in Go

Details

Implement primes/Simple benchmark in Go, and put it into go/primes/Simple.go.

You MUST implement it exactly in the same way as in other language examples, without any optimizations: php/primes/Simple.php, c-plus-plus/mandelbrot/Simple.cpp. Add script to go/benchmark.yaml. Exact logical implementation is required to correctly compare multiple languages against each other.

Here are other examples of our Go code: go/treap/Naive.go. Use it to se how collect and report execution time.

Sweep: Write Collatz Conjecture bench in Python

Details

Implement collatz/MaxSequence benchmark in Python, and put it into python/collatz/MaxSequence.py.

You MUST implement it exactly in the same way as in other languages examples: php/collatz/MaxSequence.php, javascript/collatz/MaxSequence.js, ruby/collatz/MaxSequence.rb. Add script to python/benchmark.yaml

Here are other examples of out Python code: python/primes/Atkin.py. Use it to se how collect and report execution time.

Checklist

• Create python/collatz/MaxSequence.py ✓ 7340e6c Edit
• Running GitHub Actions for python/collatz/MaxSequence.py ✓ Edit
• Modify python/benchmark.yml ✓ a862be2 Edit
• Running GitHub Actions for python/benchmark.yml ✓ Edit