ozkanpakdil / test-microservice-frameworks

testing spring-boot quarkus and micronaut for jar size and response time for a simple controller, rust and dotnet

test-microservice-frameworks

Testing spring,micronaut,quarkus with sample json creator from gatling.

Find the results at https://ozkanpakdil.github.io/ on top right menu

test-microservice-frameworks's Issues

create a table

test results on the page is nice, prepare https://micronaut.io/blog/2020-04-07-img02.jpeg like table from the results.

check https://micronaut.io/blog/2020-04-07-micronaut-vs-quarkus-vs-spring-boot-performance-jdk-14.html for more details

windows and macos tests

so far all tests are running in linux, it would be nice to see some numbers for windows or macos

ktor graalvm problem

some requests failing with ktor graalvm native image

https://ozkanpakdil.github.io/microservicetests/2023-02-26-microservice-framework-test-17.html#graalvm-native-ktor-rest-service

when I test local I see these errors

================================================================================
---- Global Information --------------------------------------------------------
> request count                                     800000 (OK=735068 KO=64932 )
> min response time                                      7 (OK=7      KO=6413  )
> max response time                                 225965 (OK=224689 KO=225965)
> mean response time                                 68711 (OK=61016  KO=155817)
> std deviation                                      73632 (OK=69995  KO=55486 )
> response time 50th percentile                      23143 (OK=15418  KO=157646)
> response time 75th percentile                     134432 (OK=122630 KO=213433)
> response time 95th percentile                     208258 (OK=197420 KO=221201)
> response time 99th percentile                     219875 (OK=214830 KO=223348)
> mean requests/sec                                2857.143 (OK=2625.243 KO=231.9 )
---- Response Time Distribution ------------------------------------------------
> t < 800 ms                                         13558 (  2%)
> 800 ms <= t < 1200 ms                               9015 (  1%)
> t >= 1200 ms                                      712495 ( 89%)
> failed                                             64932 (  8%)
---- Errors --------------------------------------------------------------------
> Request timeout to localhost/127.0.0.1:8080 after 60000 ms      32752 (50.44%)
> j.n.ConnectException: connect(..) failed: Cannot assign reques  22377 (34.46%)
ted address
> Request timeout after 60000 ms                                   8788 (13.53%)
> i.n.c.ConnectTimeoutException: connection timed out: localhost   1015 ( 1.56%)
/127.0.0.1:8080

probably because of "slow response" getting timeouts...

add graalvm to the tests

Quarkus and micronaut support graalvm native build out of the box

Requirements

• Find GitHub action to have graalvm
• Rungatling.sh should be modified to run executable from Graal and run tests

add qson to quarkus module

write a new test scenario to test https://github.com/quarkusio/qson and add to results

dotnet test

https://github.com/ozkanpakdil/test-microservice-frameworks/tree/main/Dotnet6Microservice is the webservice ,

new test should be added to rungatling sh

vertx graalvm native image is acting strange

I described at https://stackoverflow.com/questions/72250206/vertx-build-with-graalvm, can you please have a look @pmlopes

test if aot works with the sample

https://github.com/ozkanpakdil/test-microservice-frameworks/tree/main/Dotnet6Microservice can be converted to 7

then test if can it build with https://learn.microsoft.com/en-us/dotnet/core/deploying/native-aot/ put a performance report for it in the results.

add vertx startup time

came from https://www.linkedin.com/feed/update/urn:li:activity:6728420920018423808/

It would be nice contribution.