Comments (7)
If tests are running far longer than specified that's a definitely a bug. Do you have an example that is reproducible? I could take a look on that.
from trombi.
Early termination is a good idea. However, I have to think about it a bit so that it fits to current internal design.
from trombi.
I think there's actually two issues here. One is (I'm guessing) that regardless of duration already started scenarios will complete so if I try to do a 30 sec test and my scenario is 5 min it takes that long no matter what and at the end of a 20 minute test the stragglers will finish their scenarios. I'm guessing this is WAD.
The other is when I push the concurrent users over 100 to say 150 or 200 then I seem to get less traffic than at 100 users and the scenarios never seem to finish even if I wait an extra 30 min past time. Not sure what's going on there. Maybe my computer just can't handle it but it's not giving me a lot of visibility into what's happening.
from trombi.
You're right. clj-gatling checks whether it should finish after running scenario. So it will finish up all the scenarios that have been started before. If you have a small timeout value for scenario steps that's usually not a problem. Also that way ongoing requests are never interrupted (meaning that all responses are checked). For me that has been important thing but I understand that's not always needed. How long timeout you are using in your tests?
from trombi.
I'm using standard clj-http timeouts. It's less the timeout than that I'm running 20+ steps in the scenario with a sleep-before of 1-10 sec each to simulate user delay. Cutting the delay for my testing helps a lot so I made that configurable.
from trombi.
Implementing stop condition check after each scenario step is quite trivial. I added a separate issue about this #24 .
from trombi.
Solved in #24
from trombi.
Related Issues (20)
- An issue with async/timeout HOT 7
- Add scenario pre-hook and post-hook HOT 1
- Simulation with concurrency distribution fails when duration left unspecified HOT 3
- Upgrade http-kit for JDK 9 HOT 6
- Issues with high concurrency HOT 2
- Log timeouts HOT 1
- With uneven scenario weights some scenarios might run with concurrency 0 HOT 1
- clj-time HOT 6
- Steps running serially? HOT 3
- How to identify concurrency issues HOT 7
- Kill a simulation? HOT 2
- Add raw reporter HOT 2
- File based raw reporter does not work when there are less than 20000 requests in simulation
- Catch also AssertionErrors and mark those requests as KOs
- IndexOutOfBoundsException when splitting rate to weighted scenarios HOT 1
- Progress reporter shows negative concurrency values sometimes in the end of the simulation
- Terminate scenario early based on step function return value HOT 1
- Reporters console output is called too early before the results have been calculated
- Concurrency is higher than given in options
- Divide by zero when experimental test runner stats is enabled HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from trombi.