Awesome
Locust-Compare
Locust-Compare compares and validates the result of a Locusio.io run with the previous result.
Features
- Written in uncomplicated python3
- Ease of installation and use
- Merge your Locust.io runs and generate a merged .csv
- Specify which column to compare and set your own tresholds
- Great for integration in your CI/CD pipelines (Jenkins, Travis)
Installation
Prerequisites
You just need python3 to get started
Installation
$ python3 -m pip install -r requirements.txt
Usage
Commands:
Arguments to run Locust-Compare:
-p Prefix for the Locust CSV files
-o Select an option to run, view the documentation for the possible options
-c Which column name to compare
-f The allowed factor of difference
All possible options:
create_baseline
compare_results_distribution (also provide a columnname and factor)
compare_results_requests (also provide a columnname and factor)
create_comparison_distribution
create_comparison_requests
Basic usage CI/CD
First we need atleast a Locust run to have some baseline results:
$ locust -f example_test.py --csv=example --host https://www.github.com --no-web -t 1m
Add a pre build step to create a baseline with Locust Compare based on the previous run:
$ python3 locust_compare.py --prefix example --option create_baseline
Run your actual Locust script:
$ locust -f example_test.py --csv=example --host https://www.github.com --no-web -t 1m
Add a post build step to compare the results on a given column and specify the allowed factor of difference
$ python3 locust_compare.py --prefix example --option compare_results_distribution --columnname 95% --factor 1.2
Development
Bug Reports & Feature Requests
Please use the issue tracker to report any bugs or feature requests.