The motivation behind this project extends from developers tunnel visioning on benchmarks like techempower that use the benchmarking tool called wrk.
The issue is that wrk only handle some of the HTTP spec and is entirely biased towards frameworks and servers that can make heavy use of HTTP/1 Pipelining which is no longer enabled in most modern browsers or clients, this can give a very unfair and unreasonable set of stats when comparing frameworks as those at the top are simply
better at using a process which is now not used greatly.
This is where rewrk comes in, this benchmarker is built on top of hyper's client api and brings with it many advantages and more realistic methods of benchmarking.
Current features
Supports both HTTP/1 and HTTP/2.
Pipelining is disabled giving a more realistic idea on actual performance.
Multi-Platform support, developed on Windows but will run on Mac and Linux as well.
To do list
Add a random artificial delay benchmark to simulate random latency with clients.
Arithmetic benchmark to simulate different loads across clients.
State checking, making the frameworks and servers use all of their API rather than a minimised set.
JSON deserialization and validation benchmarks and checking.
Truly concurrent HTTP/2 benchmark.
Usage
Usage is relatively simple, if you have a compiled binary simply run using the CLI.
Example
Here's an example to produce the following benchmark:
256 connections (-c 256)
HTTP/2 only (--http2)
12 threads (-t 12)
15 seconds (-d 15s)
with percentile table (--pct)
on host http://127.0.0.1:5000 (-h http://127.0.0.1:5000)
To bring up the help menu simply run rewrk --help to produce this:
USAGE:
rewrk.exe [FLAGS] [OPTIONS] --duration <duration> --host <host>
FLAGS:
--help Prints help information
--http2 Set the client to use http2 only. (default is http/1) e.g. '--http2'
--pct Displays the percentile table after benchmarking.
-V, --version Prints version information
OPTIONS:
-c, --connections <connections> Set the amount of concurrent e.g. '-c 512' [default: 1]
-d, --duration <duration> Set the duration of the benchmark.
-h, --host <host> Set the host to bench e.g. '-h http://127.0.0.1:5050'
-t, --threads <threads> Set the amount of threads to use e.g. '-t 12' [default: 1]
Building from source
Building from source is incredibly simple, just make sure you have a stable version of Rust installed before you start.
With Cargo Install
Run cargo install rewrk --git https://github.com/ChillFish8/rewrk.git
lnx-search/rewrk
rewrk
A more modern http framework benchmark utility.
With optional --pct flag
Motivation
The motivation behind this project extends from developers tunnel visioning on benchmarks like techempower that use the benchmarking tool called wrk.
The issue is that wrk only handle some of the HTTP spec and is entirely biased towards frameworks and servers that can make heavy use of HTTP/1 Pipelining which is no longer enabled in most modern browsers or clients, this can give a very unfair and unreasonable set of stats when comparing frameworks as those at the top are simply better at using a process which is now not used greatly.
This is where rewrk comes in, this benchmarker is built on top of hyper's client api and brings with it many advantages and more realistic methods of benchmarking.
Current features
To do list
Usage
Usage is relatively simple, if you have a compiled binary simply run using the CLI.
Example
Here's an example to produce the following benchmark:
-c 256
)--http2
)-t 12
)-d 15s
)--pct
)http://127.0.0.1:5000
(-h http://127.0.0.1:5000
)CLI command:
rewrk -c 256 -t 12 -d 15s -h http://127.0.0.1:5000 --http2 --pct
CLI Help
To bring up the help menu simply run
rewrk --help
to produce this:Building from source
Building from source is incredibly simple, just make sure you have a stable version of Rust installed before you start.
With Cargo Install
cargo install rewrk --git https://github.com/ChillFish8/rewrk.git
With Cargo Run
cargo run --release -- <enter flags here>
With Cargo Build
cargo build --release