Awesome

Introduction

I wrote that code because: (the obvious reason::I love to write code in Go)

We are working so hard to optimize our servers - why shouldn't we do it for our clients testers?!

I noticed that the existing tools for benchmarking/load HTTP/HTTPS servers has some issues:

ab (ApacheBenchmark) - maximum concurrency is 20k (can be eliminate by opening multiple ab processes)
Siege are work in a model of native thread per request, meaning that you cannot simulated thousands/ten of thousands clients concurrently even if you tweak the RLIMIT of stack usage per native thread - still that kill the client machine and cause it to be very load and not an efficient client/s. What we really want is minimum resources usage and get the maximum throughput/load!

If you already familiar with the model of Go for high performance I/O with goroutines, we can achieve that mission easily.

The funny part - I did some benchmark to the client tester tool and not to the server:

##Siege vs GoBench:

###Siege:

$>siege -b -t10S -c500 http://localhost:80/

** SIEGE 2.70
** Preparing 500 concurrent users for battle.
The server is now under siege...
Lifting the server siege...      done.
Transactions:		       74247 hits
Availability:		      100.00 %
Elapsed time:		        9.62 secs
Data transferred:	       96.58 MB
Response time:		        0.06 secs
Transaction rate:	     7717.98 trans/sec
Throughput:		       10.04 MB/sec
Concurrency:		      490.19
Successful transactions:       74247
Failed transactions:	           0
Longest transaction:	        1.02
Shortest transaction:	        0.00

###GoBench:

$>gobench -k=true -u http://localhost:80 -c 500 -t 10
Dispatching 500 clients
Waiting for results...

Requests:                           343669 hits
Successful requests:                343669 hits
Network failed:                          0 hits
Bad requests failed (!2xx):              0 hits
Successfull requests rate:           34366 hits/sec
Read throughput:                  54700061 bytes/sec
Write throughput:                  4128684 bytes/sec
Test time:                              10 sec

requests hits and requests rate are 5X better on the same time (10 seconds) and the same number of clients (500)!
I tried the same with 2000 clients on Siege with proper system configuration, and Siege was crashed
I tried gobench with the maximum number of clients that we can use (65535 ports) - it's rocked!
Yet I didn't put the results of ab because I still need to investigate the results

Usage

install Go env follow: https://golang.org/dl/

download gobench

GOPATH=/tmp/ go get github.com/valyala/fasthttp
GOPATH=/tmp/ go get github.com/cmpxchg16/gobench

run some http server on port 80
run gobench for HTTP GET

$>gobench -u http://localhost:80 -k=true -c 500 -t 10
run gobench for HTTP POST

$>gobench -u http://localhost:80 -k=true -c 500 -t 10 -d /tmp/post

Notes

Because it's a test tool, in HTTPS the ceritificate verification is insecure
use Go >= 1.5 (fasthttp require it)

Help

gobench --help

License

Licensed under the New BSD License.

Author

Uri Shamay (shamayuri@gmail.com)