Awesome

Fortio

<img src="./ui/static/img/fortio-logo-gradient-no-bg.svg" height=109 width=167 align=right />

Fortio (Φορτίο) started as, and is, Istio's load testing tool and later (2018) graduated to be its own project.

Fortio is also used by, among others, Meshery.

Fortio runs at a specified query per second (qps) and records a histogram of execution time and calculates percentiles (e.g., p99 i.e., the response time such as 99% of the requests take less than that number (in seconds, SI unit)). It can run for a set duration, for a fixed number of calls, or until interrupted (at a constant target QPS, or max speed/load per connection/thread).

The name fortio comes from Greek φορτίο which means load/burden.

Fortio is a fast, small (4Mb Docker image, minimal dependencies), reusable, embeddable go library as well as a command line tool and server process, the server includes a simple web UI and REST API to trigger run and see graphical representation of the results (both a single latency graph and a multiple results comparative min, max, avg, qps and percentiles graphs).

Fortio also includes a set of server side features (similar to httpbin) to help debugging and testing: request echo back including headers, adding latency or error codes with a probability distribution, TCP echoing, TCP proxying, HTTP fan out/scatter and gather proxy server, gRPC echo/health in addition to HTTP, etc...

Fortio is quite mature and very stable with no known major bugs (lots of possible improvements if you want to contribute though!), and when bugs are found they are fixed quickly, so after 1 year of development and 42 incremental releases, we reached 1.0 in June 2018.

Fortio components can be used a library even for unrelated projects, for instance the stats, or fhttp utilities both client and server. A recent addition is the new jrpc JSON Remote Procedure Calls library package (docs).

We also have moved some of the library to their own toplevel package, like:

• Dynamic flags: fortio.org/dflag
• Logger: fortio.org/log - now using structured JSON logs for servers (vs text for CLIs) since fortio 1.55 / log 1.4. In color since fortio 1.57 / log 1.6.
• Version helper: fortio.org/version
• CLI helpers integrating the above to reduce toil making new tools fortio.org/cli and servers fortio.org/scli for arguments, flags, usage, dynamic config, etc...

If you want to connect to fortio using HTTPS and fortio to provide real TLS certificates, or to multiplex gRPC and regular HTTP behind a single port, check out Fortio Proxy.

If you want fortio to generate detailed Open Telemetry traces use Fortiotel.

Installation

We publish a multi architecture Docker image (linux/amd64, linux/arm64, linux/ppc64le, linux/s390x) fortio/fortio.

For instance:

docker run -p 8080:8080 -p 8079:8079 fortio/fortio server & # For the server
docker run fortio/fortio load -logger-force-color http://www.google.com/ # For a test run, forcing color instead of JSON log output

You can install from source:

1. Install go (golang 1.18 or later)
2. go install fortio.org/fortio@latest
3. you can now run fortio (from your gopath bin/ directory, usually ~/go/bin)

The releases page has binaries for many OS/architecture combinations (see assets):

curl -L https://github.com/fortio/fortio/releases/download/v1.67.1/fortio-linux_amd64-1.67.1.tgz \
 | sudo tar -C / -xvzpf -
# or the debian package
wget https://github.com/fortio/fortio/releases/download/v1.67.1/fortio_1.67.1_amd64.deb
dpkg -i fortio_1.67.1_amd64.deb
# or the rpm
rpm -i https://github.com/fortio/fortio/releases/download/v1.67.1/fortio-1.67.1-1.x86_64.rpm
# and more, see assets in release page

On macOS you can also install Fortio using Homebrew:

brew install fortio

On Windows, download https://github.com/fortio/fortio/releases/download/v1.67.1/fortio_win_1.67.1.zip and extract fortio.exe to any location, then using the Windows Command Prompt:

fortio.exe server

(at the prompt, allow the Windows firewall to let connections in)

Once fortio server is running, you can visit its web UI at http://localhost:8080/fortio/

You can get a preview of the reporting/graphing UI at https://demo.fortio.org

Command line arguments

Fortio can be a HTTP or gRPC load generator, gathering statistics using the load subcommand, or start simple HTTP and gRPC ping servers, as well as a basic web UI, result graphing, TCP/UDP echo, proxies, https redirector, with the server command or issue gRPC ping messages using the grpcping command. It can also fetch a single URL's for debugging when using the curl command (or the -curl flag to the load command). Likewise you can establish a single TCP (or Unix domain or UDP (use udp:// prefix)) connection using the nc command (like the standalone netcat package). You can run just the redirector with redirect or just the TCP echo with tcp-echo. If you saved JSON results (using the web UI or directly from the command line), you can browse and graph those results using the report command. The version command will print the short print version. fortio buildinfo will print the full build information. Lastly, you can learn which flags are available using help command.

Most important flags for HTTP load generation:

Changing the HTTP options like the TLS options -cert, -key, -cacert when launching an echo/UI/rapi server will make these options the default for runs initiated from that server (or fetches/proxies etc.).

Full list of command line flags (fortio help):

See also the FAQ entry about fortio flags for best results.

Server URLs and features

Fortio server has the following feature for the HTTP listening on 8080 (all paths and ports are configurable through flags above):

• A simple echo server which will echo back posted data (for any path not mentioned below).

  For instance curl -d abcdef http://localhost:8080/ returns abcdef back. It supports the following optional query argument parameters:

delay, close and header query arguments are also supported for the debug endpoint which echoes back the request (gzip is always done if Accept-Encoding: gzip is present, status is always 200, and the payload is the echo back debug information).

You can set a default value for all these by passing -echo-server-default-params to the server command line, for instance: fortio server -echo-server-default-params="delay=0.5s:50,1s:40&status=418" will make the server respond with HTTP 418 and a delay of either 0.5s half of the time, 1s 40% and no delay in 10% of the calls; unless any ? query args is passed by the client. Note that the quotes (") are for the shell to escape the ampersand (&) but should not be put in a YAML nor the dynamic flag URL for instance.

• /debug will echo back the request in plain text for human debugging.

• /fortio/ A UI to

  • Run/Trigger tests and graph the results.
  • A UI to browse saved results and single graph or multi graph them (comparative graph of min, avg, median, p75, p99, p99.9 and max).
  • Proxy/fetch other URLs.
  • /fortio/data/index.tsv a tab separated value file conforming to Google cloud storage URL list data transfer format so you can export/backup local results to the cloud.
  • Download/sync peer to peer JSON results files from other Fortio servers (using their index.tsv URLs).
  • Download/sync from an Amazon S3 or Google Cloud compatible bucket listings XML URLs.

• API to trigger and cancel runs from the running server (like the form UI, but more directly and with async=on option)

  • /fortio/rest/run starts a run; the arguments are either from the command line or from POSTed JSON; jsonPath can be provided to look for in a subset of the JSON object, for instance jsonPath=metadata allows using the flagger webhook metadata for fortio run parameters (see Remote Triggered load test section below).
  • /fortio/rest/stop stops all current run or by run ID (passing runid= query argument).
  • /fortio/rest/status lists the current runs (or the options of a single one if runid is passed).

• DNS API for troubleshooting latency based records / view of the DNS where fortio server is running. /fortio/rest/dns?name=x resolves all the IPs for x.

The report mode is a read-only subset of the above directly on /.

There is also the gRPC health and ping servers, as well as the HTTP->HTTPS redirector.

Example use and output

Note that recent versions of fortio, when run on the console, have colorized output (and JSON when ran in server environment). What's below is plain text from older versions.

Start the internal servers

$ fortio server &
Fortio X.Y.Z tcp-echo server listening on tcp [::]:8078
Fortio X.Y.Z udp-echo server listening on udp [::]:8078
Fortio X.Y.Z grpc 'ping' server listening on tcp [::]:8079
Fortio X.Y.Z https redirector server listening on tcp [::]:8081
Fortio X.Y.Z http-echo server listening on tcp [::]:8080
Data directory is /Users/ldemailly/dev/fortio
REST API on /fortio/rest/run, /fortio/rest/status, /fortio/rest/stop, /fortio/rest/dns
Debug endpoint on /debug, Additional Echo on /debug/echo/, Flags on /fortio/flags, and Metrics on /debug/metrics
	 UI started - visit:
		http://localhost:8080/fortio/
	 (or any host/ip reachable on this server)
I fortio_main.go:285> Note: not using dynamic flag watching (use -config to set watch directory)
I fortio_main.go:293> All fortio X.Y.Z  goM.m.p arm64 darwin servers started!

Sample of the graphing UI

With the 2 histograms - total and errors overlaid:

Change the port / binding address

By default, Fortio's web/echo servers listen on port 8080 on all interfaces. Use the -http-port flag to change this behavior:

$ fortio server -http-port 10.10.10.10:8088
UI starting - visit:
http://10.10.10.10:8088/fortio/
https redirector running on :8081
Fortio X.Y.Z grpc ping server listening on port :8079
Fortio X.Y.Z echo server listening on port 10.10.10.10:8088

Unix domain sockets

You can use Unix domain socket for any server/client:

$ fortio server --http-port /tmp/fortio-uds-http &
Fortio X.Y.Z grpc 'ping' server listening on [::]:8079
Fortio X.Y.Z https redirector server listening on [::]:8081
Fortio X.Y.Z echo server listening on /tmp/fortio-uds-http
UI started - visit:
fortio curl -unix-socket=/tmp/fortio-uds-http http://localhost/fortio/
14:58:45 I fortio_main.go:217> All fortio X.Y.Z unknown goM.m.p servers started!
$ fortio curl -unix-socket=/tmp/fortio-uds-http http://foo.bar/debug
15:00:48 I http_client.go:428> Using unix domain socket /tmp/fortio-uds-http instead of foo.bar http
HTTP/1.1 200 OK
Content-Type: text/plain; charset=UTF-8
Date: Wed, 08 Aug 2018 22:00:48 GMT
Content-Length: 231

Φορτίο version X.Y.Z unknown goM.m.p echo debug server up for 2m3.4s on ldemailly-macbookpro - request from

GET /debug HTTP/1.1

headers:

Host: foo.bar
User-Agent: fortio.org/fortio-X.Y.Z

body:

TCP

Start the echo-server alone and run a load (use tcp:// prefix for the load test to be for tcp echo server):

$ fortio tcp-echo &
Fortio X.Y.Z tcp-echo TCP server listening on [::]:8078
19:45:30 I fortio_main.go:238> All fortio X.Y.Z release goM.m.p servers started!
$ fortio load -qps -1 -n 100000 tcp://localhost:8078
Fortio X.Y.Z running at -1 queries per second, 16->16 procs, for 100000 calls: tcp://localhost:8078
20:01:31 I tcprunner.go:218> Starting tcp test for tcp://localhost:8078 with 4 threads at -1.0 qps
Starting at max qps with 4 thread(s) [gomax 16] for exactly 100000 calls (25000 per thread + 0)
20:01:32 I periodic.go:558> T003 ended after 1.240585427s : 25000 calls. qps=20151.77629520873
20:01:32 I periodic.go:558> T002 ended after 1.241141084s : 25000 calls. qps=20142.75437521493
20:01:32 I periodic.go:558> T001 ended after 1.242066385s : 25000 calls. qps=20127.7486468648
20:01:32 I periodic.go:558> T000 ended after 1.24227731s : 25000 calls. qps=20124.331176909283
Ended after 1.242312567s : 100000 calls. qps=80495
Aggregated Function Time : count 100000 avg 4.9404876e-05 +/- 1.145e-05 min 2.7697e-05 max 0.000887051 sum 4.94048763
# range, mid point, percentile, count
>= 2.7697e-05 <= 0.000887051 , 0.000457374 , 100.00, 100000
# target 50% 0.00045737
# target 75% 0.00067221
# target 90% 0.000801115
# target 99% 0.000878457
# target 99.9% 0.000886192
Sockets used: 4 (for perfect no error run, would be 4)
Total Bytes sent: 2400000, received: 2400000
tcp OK : 100000 (100.0 %)
All done 100000 calls (plus 0 warmup) 0.049 ms avg, 80495.0 qps

UDP

Start the udp-echo server alone and run a load (use udp:// prefix for the load test to be for udp echo server):

$ fortio udp-echo &
Fortio X.Y.Z udp-echo UDP server listening on [::]:8078
21:54:52 I fortio_main.go:273> Note: not using dynamic flag watching (use -config to set watch directory)
21:54:52 I fortio_main.go:281> All fortio X.Y.Z release goM.m.p servers started!
$ fortio load -qps -1 -n 100000 udp://localhost:8078/
Fortio X.Y.Z running at -1 queries per second, 16->16 procs, for 100000 calls: udp://localhost:8078/
21:56:48 I udprunner.go:222> Starting udp test for udp://localhost:8078/ with 4 threads at -1.0 qps
Starting at max qps with 4 thread(s) [gomax 16] for exactly 100000 calls (25000 per thread + 0)
21:56:49 I periodic.go:558> T003 ended after 969.635695ms : 25000 calls. qps=25782.879208051432
21:56:49 I periodic.go:558> T000 ended after 969.906228ms : 25000 calls. qps=25775.687667818544
21:56:49 I periodic.go:558> T002 ended after 970.543935ms : 25000 calls. qps=25758.751457243405
21:56:49 I periodic.go:558> T001 ended after 970.737665ms : 25000 calls. qps=25753.610786287973
Ended after 970.755702ms : 100000 calls. qps=1.0301e+05
Aggregated Function Time : count 100000 avg 3.8532238e-05 +/- 1.7e-05 min 2.0053e-05 max 0.000881827 sum 3.85322376
# range, mid point, percentile, count
>= 2.0053e-05 <= 0.000881827 , 0.00045094 , 100.00, 100000
# target 50% 0.000450936
# target 75% 0.000666381
# target 90% 0.000795649
# target 99% 0.000873209
# target 99.9% 0.000880965
Sockets used: 4 (for perfect no error run, would be 4)
Total Bytes sent: 2400000, received: 2400000
udp OK : 100000 (100.0 %)
All done 100000 calls (plus 0 warmup) 0.039 ms avg, 103012.5 qps

gRPC

Simple gRPC ping

$ fortio grpcping -n 5 localhost
22:36:55 I pingsrv.go:150> Ping RTT 212000 (avg of 259000, 217000, 160000 ns) clock skew -10500
22:36:55 I pingsrv.go:150> Ping RTT 134333 (avg of 170000, 124000, 109000 ns) clock skew 5000
22:36:55 I pingsrv.go:150> Ping RTT 112000 (avg of 111000, 122000, 103000 ns) clock skew 5000
22:36:55 I pingsrv.go:150> Ping RTT 157000 (avg of 136000, 158000, 177000 ns) clock skew 6000
22:36:55 I pingsrv.go:150> Ping RTT 108333 (avg of 118000, 106000, 101000 ns) clock skew 1000
Clock skew histogram usec : count 5 avg 1.3 +/- 6.145 min -10.5 max 6 sum 6.5
# range, mid point, percentile, count
>= -10.5 <= -10 , -10.25 , 20.00, 1
> 0 <= 2 , 1 , 40.00, 1
> 4 <= 6 , 5 , 100.00, 3
# target 50% 4.33333
RTT histogram usec : count 15 avg 144.73333 +/- 44.48 min 101 max 259 sum 2171
# range, mid point, percentile, count
>= 101 <= 110 , 105.5 , 26.67, 4
> 110 <= 120 , 115 , 40.00, 2
> 120 <= 140 , 130 , 60.00, 3
> 140 <= 160 , 150 , 73.33, 2
> 160 <= 180 , 170 , 86.67, 2
> 200 <= 250 , 225 , 93.33, 1
> 250 <= 259 , 254.5 , 100.00, 1
# target 50% 130

Change the target port for gRPC

The value of -grpc-port (default 8079) is used when specifying a hostname or an IP address in grpcping. Add :port to the grpcping destination to change this behavior:

$ fortio grpcping 10.10.10.100:8078 # Connects to gRPC server 10.10.10.100 listening on port 8078
02:29:27 I pingsrv.go:116> Ping RTT 305334 (avg of 342970, 293515, 279517 ns) clock skew -2137
Clock skew histogram usec : count 1 avg -2.137 +/- 0 min -2.137 max -2.137 sum -2.137
# range, mid point, percentile, count
>= -4 < -2 , -3 , 100.00, 1
# target 50% -2.137
RTT histogram usec : count 3 avg 305.334 +/- 27.22 min 279.517 max 342.97 sum 916.002
# range, mid point, percentile, count
>= 250 < 300 , 275 , 66.67, 2
>= 300 < 350 , 325 , 100.00, 1
# target 50% 294.879

grpcping using TLS

Note that since 1.40 the same applies to the main HTTP server port, it will listen on TLS if -cert and -key flags are provided.

For testing use make certs to generate self signed test certificates.

• First, start Fortio server with the -cert and -key flags:

/path/to/fortio/server.crt and /path/to/fortio/server.key are paths to the TLS certificate and key that you must provide:

$ fortio server -cert /path/to/fortio/server.crt -key /path/to/fortio/server.key
UI starting - visit:
http://localhost:8080/fortio/
https redirector running on :8081
Fortio X.Y.Z grpc ping server listening on port :8079
Fortio X.Y.Z echo server listening on port localhost:8080
Using server certificate /path/to/fortio/server.crt to construct TLS credentials
Using server key /path/to/fortio/server.key to construct TLS credentials

• Next, use grpcping with the -cacert flag:

/path/to/fortio/ca.crt is the path to the CA certificate that issued the server certificate for localhost. In our example, the server certificate is /path/to/fortio/server.crt:

$ fortio grpcping -cacert /path/to/fortio/ca.crt localhost
Using server certificate /path/to/fortio/ca.crt to construct TLS credentials
16:00:10 I pingsrv.go:129> Ping RTT 501452 (avg of 595441, 537088, 371828 ns) clock skew 31094
Clock skew histogram usec : count 1 avg 31.094 +/- 0 min 31.094 max 31.094 sum 31.094
# range, mid point, percentile, count
>= 31.094 <= 31.094 , 31.094 , 100.00, 1
# target 50% 31.094
RTT histogram usec : count 3 avg 501.45233 +/- 94.7 min 371.828 max 595.441 sum 1504.357
# range, mid point, percentile, count
>= 371.828 <= 400 , 385.914 , 33.33, 1
> 500 <= 595.441 , 547.721 , 100.00, 2
# target 50% 523.86

gRPC to standard HTTPS service

grpcping can connect to a non-fortio TLS server by prefacing the destination with https://:

$ fortio grpcping https://grpc.fortio.org
13:48:20 I grpcrunner.go:276> stripping https scheme. grpc destination: grpc.fortio.org. grpc port: 443
13:48:26 I pingsrv.go:152> Ping RTT 63101562 (avg of 63577000, 63192688, 62535000 ns) clock skew 32021375
Clock skew histogram usec : count 1 avg 32021.375 +/- 0 min 32021.375 max 32021.375 sum 32021.375
# range, mid point, percentile, count
>= 32021.4 <= 32021.4 , 32021.4 , 100.00, 1
# target 50% 32021.4
RTT histogram usec : count 3 avg 63101.563 +/- 430.2 min 62535 max 63577 sum 189304.688
# range, mid point, percentile, count
>= 62535 <= 63577 , 63056 , 100.00, 3
# target 50% 62795.5

Simple load test

Load (low default qps/threading) test:

$ fortio load http://www.google.com
Fortio X.Y.Z running at 8 queries per second, 8->8 procs, for 5s: http://www.google.com
19:10:33 I httprunner.go:84> Starting http test for http://www.google.com with 4 threads at 8.0 qps
Starting at 8 qps with 4 thread(s) [gomax 8] for 5s : 10 calls each (total 40)
19:10:39 I periodic.go:314> T002 ended after 5.056753279s : 10 calls. qps=1.9775534712220633
19:10:39 I periodic.go:314> T001 ended after 5.058085991s : 10 calls. qps=1.9770324224999916
19:10:39 I periodic.go:314> T000 ended after 5.058796046s : 10 calls. qps=1.9767549252963101
19:10:39 I periodic.go:314> T003 ended after 5.059557593s : 10 calls. qps=1.9764573910247019
Ended after 5.059691387s : 40 calls. qps=7.9056
Sleep times : count 36 avg 0.49175757 +/- 0.007217 min 0.463508712 max 0.502087879 sum 17.7032725
Aggregated Function Time : count 40 avg 0.060587641 +/- 0.006564 min 0.052549016 max 0.089893269 sum 2.42350566
# range, mid point, percentile, count
>= 0.052549 < 0.06 , 0.0562745 , 47.50, 19
>= 0.06 < 0.07 , 0.065 , 92.50, 18
>= 0.07 < 0.08 , 0.075 , 97.50, 2
>= 0.08 <= 0.0898933 , 0.0849466 , 100.00, 1
# target 50% 0.0605556
# target 75% 0.0661111
# target 99% 0.085936
# target 99.9% 0.0894975
Code 200 : 40
Response Header Sizes : count 40 avg 690.475 +/- 15.77 min 592 max 693 sum 27619
Response Body/Total Sizes : count 40 avg 12565.2 +/- 301.9 min 12319 max 13665 sum 502608
All done 40 calls (plus 4 warmup) 60.588 ms avg, 7.9 qps

Remote triggered load test (server mode REST API)

New since 1.18 the server has a fortio/rest/run endpoint similar to what the form UI submit in fortio/ to start a run.

• plus async query arg or JSON value "on" will make the run asynchronous (returns just the runid of the run instead of waiting for the result);
• plus read all the run configuration from either query args or JSONPath POSTed info;
• compatible with flagger and other webhooks;
• New in 1.22: use headers JSON array to send headers (or multiple &H= query args).

Examples:

$ curl -v -d '{"metadata": {"url":"localhost:8080", "c":"1", "n":"1", "async":"on", "save":"on"}}' \
     "localhost:8080/fortio/rest/run?jsonPath=.metadata"
{"started": 3}

makes a 1 connection 1 query run for localhost:8080 URL asynchronously and saves results

or minimally:

curl -s -d '{"url":"localhost:8080"}' "localhost:8080/fortio/rest/run" | jq

More complete example:

With sample.json (all values must be strings, even the numbers):

{
    "metadata": {
        "url": "localhost:8080",
        "payload": "foo",
        "qps": "40",
        "c": "2",
        "t": "0.1s",
        "headers": [
            "Foo:Bar",
            "X-Blah: Something else"
        ],
        "save": "on"
    }
}

You can run:

$ fortio curl -stdclient -payload-file sample.json "http://localhost:8080/fortio/rest/run?jsonPath=.metadata" > result.json

which makes requests like this:

POST / HTTP/1.1
Host: localhost:8080
Content-Length: 3
Content-Type: application/octet-stream
Foo: Bar
X-Blah: Something else
X-On-Behalf-Of: [::1]:62629

foo

and you get in result.json:

{
  "RunType": "HTTP",
  "Labels": "",
  "StartTime": "2022-03-19T15:34:23.279389-07:00",
  "RequestedQPS": "40",
  "RequestedDuration": "100ms",
  "ActualQPS": 38.44836361217263,
  "ActualDuration": 104035637,
  "NumThreads": 2,
  "Version": "X.Y.Z",
  "DurationHistogram": {
    "Count": 4,
    "Min": 0.00027292,
    "Max": 0.000930407,
    "Sum": 0.002332047,
    "Avg": 0.00058301175,
    "StdDev": 0.00028491034912527755,
    "Data": [
      {
        "Start": 0.00027292,
        "End": 0.000930407,
        "Percent": 100,
        "Count": 4
      }
    ],
    "Percentiles": [
      {
        "Percentile": 50,
        "Value": 0.0004920823333333334
      },
      {
        "Percentile": 75,
        "Value": 0.0007112446666666667
      },
      {
        "Percentile": 90,
        "Value": 0.0008427420666666666
      },
      {
        "Percentile": 99,
        "Value": 0.0009216405066666668
      },
      {
        "Percentile": 99.9,
        "Value": 0.0009295303506666667
      }
    ]
  },
  "Exactly": 0,
  "Jitter": false,
  "Uniform": false,
  "RunID": 7,
  "AccessLoggerInfo": "",
  "RetCodes": {
    "200": 4
  },
  "URL": "http://localhost:8080",
  "NumConnections": 1,
  "Compression": false,
  "DisableFastClient": false,
  "HTTP10": false,
  "DisableKeepAlive": false,
  "AllowHalfClose": false,
  "Insecure": false,
  "FollowRedirects": false,
  "CACert": "",
  "Cert": "",
  "Key": "",
  "Resolve": "",
  "HTTPReqTimeOut": 3000000000,
  "UserCredentials": "",
  "ContentType": "",
  "Payload": "Zm9v",
  "UnixDomainSocket": "",
  "LogErrors": false,
  "ID": 0,
  "SequentialWarmup": false,
  "Sizes": {
    "Count": 4,
    "Min": 118,
    "Max": 118,
    "Sum": 472,
    "Avg": 118,
    "StdDev": 0,
    "Data": [
      {
        "Start": 118,
        "End": 118,
        "Percent": 100,
        "Count": 4
      }
    ],
    "Percentiles": null
  },
  "HeaderSizes": {
    "Count": 4,
    "Min": 115,
    "Max": 115,
    "Sum": 460,
    "Avg": 115,
    "StdDev": 0,
    "Data": [
      {
        "Start": 115,
        "End": 115,
        "Percent": 100,
        "Count": 4
      }
    ],
    "Percentiles": null
  },
  "SocketCount": 2,
  "AbortOn": 0
}

• There is also the fortio/rest/stop endpoint to stop a run by its id or all runs if not specified.

DNS REST API example

$ curl -s localhost:8080/fortio/rest/dns?name=debug.fortio.org | jq

Returns

{
  "Name": "debug.fortio.org",
  "IPv4": [
    "18.222.136.83",
    "192.9.142.5",
    "192.9.227.83"
  ],
  "IPv6": [
    "2600:1f16:9c6:b400:282c:a766:6cab:4e82",
    "2603:c024:c00a:d144:7cd0:4951:7106:96b8",
    "2603:c024:c00a:d144:6663:5896:7efb:fbf3"
  ]
}

GRPC load test

Uses -s to use multiple (h2/gRPC) streams per connection (-c), request to hit the fortio ping gRPC endpoint with a delay in replies of 0.25s and an extra payload for 10 bytes and auto save the JSON result:

$ fortio load -a -grpc -ping -grpc-ping-delay 0.25s -payload "01234567890" -c 2 -s 4 https://fortio-stage.istio.io
Fortio X.Y.Z running at 8 queries per second, 8->8 procs, for 5s: https://fortio-stage.istio.io
16:32:56 I grpcrunner.go:139> Starting GRPC Ping Delay=250ms PayloadLength=11 test for https://fortio-stage.istio.io with 4*2 threads at 8.0 qps
16:32:56 I grpcrunner.go:261> stripping https scheme. grpc destination: fortio-stage.istio.io. grpc port: 443
16:32:57 I grpcrunner.go:261> stripping https scheme. grpc destination: fortio-stage.istio.io. grpc port: 443
Starting at 8 qps with 8 thread(s) [gomax 8] for 5s : 5 calls each (total 40)
16:33:04 I periodic.go:533> T005 ended after 5.283227589s : 5 calls. qps=0.9463911814835126
[...]
Ended after 5.28514474s : 40 calls. qps=7.5684
Sleep times : count 32 avg 0.97034752 +/- 0.002338 min 0.967323561 max 0.974838789 sum 31.0511206
Aggregated Function Time : count 40 avg 0.27731944 +/- 0.001606 min 0.2741372 max 0.280604967 sum 11.0927778
# range, mid point, percentile, count
>= 0.274137 <= 0.280605 , 0.277371 , 100.00, 40
# target 50% 0.277288
# target 75% 0.278947
# target 90% 0.279942
# target 99% 0.280539
# target 99.9% 0.280598
Ping SERVING : 40
All done 40 calls (plus 2 warmup) 277.319 ms avg, 7.6 qps
Successfully wrote 1210 bytes of Json data to 2018-04-03-163258_fortio_stage_istio_io_ldemailly_macbookpro.json

And the JSON saved is

• Load test using gRPC and TLS security. First, start Fortio server with the -cert and -key flags:

fortio server -cert /etc/ssl/certs/server.crt -key /etc/ssl/certs/server.key

Next, run the load command with the -cacert flag:

fortio load -cacert /etc/ssl/certs/ca.crt -grpc localhost:8079

cURL like (single request) mode

$ fortio load -curl -H Foo:Bar http://localhost:8080/debug
14:26:26 I http.go:133> Setting regular extra header Foo: Bar
HTTP/1.1 200 OK
Content-Type: text/plain; charset=UTF-8
Date: Mon, 08 Jan 2018 22:26:26 GMT
Content-Length: 230

Φορτίο version X.Y.Z echo debug server up for 39s on ldemailly-macbookpro - request from [::1]:65055

GET /debug HTTP/1.1

headers:

Host: localhost:8080
User-Agent: fortio.org/fortio-X.Y.Z
Foo: Bar

body:

Note: if you do not want the default fortio User-Agent to be sent pass -H user-agent:. If you want to send a present yet empty User-Agent: header, pass -H "user-agent: " (i.e., only whitespace sends empty one, empty value doesn't send any).

Report only UI

If you have JSON files saved from running the full UI or downloaded, using the -sync option, from an Amazon or Google Cloud storage bucket or from a peer fortio server (to synchronize from a peer fortio, use http://peer:8080/data/index.tsv as the sync URL). You can then serve just the reports:

$ fortio report -sync-interval 15m -sync "https://storage.googleapis.com/fortio-data?prefix=fortio.istio.io/"
Browse only UI starting - visit:
http://localhost:8080/
https redirector running on :8081

Using the HTTP fan out / multi proxy feature

Example listen on 1 extra port and every request sent to that 1 port is forward to 2:

# in one window or &
$ fortio server -M "5554 http://localhost:8080 http://localhost:8080"
[...]
Fortio X.Y.Z Multi on 5554 server listening on [::]:5554
10:09:56 I http_forwarder.go:152> Multi-server on [::]:5554 running with &{Targets:[{Destination:http://localhost:8080 MirrorOrigin:true} {Destination:http://localhost:8080 MirrorOrigin:true}] Name:Multi on [::]:5554 client:0xc0001ccc00}

Call the debug endpoint on both:

# in new window
$ fortio curl -payload "a test" http://localhost:5554/debug
HTTP/1.1 200 OK
Date: Wed, 07 Oct 2020 17:11:06 GMT
Content-Length: 684
Content-Type: text/plain; charset=utf-8

Φορτίο version X.Y.Z unknown goM.m.p echo debug server up for 1m9.3s on C02C77BHMD6R - request from [::1]:51020

POST /debug HTTP/1.1

headers:

Host: localhost:8080
Accept-Encoding: gzip
Content-Type: application/octet-stream
User-Agent: fortio.org/fortio-X.Y.Z
X-Fortio-Multi-Id: 1
X-On-Behalf-Of: [::1]:51019

body:

a test
Φορτίο version X.Y.Z unknown goM.m.p echo debug server up for 1m9.3s on C02C77BHMD6R - request from [::1]:51020

POST /debug HTTP/1.1

headers:

Host: localhost:8080
Accept-Encoding: gzip
Content-Type: application/octet-stream
User-Agent: fortio.org/fortio-X.Y.Z
X-Fortio-Multi-Id: 2
X-On-Behalf-Of: [::1]:51019

body:

a test

There are 2 flags to further control the behavior of the multi-server proxies:

• pass -mirrorOriginFlag=false to not mirror all headers and request type to targets.
• pass -multi-serial-mode to stream request response serially instead of fetching in parallel and writing combined data after completion.

Also remember you can pass multiple -M.

Using the TCP proxy server(s) feature

Example: open 2 additional listening ports and forward all requests received on 8888 and 8889 (IPv6) to 8080 (regular HTTP server)

$ fortio server -P "8888 [::1]:8080" -P "[::1]:8889 [::1]:8080"
Fortio X.Y.Z grpc 'ping' server listening on [::]:8079
Fortio X.Y.Z https redirector server listening on [::]:8081
Fortio X.Y.Z echo server listening on [::]:8080
Data directory is /home/dl
UI started - visit:
http://localhost:8080/fortio/
(or any host/ip reachable on this server)
Fortio X.Y.Z proxy for [::1]:8080 server listening on [::]:8888
Fortio X.Y.Z proxy for [::1]:8080 server listening on [::1]:8889

Implementation details

Fortio is written in the Go language and includes a scalable semi log histogram in stats.go and a periodic runner engine in periodic.go with specializations for HTTP and gRPC. The fhttp/ package includes a very high performance specialized HTTP 1.1 client. You may find fortio's logger useful as well.

You can run the histogram code standalone as a command line in histogram/, a basic echo HTTP server in echosrv/, or both the HTTP echo and gRPC ping server through fortio server, the fortio command line interface lives in this top level directory fortio_main.go

There is also fcurl/ which is the fortio curl part of the code (if you need a light HTTP client without gRPC or server side). A matching tiny (2Mb compressed) Docker image is fortio/fortio.fcurl.

More examples

You can get the data on the console, for instance, with 5k qps: (includes envoy and mixer in the calls)

Or you can get the data in JSON format (using -json result.json).

Web/Graphical UI

Or graphically (through the http://localhost:8080/fortio/ web UI):

Simple form/UI:

Sample requests with responses delayed by 250us and 0.5% of 503 and 1.5% of 429 simulated HTTP errors:

Run result:

Code 200 : 2929 (97.6 %)
Code 429 : 56 (1.9 %)
Code 503 : 15 (0.5 %)

There are live examples on https://demo.fortio.org

Contributing

Contributions whether through issues, documentation, bug fixes, or new features are most welcome !

Please also see Contributing to Istio and Getting started contributing to Fortio in the FAQ.

If you are not using the binary releases, please do make pull to pull/update to the latest of the current branch.

And make sure to go strict format (go get mvdan.cc/gofumpt and gofumpt -w *.go) and run those commands successfully before sending your PRs:

make test
make lint
make release-test

When modifying JavaScript, check with standard:

standard --fix ui/static/js/fortio_chart.js

New features and bug fixes should include a test.

See also

Our wiki and the Fortio FAQ (including for instance differences between fortio and wrk or httpbin).

Disclaimer

This is not an officially supported Google product.