Awesome
fhttp
<!-- This note is not necessary on this repo, but I won't delete it as it should be included on the original one. **NOTE** This maintenance of this library has moved over to [Carcraftz](https://github.com/Carcraftz/fhttp). The only use for this repository is so imports will not break. The "f" stands for "fly" *(or "flex")*. fhttp is a fork of `net/http` that provides an array of features pertaining to the fingerprint of the golang `http` client. Through these changes, the `http` client becomes much more flexible, and when combined with transports such as [uTLS](https://github.com/refraction-networking/utls) it can mitigate fingerprinting requests, reducing the chances that a server detects they were made by a golang program, instead having them appear to originate from a regular Chrome browser. Documentation can be contributed, otherwise, look at tests and examples. The main one should be [example_client_test.go](example_client_test.go). -->Features
Ordered Headers
The package allows for both pseudo header order and normal header order. Most of the code is taken from this Pull Request.
Note on HTTP/1.1 header order Although the header key is capitalized, the header order slice must be in lowercase.
req.Header = http.Header{
"X-NewRelic-ID": {"12345"},
"x-api-key": {"ABCDE12345"},
"MESH-Commerce-Channel": {"android-app-phone"},
"mesh-version": {"cart=4"},
"X-Request-Auth": {"hawkHeader"},
"X-acf-sensor-data": {"3456"},
"Content-Type": {"application/json; charset=UTF-8"},
"Accept": {"application/json"},
"Transfer-Encoding": {"chunked"},
"Host": {"example.com"},
"Connection": {"Keep-Alive"},
"Accept-Encoding": {"gzip"},
HeaderOrderKey: {
"x-newrelic-id",
"x-api-key",
"mesh-commerce-channel",
"mesh-version",
"user-agent",
"x-request-auth",
"x-acf-sensor-data",
"transfer-encoding",
"content-type",
"accept",
"host",
"connection",
"accept-encoding",
},
PHeaderOrderKey: {
":method",
":path",
":authority",
":scheme",
},
}
Connection settings
fhhtp has Chrome-like connection settings, as shown below:
SETTINGS_HEADER_TABLE_SIZE = 65536 (2^16)
SETTINGS_ENABLE_PUSH = 1
SETTINGS_MAX_CONCURRENT_STREAMS = 1000
SETTINGS_INITIAL_WINDOW_SIZE = 6291456
SETTINGS_MAX_FRAME_SIZE = 16384 (2^14)
SETTINGS_MAX_HEADER_LIST_SIZE = 262144 (2^18)
The default net/http settings, on the other hand, are the following:
SETTINGS_HEADER_TABLE_SIZE = 4096
SETTINGS_ENABLE_PUSH = 0
SETTINGS_MAX_CONCURRENT_STREAMS = unlimited
SETTINGS_INITIAL_WINDOW_SIZE = 4194304
SETTINGS_MAX_FRAME_SIZE = 16384
SETTINGS_MAX_HEADER_LIST_SIZE = 10485760
The ENABLE_PUSH implementation was merged from this Pull Request.
gzip, deflate, and br encoding
gzip
, deflate
, and br
encoding are all supported by the package.
Pseudo header order
fhttp supports pseudo header order for http2, helping mitigate fingerprinting. You can read more about how it works here.
Backward compatible with net/http
Although this library is an extension of net/http
, it is also meant to be backward compatible. Replacing
import (
"net/http"
)
with
import (
http "github.com/Carcraftz/fhttp"
)
SHOULD not break anything.
Credits
Special thanks to the following people for helping me with this project.