Awesome

performance reports

Updated benchmarks are automatically generated and published when a new version of ugrep is released. Last update Fri Aug 23 14:49:02 EDT 2024

performance report x64

performance report arm64

benchmark setup

Intel x64 machine:

./install.sh # expand source code repo in corpi dir and create archives to search
./bench.sh > report_x64.md
./collect.awk < report_x64.md

ARM64 machine:

./install.sh # expand source code repo in corpi dir and create archives to search
./bench.sh > report_arm64.md
./collect.awk < report_arm64.md

the install.sh script requires the following compression utilities:

• bzip2
• gzip
• lzip
• xz
• zstd

important notes on benchmarking methodology

WARNING performance results are meaningless when the host machine executes other tasks that load the CPU; quit all running applications first, disconnect from the network if possible to halt background process networking activity, and check for running background processes (with e.g. top) before running ./bench.sh

• timing results are collected with the standard 10ms resolution; a lower resolution is unusable and a higher resolution is unreliable due to the natural timing variations observed in the system
• all timed runs are warm runs, cold runs are not timed
• all timed runs of ugrep are performed without a .ugrep configuration file by using the ugrep command
• all regex patterns tested are fully compliant with the common ERE standard syntax; a failure may occur if a grep tool fails to parse ERE (for example, ripgrep failing to parse [][a-z] in URL pattern testing, when [\[\]a-z] works for ripgrep but this is not compliant so GNU grep fails)

important notes on grep tool differences that impact the results

• ripgrep and silver searcher skip binary files by default, whereas grep and ugrep do not and use option -I to skip binary files; we include option -I in recursive searches for a fair performance comparison
• ripgrep does not output 0 matches for option -c, whereas grep and ugrep output 0 matches as expected to list all files thereby making the performance of option -c incomparable for recursive searches (note: ugrep option -m1, (--min-count=1) skips zero matches but is not used in this benchmark)
• ripgrep does not search tar file contents, instead it may report binary file matches (found "\0" byte around offset N) without exiting with an error, so we report an error instead
• ugrep option -z is more powerful than just internally decompressing a single file in a buffer to search, it searches nested archives up to nesting depth --zmax (1 by default) by spawning one or more decompression theads; none of the other grep tools can search compressed tar files, nested archives and compressed files stored within archives
• different versions and implementations of a compression library linked with ugrep may have different performance characteristics, notably zlib (gz); the performance is mostly determined by the compression library and is not attributable to the grep tool

performance report x64

found ugrep 1415832 byte executable located at /usr/local/bin/ugrep

ugrep 6.5.0 x86_64-apple-darwin21.6.0 +avx2; -P:pcre2jit; -z:zlib,bzip2,lzma,lz4,zstd,brotli,7z,tar/pax/cpio/zip
License: BSD-3-Clause; ugrep user manual: <https://ugrep.com>
Written by Robert van Engelen and others: <https://github.com/Genivia/ugrep>
Ugrep utilizes the RE/flex regex library: <https://github.com/Genivia/RE-flex>

found rg 6748656 byte executable located at /usr/local/bin/rg

ripgrep 14.1.0

features:-simd-accel,+pcre2
simd(compile):+SSE2,+SSSE3,-AVX2
simd(runtime):+SSE2,+SSSE3,+AVX2

PCRE2 10.42 is available (JIT is available)

found ag 84764 byte executable located at /usr/local/bin/ag

ag version 2.2.0

Features:
  +jit +lzma +zlib

found ggrep 263184 byte executable located at /usr/local/bin/ggrep

ggrep (GNU grep) 3.11
Packaged by Homebrew
Copyright (C) 2023 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <https://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.

Written by Mike Haertel and others; see
<https://git.savannah.gnu.org/cgit/grep.git/tree/AUTHORS>.

grep -P uses PCRE2 10.44 2024-06-07

results for large text file search

grepping rol elapsed real time (s)

grepping the elapsed real time (s)

grepping cycles|semigroups elapsed real time (s)

grepping ro[a-z]*ds elapsed real time (s)

grepping r[a-z]*st elapsed real time (s)

grepping [A-Z][a-z]+ny elapsed real time (s)

grepping [A-Z][a-z]{11}ny elapsed real time (s)

grepping \w+ny elapsed real time (s)

grepping ab(cd?)? elapsed real time (s)

grepping x*y*z* elapsed real time (s)

grepping (19|20)[0-9]{2}/(0[1-9]|1[012])|(0[1-9]|1[012])/(19|20)[0-9]{2} elapsed real time (s)

grepping (https?://|www\.)[-a-zA-Z0-9@:%._+~#=]{1,253}\.[-a-zA-Z0-9]{2,}\.[][a-zA-Z0-9()@:%_+.~#?&/=\-]+ elapsed real time (s)

grepping [a-z]+-[a-z]+ elapsed real time (s)

grepping '' elapsed real time (s)

grepping ^$ elapsed real time (s)

results for large text file search for words from files

grepping -fwords/1.txt elapsed real time (s)

grepping -fwords/2.txt elapsed real time (s)

grepping -fwords/3.txt elapsed real time (s)

grepping -fwords/4.txt elapsed real time (s)

results for large text file search with formatted output

grepping Sherlock|Holmes elapsed real time (s)

results for large text file search with replaced output

grepping flop elapsed real time (s)

results for large text file search with context

grepping ^$ elapsed real time (s)

grepping begin|end elapsed real time (s)

results for large long lines JSON file search

grepping abc[a-z0-9]+ elapsed real time (s)

results for OpenSSL source code repo directory search

grepping FIXME|TODO elapsed real time (s)

grepping char|int|long|size_t|void elapsed real time (s)

grepping ssl-?3(\.[0-9]+)? elapsed real time (s)

results for Swift source code repo directory search

grepping _(RUN|LIB|NAM)[A-Z_]+ elapsed real time (s)

grepping String|Int|Double|Array|Dictionary elapsed real time (s)

grepping (class|struct)\sS[a-z]+T elapsed real time (s)

grepping for\s[a-z]+\sin elapsed real time (s)

results for bz2 compressed large text file search

grepping landsnail elapsed real time (s)

results for gz compressed large text file search

grepping landsnail elapsed real time (s)

results for lz4 compressed large text file search

grepping landsnail elapsed real time (s)

results for xz compressed large text file search

grepping landsnail elapsed real time (s)

results for zstd compressed large text file search

grepping landsnail elapsed real time (s)

results for zip archived repo search

grepping FIXME|TODO elapsed real time (s)

results for tar archived repo search

grepping FIXME|TODO elapsed real time (s)

results for compressed tarball search

grepping FIXME|TODO elapsed real time (s)

performance report arm64

found ugrep 1266194 byte executable located at /usr/local/bin/ugrep

ugrep 6.5.0 aarch64-apple-darwin21.6.0 +neon/AArch64; -P:pcre2jit; -z:zlib,bzip2,lzma,lz4,zstd,brotli,7z,tar/pax/cpio/zip
License: BSD-3-Clause; ugrep user manual: <https://ugrep.com>
Written by Robert van Engelen and others: <https://github.com/Genivia/ugrep>
Ugrep utilizes the RE/flex regex library: <https://github.com/Genivia/RE-flex>

found rg 6680304 byte executable located at /opt/homebrew/bin/rg

ripgrep 14.1.0

features:-simd-accel,+pcre2
simd(compile):+NEON
simd(runtime):+NEON

PCRE2 10.42 is available (JIT is available)

found ag 111344 byte executable located at /opt/homebrew/bin/ag

ag version 2.2.0

Features:
  +jit +lzma +zlib

found ggrep 266352 byte executable located at /opt/homebrew/bin/ggrep

ggrep (GNU grep) 3.11
Packaged by Homebrew
Copyright (C) 2023 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <https://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.

Written by Mike Haertel and others; see
<https://git.savannah.gnu.org/cgit/grep.git/tree/AUTHORS>.

grep -P uses PCRE2 10.44 2024-06-07

results for large text file search

grepping rol elapsed real time (s)

grepping the elapsed real time (s)

grepping cycles|semigroups elapsed real time (s)

grepping ro[a-z]*ds elapsed real time (s)

grepping r[a-z]*st elapsed real time (s)

grepping [A-Z][a-z]+ny elapsed real time (s)

grepping [A-Z][a-z]{11}ny elapsed real time (s)

grepping \w+ny elapsed real time (s)

grepping ab(cd?)? elapsed real time (s)

grepping x*y*z* elapsed real time (s)

grepping (19|20)[0-9]{2}/(0[1-9]|1[012])|(0[1-9]|1[012])/(19|20)[0-9]{2} elapsed real time (s)

grepping (https?://|www\.)[-a-zA-Z0-9@:%._+~#=]{1,253}\.[-a-zA-Z0-9]{2,}\.[][a-zA-Z0-9()@:%_+.~#?&/=\-]+ elapsed real time (s)

grepping [a-z]+-[a-z]+ elapsed real time (s)

grepping '' elapsed real time (s)

grepping ^$ elapsed real time (s)

results for large text file search for words from files

grepping -fwords/1.txt elapsed real time (s)

grepping -fwords/2.txt elapsed real time (s)

grepping -fwords/3.txt elapsed real time (s)

grepping -fwords/4.txt elapsed real time (s)

results for large text file search with formatted output

grepping Sherlock|Holmes elapsed real time (s)

results for large text file search with replaced output

grepping flop elapsed real time (s)

results for large text file search with context

grepping ^$ elapsed real time (s)

grepping begin|end elapsed real time (s)

results for large long lines JSON file search

grepping abc[a-z0-9]+ elapsed real time (s)

results for OpenSSL source code repo directory search

grepping FIXME|TODO elapsed real time (s)

grepping char|int|long|size_t|void elapsed real time (s)

grepping ssl-?3(\.[0-9]+)? elapsed real time (s)

results for Swift source code repo directory search

grepping _(RUN|LIB|NAM)[A-Z_]+ elapsed real time (s)

grepping String|Int|Double|Array|Dictionary elapsed real time (s)

grepping (class|struct)\sS[a-z]+T elapsed real time (s)

grepping for\s[a-z]+\sin elapsed real time (s)

results for bz2 compressed large text file search

grepping landsnail elapsed real time (s)

results for gz compressed large text file search

grepping landsnail elapsed real time (s)

results for lz4 compressed large text file search

grepping landsnail elapsed real time (s)

results for xz compressed large text file search

grepping landsnail elapsed real time (s)

results for zstd compressed large text file search

grepping landsnail elapsed real time (s)

results for zip archived repo search

grepping FIXME|TODO elapsed real time (s)

results for tar archived repo search

grepping FIXME|TODO elapsed real time (s)

results for compressed tarball search

grepping FIXME|TODO elapsed real time (s)