Home

Awesome

pithy

pithy is licensed under the terms of the BSD license.<br /> Copyright © 2011, John Engelhart.

Notes

pithys roots can be traced back to Googles snappy compression library, but has diverged quite a bit.

pithy can not read or write the snappy compression format, and vice versa.

TODO

Write the README.md :).

Benchmarks

Size

NameUncompressedpithy 0pithy 2snappylzflzozlib 1zlib 6
alice29.txt15208993270877679096582985835686514854416
asyoulik.txt12517983039781708020772081738495680948909
baddata1.snappy2751227521275212667526228264912315122953
baddata2.snappy2748327495274952672426272265312321423035
baddata3.snappy2838428346283462747627105273882392723730
cp.html24603123981199011838118691167790467973
fields.c111504960479047284667468036653134
geo.protodata11858819984195242745927748201701884515143
grammar.lsp37211859183918001768178313441234
house.jpg126958126846126843126803130003127169126488126525
html10240021725210772414022534210591704913711
html_x_440960021753211059647289962827306747053379
kennedy.xls1029744427736425992425735402525359590242311204004
kppkn.gtb18432073768682877053575486726234987738763
lcet10.txt426754247515230250243710225007223028174142144916
mapreduce-osdi-1.pdf9433079281793317747779684772417641474940
plrabn12.txt481861340325317582329339290030297444228901195273
ptt551321687776836769345580756862776557156477
sum3824019018187281983720274176091413013002
urls.10K702087343976316942357267350981312748253275222625
xargs.142272603254525092441245118641748

Compression Speed in MB/s

Namepithy 0pithy 2snappylzflzozlib 1zlib 6
alice29.txt34.3130.4826.9218.4627.915.011.36
asyoulik.txt32.6729.0925.6317.5225.914.601.24
baddata1.snappy332.22236.4137.5912.6113.203.332.79
baddata2.snappy287.97213.1540.3912.5813.123.452.87
baddata3.snappy287.98213.2134.5712.5713.033.382.82
cp.html44.0237.6629.8122.5429.006.323.36
fields.c43.0635.5726.4525.6839.536.033.56
geo.protodata90.3382.3163.0437.9160.7712.475.42
grammar.lsp35.1533.1723.1924.9936.983.732.93
house.jpg712.25450.11209.4811.5310.412.672.46
html77.1469.6158.0941.5757.6811.024.65
html_x_4171.03131.7556.0037.6351.1811.184.36
kennedy.xls45.4137.8836.6834.3440.087.971.76
kppkn.gtb47.6642.3237.3831.0840.326.801.23
lcet10.txt33.9829.6927.1517.8423.874.921.37
mapreduce-osdi-1.pdf165.96147.4890.8714.2513.313.472.91
plrabn12.txt29.2824.6122.8415.8020.644.141.03
ptt580.6770.7668.0841.0849.5411.463.53
sum44.9138.5930.3122.7132.025.931.97
urls.10K39.1531.6831.1120.4423.315.712.47
xargs.133.6025.6819.6720.2630.313.772.99

Decompression Speed in MB/s

Namepithy 0pithy 2snappylzflzozlib 1zlib 6
alice29.txt115.76114.8448.9269.5368.7428.7133.94
asyoulik.txt112.63110.9547.1766.9265.9227.9931.66
baddata1.snappy1544.531642.51228.20114.57143.3920.5821.42
baddata2.snappy1093.851049.47251.99115.96144.8420.6020.77
baddata3.snappy1355.651355.65213.21114.71143.9920.1921.67
cp.html172.58172.5876.1974.72100.7030.8332.77
fields.c154.19156.4967.7381.80100.3433.7637.18
geo.protodata340.65343.80135.29150.60156.6454.2458.54
grammar.lsp154.64154.2472.4378.96104.4522.3223.19
house.jpg1985.66897.231017.70230.62229.3227.6036.28
html279.83280.60115.30130.03136.3950.9755.11
html_x_4832.94847.38108.72122.60129.3946.4150.31
kennedy.xls147.34147.6152.0856.7295.5432.9636.43
kppkn.gtb132.47115.9556.0285.6284.2734.0741.23
lcet10.txt109.02107.6145.5860.3461.2627.5830.86
mapreduce-osdi-1.pdf478.53463.82257.78182.13185.1029.2930.33
plrabn12.txt94.1390.7337.6055.4652.7423.6826.55
ptt5241.46182.63116.23131.32133.3649.1652.61
sum162.12147.6467.9174.8998.0429.1833.77
urls.10K156.08153.0468.1062.9377.8429.5231.03
xargs.1149.63144.2063.9872.0393.8022.0323.30