From 49f707b0de6cb07cf881f69c0d2f3c0cf135ee9e Mon Sep 17 00:00:00 2001 From: Takayuki MATSUOKA Date: Fri, 3 Apr 2015 17:32:15 +0900 Subject: Add icons, tweak chart comments - Add icons. Just a setup. Proper layout needed. - Tweak chart comments. But claim of charts are still obscured. - What is superiority of LZ4 ? --- test.html | 232 ++++++++++++++++++++++++++++++++++++++++++++++++-------------- 1 file changed, 180 insertions(+), 52 deletions(-) diff --git a/test.html b/test.html index cd94fb1..ea14f90 100644 --- a/test.html +++ b/test.html @@ -76,8 +76,8 @@ Benchmarks ---------- The benchmark uses the - [Open-Source Benchmark program by m^2 (v0.14.2)](http://encode.ru/threads/1371-Filesystem-benchmark?p=33548&viewfull=1#post33548) - compiled with GCC v4.6.1 on Linux Ubuntu 64-bits v11.10, +[Open-Source Benchmark program by m^2 (v0.14.2)](http://encode.ru/threads/1371-Filesystem-benchmark?p=33548&viewfull=1#post33548) +compiled with GCC v4.6.1 on Linux Ubuntu 64-bits v11.10, The reference system uses a Core i5-3340M @2.7GHz. Benchmark evaluates the compression of reference [Silesia Corpus](http://sun.aei.polsl.pl/~sdeor/index.php?page=silesia) in single-thread mode. @@ -92,7 +92,7 @@ Benchmark evaluates the compression of reference [Silesia Corpus](http://sun.aei

Transfer + Decompression Time @1000Mbit/s (without I/O overwrapping, multithreading)

- This benchmark simulates simple "static content transfer" scenario such as Kernel compression + This benchmark simulates simple "static content transfer" scenario such as OS Kernel compression or video game's static assets (text/images/tables/scripts/etc) which loading from Flash Memory / HDD / SSD.

@@ -100,6 +100,9 @@ Benchmark evaluates the compression of reference [Silesia Corpus](http://sun.aei Because only content developers compress the data at once and usually they don't care about its computational cost. But they always care enduser's experience a.k.a. "loading time" and bandwidth.

+

+ Please pay attention to "LZ4HC -9" which is quite faster than other methods. +

@@ -120,11 +124,11 @@ Benchmark evaluates the compression of reference [Silesia Corpus](http://sun.aei

Compression + Transfer + Decompression Time @1000Mbit/s (without I/O overwrapping, multithreading)

- This benchmark simulates "dynamic content transfer" scenario such as filesystems, caches, network packets, RPCs, databases, and usual files. + This benchmark simulates "dynamic content transfer" scenario such as filesystems, caches, network packets, IPC/RPCs, and databases.

In this case, both compression and decompression times are important. - Also robust compression time for incompressible (eg. encrypted) data is required. + You can observe "Fast compression algorithms" are better than traditional algorithms such as DEFLATE (zlib).

@@ -145,77 +150,200 @@ Benchmark evaluates the compression of reference [Silesia Corpus](http://sun.aei -
-## Specifications +## Documentation The LZ4 block compression format is detailed within [lz4_block_format.txt](lz4_block_format.txt). -For streaming unknown amount of data, and compress files of any size, a frame format has been published, and can be consulted within the file [LZ4_Frame_Format.html](LZ4_Frame_Format.html). +For streaming unknown amount of data, and compress files of any size, +a frame format has been published, and can be consulted within the file [LZ4_Frame_Format.html](LZ4_Frame_Format.html). + +
## Interoperable LZ4 versions -The following versions are provided for languages beyond the C reference version. They are in conformance with the LZ4 frame specification and are therefore interoperable. +The following versions are provided for languages beyond the C reference version. +They are in conformance with the LZ4 frame specification and are therefore interoperable. + +|Language |Author |URL | +|-- |-- |-- | +|__Javascript__ |Pierre Curto |https://github.com/pierrec/node-lz4 | +|__C++11 multi-threads__ |Takayuki Matsuoka |https://github.com/t-mat/lz4mt | +|__Python__ |Christopher Jackson |https://github.com/darkdragn/lz4tools | +|__Delphi__ |Hanno Hugenberg |https://github.com/Hugie/lz4-delphi | +|__Go__ |Pierre Curto |https://github.com/pierrec/lz4 | +|__Rust__ |Artem Navrotskiy |https://github.com/bozaro/lz4-rs | + -* __Javascript__ : by Pierre Curto, at https://github.com/pierrec/node-lz4 -* __C++11__ multi-threads : by Takayuki Matsuoka, at https://github.com/t-mat/lz4mt -* __Python__ : by Christopher Jackson, at https://github.com/darkdragn/lz4tools -* __Delphi__ : by Hanno Hugenberg, at https://github.com/Hugie/lz4-delphi -* __Go__ : by Pierre Curto, at https://github.com/pierrec/lz4 -* __Rust__ : by Artem Navrotskiy, at https://github.com/bozaro/lz4-rs
-## Other Source versions : -The following versions compress data blocks using LZ4 compression algorithm in multiple languages. Each version encapsulates the compressed result into its own header/frame format convention. - -* __Java__ : by Adrien Grand, at https://github.com/jpountz/lz4-java -* __Python__ : by Steeve Morin, at http://pypi.python.org/pypi/lz4 -* __Perl__ : by Gray, at http://search.cpan.org/dist/Compress-LZ4/ -* __C#__ : by Milosz Krajewski, at http://lz4net.codeplex.com -* __C#__ streaming : by Phill Djonov, at https://github.com/pdjonov/Lz4Stream -* __Go__ : by Branimir Karadzic, at https://github.com/bkaradzic/go-lz4 -* __Ruby__ : by Komiya Atsushi, at http://rubygems.org/gems/lz4-ruby -* __PHP__ : by Kamijo, at https://github.com/kjdev/php-ext-lz4 -* __Lua__ : by Christophe Delord, at http://cdsoft.fr/bl/bonaluna.html -* __Haskell__ : by Mark Wotton, at http://hackage.haskell.org/package/lz4 -* __Erlang__ : by Tetsuya Suzuki, at https://github.com/szktty/erlang-lz4 -* __Smalltalk__ (Pharo) : by Mariano Martinez Peck, at http://smalltalkhub.com/#!/~marianopeck/LZ4/ -* __OCaml__ : by Peter Zotov, at https://github.com/whitequark/ocaml-lz4 -* __Rust__ : by Alex Crichton, at http://alexcrichton.com/rust-compress/compress/lz4/index.html -* __8088 assembly__ decoder, by Jim Leonard, at http://www.oldskool.org/pc/lz4_8088 -* __6502 & 65C02 assembly__ decoder, by Peter Ferrie, at http://pferrie.host22.com/misc/appleii.htm -* __Atari XL/XE assembly__ decoder, by xxl, at http://xxl.atari.pl/?p=1524 -* __65c816 assembly__ decoder, by Olivier Zardini, at http://www.brutaldeluxe.fr/products/crossdevtools/lz4/index.html +## Other Source versions +The following versions compress data blocks using LZ4 compression algorithm in multiple languages. +Each version encapsulates the compressed result into its own header/frame format convention. + +|Language |Author |URL | +|-- |-- |-- | +|__Java__ |Adrien Grand |https://github.com/jpountz/lz4-java | +|__Python__ |Steeve Morin |http://pypi.python.org/pypi/lz4 | +|__Perl__ |Gray |http://search.cpan.org/dist/Compress-LZ4/ | +|__C#__ |Milosz Krajewski |http://lz4net.codeplex.com | +|__C#__ streaming |Phill Djonov |https://github.com/pdjonov/Lz4Stream | +|__Go__ |Branimir Karadzic |https://github.com/bkaradzic/go-lz4 | +|__Ruby__ |Komiya Atsushi |http://rubygems.org/gems/lz4-ruby | +|__PHP__ |Kamijo |https://github.com/kjdev/php-ext-lz4 | +|__Lua__ |Christophe Delord |http://cdsoft.fr/bl/bonaluna.html | +|__Haskell__ |Mark Wotton |http://hackage.haskell.org/package/lz4 | +|__Erlang__ |Tetsuya Suzuki |https://github.com/szktty/erlang-lz4 | +|__Smalltalk__ (Pharo) |Mariano Martinez Peck |http://smalltalkhub.com/#!/~marianopeck/LZ4/ | +|__OCaml__ |Peter Zotov |https://github.com/whitequark/ocaml-lz4 | +|__Rust__ |Alex Crichton |http://alexcrichton.com/rust-compress/compress/lz4/index.html | +|__8088 assembly__ decoder |Jim Leonard |http://www.oldskool.org/pc/lz4_8088 | +|__6502 & 65C02 assembly__ decoder |Peter Ferrie |http://pferrie.host22.com/misc/appleii.htm | +|__Atari XL/XE assembly__ decoder |xxl |http://xxl.atari.pl/?p=1524 | +|__65c816 assembly__ decoder |Olivier Zardini |http://www.brutaldeluxe.fr/products/crossdevtools/lz4/index.html | + +
## LZ4 is used by -* __Operating Systems__ : ![](images/linux50.png) [Linux](https://github.com/torvalds/linux), ![](images/FreeBSD50.png) [FreeBSD](http://www.freebsd.org/), ![](images/Illumos50.png) [Illumos](http://wiki.illumos.org/display/illumos/illumos+Home), ![](images/smartos50.png) [SmartOS](http://smartos.org/) -* __File Systems__ : OpenZFS, Hammer2, SquashFS, LessFS, LeoFS, Grub -* __Big Data__ : Hadoop, Cassandra, Hbase, Rarelogic, SparkSpark, Hustle -* __Search Engine__ : Lucene, Solr, Scalyr, kafka -* __Database__ : MySQL, Tokudb, Delphix, infiniSQL, RocksDB, OlegDB -* __Games__ : Battlefield 4, Guild Wars 2, Sine Mora, 1000 Tiny Claws -* __Graphics__ : nVidia, Enlightenment, Xpra, OpenVDB, Scaplib, kanzi -* __Network__ : freeNAS, openVPN, Netty, dovecot, virtualHere -* __Storage__ : Datastax, Nimble Storage, Nexenta, K2 Spear, Syneto OS -* __Caching__ : Zram, HHVM, PHP Zend Optimizer -* __Other__ : Mozilla Firefox, Bareos, GTKWave, Blosc, Facebook's Mercurial, Nippy, systemd + +#### Operating Systems +
+ +
+ +#### File Systems +
+ +
+ +#### Big Data +
+ +
+ +#### Search Engine +
+ +
+ +#### Database +
+ +
+ +#### Games +
+ +
+ +#### Graphics +
+ +
+ +#### Network +
+ +
+ +#### Storage +
+ +
+ +#### Caching +
+ +
+ +#### Other +
+ +
--- - + - + - + -- cgit v0.12