Comments (2)
Thanks @tomByrer
Yes, I'm aware of the Brotli project by Google.
I believe it's a nice team making a really good job.
However, the direction selected is quite different from Zstd, resulting in fairly different optimization directions.
If I'm not mistaken,
initially, Brotli was about speed, most importantly decompression speed, and targeting a specific file type, fonts. They have since changed course a bit, by now targeting "general-purpose compression" and "more compression", but these roots are still there.
I believe that they made the following calculation : speed => huffman => poor compression at high statistics => Let's make statistics small => Lots of symbols (2nd order). In selecting which symbols to add, the initial use case (font compression) was rather key to determine them. They are now statically defined in the format.
Zstd rather made the following choice : speed => fse => good compression at high statistics => Let's use less symbols. And I haven't really finished this part of the job, but that gives you a direction.
So of course, since both algorithms are LZ-based, they still have some common elements, but due to these different initial impulsions, there are also some important design differences, which can't be erased by a last minute addition (such as swapping fse and huffman).
Also, note that fse did not existed when brotli started, so it limited their choice.
from zstd.
Yes, I suspected it was meant to replace Zopfli for WOFF/WOFF2; thanks for the details!
from zstd.
Related Issues (20)
- Environment variable for --memory HOT 2
- Improve misleading wording in the streaming decompression howto HOT 2
- erro
- Add library and cli flags for file format with embedded dictionary
- Question about ZSTD protocole HOT 2
- Building on MacOS 13 and targeting MacOS 11 and SDK 11.3 (or any other MacOS version) does not work HOT 2
- Integrating the library with an external thread pool HOT 2
- Is it safe to move compression and decompression contexts between threads? HOT 1
- ZDICT_trainFromBuffer_cover is not thread safe HOT 17
- zstd compression output differens with the same options between 1.5.5 and 1.5.6 HOT 5
- Warning message for `zstd -v --train` is missing line breaks
- How to accelerate the process of dictionary training in zstd? HOT 5
- tests/cli-tests/cltools/zstdless.sh fails with newer version of less HOT 3
- Please promote thread pools from experimental to stable HOT 1
- The CMake build script breaks check_ipo_supported
- Dynamic decompression HOT 3
- Change `dictionary_compression.c` example to use API for dictionary creation
- Enable weak symbol support for Risc-V? HOT 1
- Possibly missing check for truncated initial states in Huffman weight block HOT 4
- Poor compressor behavior on interleaved data HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from zstd.