wyrover / wget-gzip

GNU Wget with gzip compression support

wget-gzip

This is a branch of GNU Wget that adds support for transparent HTTP compression. Wget will always send Accept-Encoding header in HTTP requests. If server returns Content-Encoding header the file is decompressed on the fly.

Standards

• Accept-Encoding request header per section 14.3 of RFC 2616
• Content-Encoding reply header per section 14.11 of RFC 2616
• Gzip compression per RFC 1952, using Zlib

Limitations

• Only "gzip" method is supported.
• This is currently developed on Windows so it won't compile on Unix systms (not that it's impossible, it just needs some code clean up)
• Only supports GNU TLS and not OpenSSL
• Does not support NTLM authentication (because of no OpenSSL support)

Building

I'm using Visual C/C++ 2008 with Git Source Control Provider, so I'm just pulling the solution directly from GitHub. There are two empy dirctories lib and include that need to be populated with external library files.

• External libraries to compile wget-gzip
  • zlib-lib
    • Copy lib from the archive to project's lib directory
    • Copy include from the archite to project's include directory
  • gnutls
    • Copy lib from the archite to project's lib directory
    • Copy include from the archite to project's include directory
• External runtime libraries (DLL) to run wget-gzip
  • libgnutls-28.dll, libgmp-10.dll, libhogweed-2-1.dll, libnettle-4-3.dll, libp11-kit-0.dll from the gnutls gnutls (same as above)
  • zlib1.dll from zlib-bin
  • You need to place these in SYSTEM32 or in the same folder as wget.exe binary

License

GNU Wget is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 3 of the License, or (at your option) any later version.

GNU Wget is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with Wget. If not, see GNU Licenses.

Additional permission under GNU GPL version 3 section 7

If you modify this program, or any covered work, by linking or combining it with the OpenSSL project's OpenSSL library (or a modified version of that library), containing parts covered by the terms of the OpenSSL or SSLeay licenses, the Free Software Foundation grants you additional permission to convey the resulting work. Corresponding Source for a non-source form of such a combination shall include the source code for the parts of OpenSSL used as well as that of the covered work.