Hap is a video codec that performs decompression using a computer's graphics hardware, substantially reducing the CPU usage necessary to play video — this is useful in situations where CPU power is a limiting factor, such as when working with multiple high resolution videos in real-time.
When supported natively by a host application, Hap has a number of distinct advantages over other codecs commonly used for real-time video playback.
- Very low CPU usage, even at high resolutions
- Support for an optional alpha channel
- Reduced data through-put to graphics hardware
There are four different Hap codecs: Hap, Hap Alpha, Hap Q and Hap Q Alpha.
- Hap has the lowest data-rate and reasonable image quality.
- Hap Alpha has similar image quality to Hap, and supports an Alpha channel.
- Hap Q has improved image quality, at the expense of larger file sizes.
- Hap Q Alpha has improved image quality and an Alpha channel, at the expense of larger file sizes.
Hap has some characteristics which you should consider before using it:
- Hap files are usually large and require a fast hard drive or solid state drive for playback.
- Image quality can be inferior to other, CPU-based, codecs. Hap Q gives substantially higher quality, but this comes at the expense of even larger file sizes.
This new codec is designed with the goal of playing back as many movies as possible on hardware with fast hard drives, particularly in situations where existing codecs reach the limits of the CPU to decode frames.
In particular this addresses three recent trends we've noticed in Macs currently being used for real-time visuals:
-
Upgrading to a SSD is a great way to get more use out of an older, slower machine, where the CPU is often difficult or flat out impossible to swap out.
-
Many of the newer high-end Macs (which are already recommended for their better graphics cards) come standard with SSD drives now, plus the SSDs options are widely more affordable than they were just 3 or 4 years ago.
-
For very high-end situations, it's usually possible to build a faster / bigger hard drive array, whereas you can't just stick more processors into a computer to play more movies at once.
Video codecs compress/decompress video data — they translate the files on your disk into pixels. Normally, your computer's processors do this work — GPU-accelerated codecs perform this task on the computer's graphics hardware. With Hap, this is done by using S3 Texture Compression to encode frames, which allows still-compressed frames to be passed directly to your computer's graphics hardware for decompression. Since the graphics hardware is designed to do this sort of task very quickly it still remains available for other image processing you may wish to apply to the decompressed frames, and the load on the CPU is minimal.
The Hap codec comes in three different variations, each corresponding to a different form of S3TC texture compression: Hap (DXT1), Hap Alpha (DXT5) and Hap Q (Scaled YCoCg DXT5).
Since images encoded with S3TC are still extremely large, Hap uses an additional lightweight lossless compression pass using Snappy to reduce the overall data-rate to a manageable size.
The following applications, environments and hardware have support for GPU-accelerated playback of Hap movies:
- Blendy VJ
- CoGe
- Christie / Coolux Pandoras Box
- Cinder via Cinder-Hap
- Dataton Watchout
- disguise Media Servers (formerly d3 Technologies)
- Fugio
- GrandVJ
- GRoK
- Isadora
- MadMapper
- Max via Hap Video Engine or jit.gl.hap
- Millumin
- Mitti
- MixEmergency
- modul8
- Modulo Player and Modulo Kinetic
- OpenFrameworks via ofxHapPlayer
- Painting With Light
- Quartz Composer via CoGeHapPlayer
- Remixvideo
- Smode
- TouchDesigner
- Unity via AVPro Video and Demolition Media Hap
- VDMX
- Ventuz
- Videosync
- VPT 7
- Vuo
- vvvv via Demolition Media Hap
The following applications can play (and/or encode) Hap movies with varying or no GPU-accelaration:
To add Hap support in your application, there are a number possible routes:
- On OS X, the Hap AVFoundation framework enables encoding and decoding of Hap video on Mac OS X through AVFoundation.
- For 32-bit applications on OS X and Windows, the Hap QuickTime codec allows encoding and non-accelerated playback of Hap video in any application, and assists accelerated playback in applications which support it. Discussion and sample code is available in the Hap QuickTime Playback Demo.
- A DirectShow codec is also available.
- Use any demuxer (eg libavformat from FFMPEG) to parse encoded frames from a file and then use the source code from this project to decode the Hap frames to their compressed-texture formats to pass to OpenGL or DirectX.
If you need to parse raw Hap frames yourself, source code and a specification document are available as part of this project.
The Hap codec project is open-source, licensed under a Free BSD License, meaning you can use it in your commercial or noncommercial applications free of charge.
We like to know about software that supports Hap, so if you are using it for a project, please get in touch.
This project was originally written by Tom Butterworth and commissioned by VIDVOX, 2012.
For more information and performance stats read our post on the VIDVOX blog.