lupengliu / gc3

GC3 - Group Communication with Context Codec for Ultra-Lightweight Source Separation

This repository provides a minimalist's implementation of several GC3-based sequence modeling networks. GC3, the abbreviation for Group Communication with Context Codec, is a simple method to decrease both the model size and complexity of sequence modeling networks for source separation. Adding GC3 to existing models can maintain the same level of performance with only 4.7% model size (storage < 600KB on hard disk, Pytorch 1.4.0) and 17.6% MACs. For details of the design, please refer to our manuscript: Group Communication with Context Codec for Ultra-Lightweight Source Separation.

To get an intuition about the effectiveness of GC3, we applied GC3 to four types of sequence modeling networks for source separation: DPRNN [1], TCN [2], UBlock [3], and Transformer [4]. The figure below (Figure 2 in the manuscript) provides the comparison of the separation performance, model complexity, and memory footprint of the four models and their GC3 counterparts: