How does the DAWG dictionary-compression algorithm work?
Essentially it is a preprocessor for gzip that removes redundancy from a sorted list of words, and typically shrinks an input wordlist by some 50% without negatively impacting gzip’s ability to further compress the file. In the new version of the DAWG code – slightly improved over the version that ships with Crack v5.
