PHP implements Huffman encoding/decoding

This article mainly introduces the implementation of Huffman encoding/decoding in PHP, which has certain reference value. Now I share it with you. Friends in need can refer to it.

Huffman encoding is a data compression algorithm. The core of our commonly used zip compression is Huffman encoding, and in HTTP/2, Huffman encoding is used to compress HTTP headers.

This article will use PHP to practice Huffman encoding and decoding.

1. Encoding

Word Count Count

The first step of Huffman encoding is to count the number of occurrences of each character in the document. PHP’s built-in function count_chars( ) You can do this:

$input = file_get_contents('input.txt');$stat = count_chars($input, 1);

Construct the Huffman tree

Next, construct the Huffman tree based on the statistical results. The construction method is described in detail in Wikipedia. Here is a simple version written in PHP:

$huffmanTree = [];foreach ($stat as $char => $count) {    $huffmanTree[] = [        'k' => chr($char),        'v' => $count,        'left' => null,        'right' => null,
    ];
}// 构造树的层级关系，思想见wiki：https://zh.wikipedia.org/wiki/%E9%9C%8D%E5%A4%AB%E6%9B%BC%E7%BC%96%E7%A0%81$size = count($huffmanTree);for ($i = 0; $i !== $size - 1; $i++) {
    uasort($huffmanTree, function ($a, $b) {
        if ($a['v'] === $b['v']) {            return 0;
        }        return $a[&#39;v&#39;] < $b[&#39;v&#39;] ? -1 : 1;
    });    $a = array_shift($huffmanTree);    $b = array_shift($huffmanTree);    $huffmanTree[] = [        &#39;v&#39; => $a[&#39;v&#39;] + $b[&#39;v&#39;],        &#39;left&#39; => $b,        &#39;right&#39; => $a,
    ];
}$root = current($huffmanTree);

After calculation, $root will point to the root node of the Huffman tree

Generate a coding dictionary based on the Huffman tree

With the Huffman tree, you can generate a dictionary for encoding:

function buildDict($elem, $code = '', &$dict) {
    if (isset($elem['k'])) {        $dict[$elem['k']] = $code;
    } else {
        buildDict($elem['left'], $code.'0', $dict);
        buildDict($elem['right'], $code.'1', $dict);
    }
}$dict = [];
buildDict($root, '', $dict);

Write file

Use the dictionary to encode the file content and write it to the file. There are several things to pay attention to when writing Huffman encoding to a file:

1. After writing the encoding dictionary and encoding content to the file together, it is impossible to distinguish their boundaries, so you need to The file starts writing the number of bytes they each occupy

2. ##fwrite() function provided by PHP can write 8-bit (one byte) or An integer multiple of 8 bits. However, in Huffman encoding, a character may be represented by only 1-bit, and PHP does not support the operation of writing only 1-bit to the file. Therefore, we need to splice the encoding ourselves, and only write the file after every 8-bit is obtained.

1. Similar to the second item, the final file size must be an integer multiple of 8-bit. So if the size of the entire encoding is 8001-bit, 7 0s must be added at the end

$dictString = serialize($dict);// 写入字典和编码各自占用的字节数$header = pack('VV', strlen($dictString), strlen($input));
fwrite($outFile, $header);// 写入字典本身fwrite($outFile, $dictString);// 写入编码的内容$buffer = '';$i = 0;while (isset($input[$i])) {    $buffer .= $dict[$input[$i]];    while (isset($buffer[7])) {        $char = bindec(substr($buffer, 0, 8));
        fwrite($outFile, chr($char));        $buffer = substr($buffer, 8);
    }    $i++;
}// 末尾的内容如果没有凑齐 8-bit，需要自行补齐if (!empty($buffer)) {    $char = bindec(str_pad($buffer, 8, '0'));
    fwrite($outFile, chr($char));
}
fclose($outFile);

Copy after login

<?php$content = file_get_contents(&#39;a.out&#39;);// 读出字典长度和编码内容长度$header = unpack(&#39;VdictLen/VcontentLen&#39;, $content);$dict = unserialize(substr($content, 8, $header[&#39;dictLen&#39;]));$dict = array_flip($dict);$bin = substr($content, 8 + $header[&#39;dictLen&#39;]);$output = &#39;&#39;;$key = &#39;&#39;;$decodedLen = 0;$i = 0;while (isset($bin[$i]) && $decodedLen !== $header[&#39;contentLen&#39;]) {    $bits = decbin(ord($bin[$i]));    $bits = str_pad($bits, 8, &#39;0&#39;, STR_PAD_LEFT);    for ($j = 0; $j !== 8; $j++) {        // 每拼接上 1-bit，就去与字典比对是否能解码出字符
        $key .= $bits[$j];        if (isset($dict[$key])) {            $output .= $dict[$key];            $key = &#39;&#39;;            $decodedLen++;            if ($decodedLen === $header[&#39;contentLen&#39;]) {                break;
            }
        }
    }    $i++;
}echo $output;

Before encoding: 418,504 bytes

After encoding: 280,127 bytes

Before encoding: 770,384 bytes

After encoding: 773,076 bytes

Use PHP to implement a singly linked list

The above is the detailed content of PHP implements Huffman encoding/decoding. For more information, please follow other related articles on the PHP Chinese website!