Linux User Space

The History of Xz (and the "Hack"!)


Listen Later

The further you dig, the farther the history goes, so we settled on starting in 1906, then the 90's, then Slackware. This is the history of Xz that culminated into a "hack" that would have rocked the world if not for one intrepid SQL developer.

Originally released in the full episode, Open Source Isn't Safe! on May 13th

https://www.youtube.com/watch?v=I3bN3PRmHJY

📖The History of XZ🦜

LZMA
https://web.archive.org/web/20121109182343/http://sourceforge.net/projects/sevenzip/forums/forum/45797/topic/1025556
Andrey Markov
https://en.wikipedia.org/wiki/Markov_chain
LZ77 and LZ78
https://en.wikipedia.org/wiki/LZ77_and_LZ78
7zip history
https://7-zip.org/history.txt
Slackels
https://web.archive.org/web/20060202151612/https://tukaani.org/
LZMA in the form of the GCC compiled LZMA SDK
https://web.archive.org/web/20060213143853/http://tukaani.org/lzma/history
Tukanni Linux Project was officially gone
https://web.archive.org/web/20071011030325/http://tukaani.org/
LZMA Utils was left behind in favor of the similarly LZMA-backed Xz Utils
https://web.archive.org/web/20090830051503/http://tukaani.org:80/xz
version 5.0 is the transition from LZMA to XZ
https://web.archive.org/web/20101201065849/http://tukaani.org/xz/
Some distributions would eventually migrate to using Z Standard compression, including Arch in 2019 and Fedora and Ubuntu would make the switch in 2020
https://archlinux.org/news/now-using-zstandard-instead-of-xz-for-package-compression/
https://fedoraproject.org/wiki/Changes/Switch_RPMs_to_zstd_compression
A new face, Jigar Kumar, shows up
https://www.mail-archive.com/[email protected]/msg00565.html
January 7th, 2023, Jia Tan was finally able to merge their own commits to Xz on Github
https://github.com/tukaani-project/xz/pull/7
Jia tries to convince the OSS-Fuzz team to accept a patch that disabled Indrect Function
https://github.com/google/oss-fuzz/pull/10667
Adding the test files which weren't test files at all
https://git.tukaani.org/?p=xz.git;a=commitdiff;h=cf44e4b7f5dfdbf8c78aef377c10f71e274f63c0
Andres Freund's Mastodon post
https://mastodon.social/@AndresFreundTec/112180083704606941
On April 2nd, 2024, Collin adds a page to his tukaani.org domain
https://tukaani.org/xz-backdoor/

...more
View all episodesView all episodes
Download on the App Store

Linux User SpaceBy