P

Patrick Craig

patrickcraig.co.uk · Personal blog · on HN since 2011

Patrick Craig tells the story of the $5000 compression challenge, in which a challenge to compress random data was gamed.

What HN saysHN links it whenever data compression or storing data in metadata comes up, and one commenter ranks it as an excellent computer story.
24HN people shared it
11linked it in comments
13stories submitted
665story points
2 years agolast shared
2011people per year2026

Most-shared posts

  1. 1
    The $5000 Compression Challenge
    14 people · 658 points · first shared 2011 · 185 comments on HN
  2. 2
    The $5000 Compression Challenge
    10 people · 7 points · first shared 2015 · discussion on HN

What HN people wrote when they linked it

fogof · 2021-03-04
He did not, full story, for the perspective of the metadata guy is here https://www.patrickcraig.co.uk/other/compression.htm Excellent computer story, on a par with "We can't send email more than 500 miles" IMO.
gameshot911 · 2017-03-08
Somewhat off topic, but this reminded me of one of my favorite HN submissions: Link - http://www.patrickcraig.co.uk/other/compression.php Previous commentary - https://news.ycombinator.com/item?id=9163782
twinge · 2023-01-26
Storing data in the metadata reminds me of the $5000 compression challenge: https://www.patrickcraig.co.uk/other/compression.htm
btilly · 2020-03-13
Same problem. The amount of information that you need to specify a compressible offset plus the compressibility of said offset adds up to at least the amount of information you were trying to encode, and no compression happens. If you ignore either half of the information problem, you can get what looks like compression but really isn't. See https://www.patrickcraig.co.uk/other/compression.php for a fun story about "data hiding" to show exactly how sneaky the data hiding can be.
abhgh · 2018-09-04
Do you mean this - [1]? Yes, this was pretty cool! I esp liked how Mike, the person initiating the bet, initially was super-confident he'd win: It would be very easy to point out to him the impossibility of his task, but far more interesting to see how long he will struggle with the problem before realizing it for himself. [1] http://www.patrickcraig.co.uk/other/compression.php
tsellon · 2014-04-22
Hiding the entropy in the language reminds me of this writeup about the $5000 compression challenge from back in the day: http://www.patrickcraig.co.uk/other/compression.htm
jlgreco · 2013-04-03
Reminds me of the infamous compression challenge where one person tried to cheat and win the prize by storing data in filenames: http://www.patrickcraig.co.uk/other/compression.htm
DanBC · 2012-10-01
Here's a mildly amusing challenge and response to that challenge: (http://www.patrickcraig.co.uk/other/compression.htm) This page has some nice compression gimmicks (a file that compresses well with one algorithm but hardly at all with another; a file that uncompresses to itself) (http://www.maximumcompression.com/compression_fun.php) The large text compression benchmark has some nice finely tuned compression software and statistics. (http://mattmahoney.net/dc/text.html) And the Hutter prize is interesting. (Get the 100 Mb file of enwiki8 and the de-compressor to under 16 Mb) (http://prize.hutter1.net/)

Keyboard shortcuts

/Search
j kNext / previous blog
EnterOpen selected blog
vVisit the blog site
fFollow / unfollow
lSwitch grid / list view
dSwitch dark mode
g hHome
g pTop posts
g tTopics
g fFollowing
g lLiked
g yHistory
g qFAQ
EscBack / close