A Short History of the Bit

Long before writing, people needed to keep track of how many — sheep, days, debts. The first tools were physical and direct: notches on a bone, pebbles in a pouch, knots on a cord. Each mark stood for one thing. This is unary counting, and it works, but it scales terribly: recording a hundred sheep means a hundred notches.

The leap to symbols — a single mark that means "ten", another that means "hundred" — compressed counting enormously. Roman numerals, then the place-value system we inherited from India via the Arab world, let a handful of digits express any quantity. The crucial realisation buried in place value is that the position of a symbol carries information, not just the symbol itself. That idea comes back with a vengeance in computing.

For most of history, more symbols seemed better — ten digits, twenty-six letters. The counter-intuitive turn is that you can represent anything with just two symbols, 0 and 1, if you are willing to use more positions.

This is binary. The number five is 101; the letter A is a code like 01000001; a black pixel and a white pixel are 0 and 1. Why deliberately restrict yourself to two symbols? Because two states are the easiest thing in the world to build reliably in a machine: a switch that is off or on, a voltage that is low or high, a magnetic region pointing one way or the other. A device only has to tell two things apart, not ten, so it can be made small, fast and dependable — and then repeated billions of times.

A single binary digit — one 0-or-1 choice — is a bit.

The final piece came in 1948, when Claude Shannon showed that the bit is not just a convenient way to store numbers — it is the universal unit of information itself. Any message, whatever its form — text, sound, an image, a measurement — can be encoded as bits, and Shannon gave a precise way to measure how many bits a source of information truly requires. A fair coin flip is exactly one bit; a lopsided coin, less; predictable text, less still, which is why it compresses.

That single idea unified fields that had seemed unrelated. A photograph, a symphony, a genome and this paragraph are, at bottom, the same kind of thing: a pattern of bits. Once everything is bits, one machine can store, copy, transmit and transform all of it with the same operations. The bit is the common denominator of the digital age — and everything else Educatifu's tracks explore, from neural networks to cryptography to money, is ultimately built on it.