Claude Shannon: The Father of Information Theory Behind the AI Era

Posts revisit Claude Shannon's legacy: his 1948 paper founded information theory, his thesis linked Boolean algebra to circuits, and Shannon entropy underpins the cross-entropy training of all modern LLMs.

2026-08-21 ~ 2026-08-21 · 2 related posts

• Shannon Entropy Defines Information, Cross-entropy Trains All LLMs — techNmak · 2026-08-21
• Claude Shannon: The 32-year-old who founded the Information Age in 1948 — eyishazyer · 2026-08-21