Dietterich on LLM Knowledge Representation: Facts Are Easy, Relations Are Hard

ML veteran Thomas Dietterich argues that facts like 'Albany is located in NY' can be stored in databases, while neural networks' real strength lies in representing the full network of relationships, offering a new perspective on LLM knowledge representation.

2026-09-28 ~ 2026-09-28 · 2 related posts

• Tom Dietterich: 'Albany is in NY' is simple — its web of associations is not — tdietterich · 2026-09-28
• Dietterich: facts fit in databases, but association networks are neural nets' strength — tdietterich · 2026-09-28