Conditional Program Shrinks LLM Lookup Tables 75% While Improving Fidelity

dnotitia · hf · 2026-10-20

A paper from Dnotitia Inc. and KAIST introduces Conditional Program (CP), a compressed representation for conditional-memory embedding tables in LLMs.

Instead of keeping the full table resident, CP reconstructs only the rows an input requests, representing each row as a short code plus a local scale, with the reconstruction program shared across the table and rows independently decodable.

Result: 75% storage reduction while improving fidelity over the uncompressed baseline.

Original post →

More from Research

Research channel →