Zero-Training PCA Trick Pushes 577M Embedding Model to Top of MAEB Audio Benchmark
A zero-training experiment using PCA to fill the 577M EmbeddingGemma-2's 256-dim null space lifted its MAEB audio benchmark score from 49.3%, beating 9B-parameter models.
2026-10-28 ~ 2026-10-28 · 2 related posts
- Zero-training PCA head lifts 577M EmbeddingGemma-2 to #1 on MTEB audio, beating 9B models — JeanMichelRanu · 2026-10-28
- Zero-training PCA injection into a 256d null space takes EmbeddingGemma-2 (577M) from #26 to #1 on MAEB audio — JeanMichelRanu · 2026-10-28