Qwen 3 8B Exhibits Patterns in Day-of-Week Embeddings

Sauers_ · x · 2026-07-04

The author observed how the Qwen 3 8B model represents days of the week: Wednesday, Tuesday, and Saturday seem to share a certain similar "vibe." The first two principal components form a circular structure, while the third axis exhibits a different pattern, reflecting the model's internal geometric organization of time concepts.

Original post →

More from Models

Models channel →