Mirendil debuts Fern, a from-scratch model with up to 10M-token context built for AI R&D agents

shayan_ · x · 2026-10-27

Mirendil introduced Fern 0.1, its first model pretrained from scratch with a context window of up to 10 million tokens — roughly 0.5M lines of code or days of agent work in context at once. The company says next-token prediction keeps improving as context grows to 10M tokens.

Fern targets high-volume agentic work in AI R&D: auditing training data, debugging training runs from logs, and reading agent traces end to end. Fern 0.1 is Mirendil-Base after a short post-training round, the first and smallest of three models — two larger ones are now being pretrained, with frequent updates and model availability promised soon.

Related event: Mirendil Debuts Fern, a From-Scratch Model with 10M-Token Context(12 posts)→

Original post →

More from coding & agent

coding & agent channel →