Yoav Goldberg: encoder-only, instruct-tuned transformers are a thing again?
yoavgo · x · 2026-09-16
Yoav Goldberg remarks that encoder-only, instruct-tuned transformers appear to be making a comeback. A one-line observation on an architecture trend, with no specific model or evidence given.
More from Models
- DeepSeek harness spotted with experimental computer use and browser use updates — kevinkern · 2026-09-16
- Unverified claim: Gemini API to be permanently discontinued on Sep 24, 2026 — Professional-Cry3836 · 2026-09-16
- Japan's crowdsourced Minna de Honkoku OCR upgrades to v19 with better kanbun recognition — tkasasagi · 2026-09-16
- Even the 20x plan hits weekly limits: user hunts an open-weight model for Blender — Individual-Dot5488 · 2026-09-16
- Third-party tests confirm typesafeai's Jev matches GPT-5.6 Terra-level intelligence — hardimanjames · 2026-09-16
- DeepSeek V4.1 shows off its vision skills, but some providers ship without it enabled — xeophon · 2026-09-16