Jet-Long: Long-Context Extension Method

nvidia · hf · 2026-07-10

NVIDIA proposed Jet-Long, a zero-shot and efficient method for extending the context length of large models. It maintains high performance across various sequence lengths by dynamically adjusting scaling factors and utilizing a bifocal attention mechanism.

Original post →

More from Research

Research channel →