IBM

Berita AI terbaru, model, dan rilis dari IBM. ['ChartNet', 'Granite 4.0', 'Granite-Docling-258M', 'Granite Speech', 'Granite Speech 4.0 1B', 'Granite Speech 4.1 2B', 'Granite Speech 4.1 2B-NAR', 'Granite-Vision-3.3-2B', 'IBM gender classifier', 'сверхпроводящий квантовый компьютер IBM']

Riset 🇺🇸

Beyond Standard LLMs: Linear Attention Hybrids, Text Diffusion Models, Code World Models, and Small Recurrent Transformers

The article explores alternatives to standard autoregressive transformer-based LLMs: linear attention hybrids (MiniMax-M1, Qwen3-Next, DeepSeek V3.2, Kimi Linear), text diffusion models, code world models, and small recurrent transformers. The author notes a return to classical attention in MiniMax-M2 and the complexity of linear attention in production.

Moonshot AIMoonshot AI MiniMaxMiniMax Alibaba/QwenAlibaba/Qwen DeepSeekDeepSeek Google/DeepMindGoogle/DeepMind MistralMistral MetaMeta Hugging FaceHugging Face Allen Institute for AIAllen Institute for AI xAIxAI OpenAIOpenAI IBMIBM NVIDIANVIDIA
Sebastian Raschka27.07 · 17:04
Berita terbaru