Model Showcase 2: New Architectural Approaches in Language Models

This column focuses on open-weight models from China, Liquid Foundation Models, performant lean models, and a Titan from ...
WinBuzzer

Google Researchers Say AI Models Exhibit Signs of Collective Intelligence

Google researchers have discovered that AI reasoning models like DeepSeek-R1 and QwQ-32B simulate internal debates between ...
NextBigFuture

Analog in-memory Computing Attention Mechanism for Fast and Energy-efficient Large Language Models

A Nature paper describes an innovative analog in-memory computing (IMC) architecture tailored for the attention mechanism in large language models (LLMs). They want to drastically reduce latency and ...