New AI Models for Long-Horizon Coding Tasks Introduced

New research demonstrates that large language models (LLMs) trained exclusively on data filtered to a K-5 elementary school curriculum do not acquire capabilities beyond that curriculum, even with scaling, post-training, or in-context learning. This indicates that the pretraining data distribution sets an effective ceiling on a model's capabilities, suggesting that new skills are elicited rather than acquired through these interventions.

A new contract-grade verifier identified significant correctness issues in GPU kernels generated by large language models (LLMs), with 39.5% found broken and 62.1% having at least one violation, despite passing standard tests. This finding indicates that current methods for evaluating LLM-generated code for GPUs are insufficient and overestimate their reliability.

Z.ai released GLM-5.3, a new coding and agent model built on the same base as GLM-5.2, but with substantial performance improvements achieved through expanded post-training. This release demonstrates that optimizing post-training can lead to significant model advancements without altering the base architecture, impacting how AI models are developed and improved.

A new vision-language model, LFM2.5-VL-3B, has been released, featuring improved screen understanding, grounding, multi-image input, and function calling. This model is designed for on-device inference and shows strong performance across various vision and text benchmarks.

New research investigates the ability of large language models (LLMs) to introspect on their internal states by injecting concept representations into their activations and measuring self-reported states. The study found that models can, in certain scenarios, identify injected concepts and recall prior internal representations, with Claude Opus 4 and 4.1 demonstrating the greatest introspective awareness. This research indicates that current LLMs possess some functional introspective awareness, which could develop further with model improvements.

Meta Superintelligence Labs released Muse Glimmer, a 30-billion-parameter model with open weights under an Apache 2.0 license, optimized for local agent workflows and coding tasks. This release enables AI applications to run on consumer hardware without cloud dependency, addressing the need for offline and private AI capabilities.

Researchers introduced a new method for knowledge distillation in Large Language Models (LLMs) that significantly reduces memory and computational costs. This approach makes large-scale experimentation and long-context healing feasible on a single GPU, addressing the high resource demands of current distillation techniques.

Meta has released Muse Glimmer, a new 30B parameter multimodal AI model that includes a 2B ViT-style vision encoder and a 28B parameter text decoder. This model is designed for local, agentic, and multimodal applications, and is open-source with day-0 support in major AI libraries.

A new framework called TutorMoments has been introduced to measure how well large language models (LLMs) can decide when to assist a student and when to encourage independent problem-solving in educational settings. Initial findings indicate that LLMs tend to over-help, providing too much support and not adequately pushing students for deeper thinking, even when prompted to balance these actions.

This article details the fundamental building blocks of vLLM, an inference system designed for high-throughput Large Language Models. It explains how vLLM enables efficient LLM inference through components like the LLM engine and its core functionalities, setting the stage for understanding more advanced features and scaling. This information is relevant for developers and researchers working on deploying and optimizing LLMs.

Prime Intellect has launched Prime Agent, an open-source, self-improving coding agent built around Recursive Language Model (RLM) and Continual Harness abstractions. This agent aims to overcome limitations of older harness designs by allowing models to adapt and manage their own context, sub-agents, and tools dynamically. It matters because it offers a new approach to AI agent design, potentially improving long-horizon autonomous evaluation and general coding assistance.

Meta introduced two architectural advancements for its ad ranking systems: a multi-stage sequence model and a learning technique using dense tokenization and target-aware attention. These innovations have led to increased conversion rates on Instagram and Facebook, and improved ad clicks on Facebook, by enhancing the efficiency and effectiveness of sequence learning in ad recommendations.

Zero-Mem is a new method for LLM agents that performs memory operations without invoking additional LLM calls or consuming tokens, addressing the high token and time costs of traditional memory systems. This approach achieves competitive performance in long-memory and long-context question-answering benchmarks while significantly reducing memory-operation time.

A new AI model, LFM2.5-2.6B, has been released, demonstrating performance comparable to models four times its size in tool use, instruction following, and multi-step agentic tasks. This development provides an efficient option for deploying local AI agents, requiring less memory and computational power.

Research indicates that Large Language Models (LLMs) struggle with tabular data prediction primarily because of high input dimensionality, rather than issues like data noise, CSV formatting, or numeric tokenization. This finding explains why LLMs underperform compared to classical machine learning methods on tabular datasets, despite their capabilities in other domains.

Meta has doubled the end-to-end training efficiency of its Generative Ads Recommendation Model (GEM), the foundation model for ads across Instagram and Facebook. This improvement was achieved by co-designing kernels, precision, parallelism, networking, and memory, resulting in a 4x increase in training FLOPs over the past year. The advancement allows Meta to scale its ad recommendation system more efficiently, addressing unique challenges posed by combining recommendation systems with LLM-scale training.

A new benchmark called MirrorCode has been introduced to assess AI models' ability to re-implement entire programs without access to original source code or the internet. This benchmark aims to measure AI performance on complex, long-horizon coding tasks, contrasting with existing benchmarks that focus on shorter tasks. Claude Opus 4.7 successfully re-implemented a bioinformatics toolkit with 16,000 lines of Go, demonstrating AI's current capability in this area.

Kaggle and Google's recent 5-Day AI Agents: Intensive Vibe Coding Course registered over 353,000 participants, focusing on programming AI through natural language. This collaboration highlights the demand for rapid learning in AI development and the shift towards deploying production-grade AI agents.

Cloudflare implemented three techniques to efficiently serve large language models like Kimi K-series and GLM on Workers AI: KV cache quantization, model weight compression, and cache protection. These optimizations allow Cloudflare to support more customers at lower costs without affecting model accuracy.

Researchers introduced Persistent State Machines (PSMs) as a formal discrete framework for attention operators in Large Language Models, demonstrating its implementation feasibility on programmable logic. This approach allows for low-power, in-memory computation of LLM attention, potentially leading to more efficient hardware for AI inference.

Explorative Modeling (XM) is a new paradigm for generative modeling that acts as a pretraining axis and enables end-to-end generation. XM improves existing models across images, video, and language, showing increased gains with data and parameter scale, and offers significant efficiency improvements.

Researchers introduced ORCA-bench, a new benchmark to assess the capability of large language model agents in performing oncall root cause analysis (RCA) within a production-fidelity environment. The benchmark revealed that current frontier agents achieve a maximum RCA accuracy of 25.3% on medium-difficulty tasks, indicating a significant gap before they can be reliably used for production reliability.

New LFM2.5-Encoders have been released, offering efficient long-context inference on CPUs for NLP tasks. These models provide strong performance comparable to larger encoders while maintaining faster processing speeds, particularly for inputs up to 8,192 tokens.

Researchers introduced Kimi Linear, a hybrid linear attention architecture that surpasses full attention in various scenarios, including short-context, long-context, and reinforcement learning. This architecture reduces KV cache usage by up to 75% and increases decoding throughput by up to 6 times for a 1M context, offering a more efficient replacement for existing attention mechanisms.

Researchers developed a method where a frozen 12B language model, augmented with a persistent memory of verified solutions, achieves 100% accuracy on specific problem families with zero generation tokens. This approach allows for deterministic, bit-exact answers by reusing pre-verified solutions, decoupling capability from continuous model retraining and parameter scaling.

The llm-d project released co-operative time-slicing, a solution that interleaves independent reinforcement learning (RL) jobs on shared hardware to reduce idle accelerator time. This improves price-performance and lowers total cost of ownership for large language model (LLM) post-training by increasing accelerator duty cycles from 40% to 70%.

Laguna S 2.1 launches as a 118B parameter Mixture-of-Experts model with advanced reasoning capabilities. It excels in long-horizon coding benchmarks, outperforming larger models in its weight class, and supports extensive context lengths.

Single-pass AI coding remains relevant but is considered suitable only for simpler tasks. Experts advocate for adopting high-reasoning AI, which employs multi-step problem-solving for more complex coding challenges.

Xiaomi-Robotics-1 enhances robot policy models through 100,000 hours of embodiment-free pre-training combined with real-robot data. This approach seeks to overcome data scarcity in robotics and offers insights into the effects of large-scale training on robot capabilities.

A study on coding agents shows they can internally represent program properties and predict future edits. This insight into how language models operate could advance research in coding agent interpretability.

Cognition has released SWE-1.7, a model designed for long-horizon asynchronous tasks with improved cost-performance. This launch advances reinforcement learning techniques and challenges the existing limits of post-training capabilities.

GLM-5.2 introduces a 1M-token context improving performance in long-horizon coding tasks. The model features enhanced coding capabilities and architecture improvements that significantly reduce computational costs while maintaining performance, marking it as a competitive player in the open-source sector.