Kyutai released REKI, a 2.4 billion parameter vision-language-action model designed for efficient robot manipulation. With a smaller parameter count than comparable models and innovative memory architecture, REKI achieves top performance on LIBERO-Plus benchmarks while reducing computational overhead, potentially lowering barriers to robot deployment in warehouses and factories.
Key Takeaways
- Kyutai's REKI is a 2.4 billion parameter VLA that achieves 90.4% success on LIBERO-Plus benchmarks while remaining roughly half the size of competing manipulation models.
- The model uses an innovative memory architecture embedding 32 learned register tokens in its action expert, adding only 0.1 milliseconds of latency while cutting pose oscillations from 18.6% to 4.1%.
- Trained exclusively on 1.0 billion frames of public data, REKI demonstrates that efficient manipulation models need not rely on proprietary datasets or massive compute, potentially democratizing robot learning.
- At 21.8 milliseconds per inference on a single H100 GPU, REKI's computational efficiency could lower the software cost barrier that has prevented robot deployment in many manual labor contexts.
- Smaller parameter counts and efficient inference directly improve the business case for robot manipulation in warehouses and factories by reducing capital requirements for GPU infrastructure.
Kyutai, in collaboration with Inria and École des Ponts, has released REKI, a 2.4 billion parameter vision-language-action (VLA) model specifically designed for efficient robot manipulation. The release addresses a persistent challenge in physical AI: how to enable robots to perform complex dexterous tasks—picking, sorting, and assembly—without the prohibitively expensive compute budgets that have confined robot learning to well-resourced research laboratories.
Robot manipulation has long been considered the hardest unsolved problem in physical AI. While advances in large language models and vision systems have accelerated progress in perception and planning, translating those capabilities into reliable physical action remains difficult. REKI represents a deliberate engineering choice to prioritize deployment feasibility over raw model scale. Rather than relying on massive foundation models that require extensive GPU clusters, REKI pairs a Qwen3.5-2B vision-language backbone with a 200 million parameter action expert, keeping total parameters to 2.4B—roughly half the size of competing VLA models like Qwen-RobotManip (4.7B) and π0 (3.3B).
Technical Architecture and Memory Innovation
The model is pretrained exclusively on public data, drawing from 1.0 billion frames and 12.2 million vision-language samples sourced from datasets including DROID, BridgeData V2, AgiBot World, EgoDex, and EgoVerse. Real-robot teleoperation accounts for 639.8 million frames, simulation contributes 193.9 million, and egocentric human video provides 170.9 million. Pretraining consumed 200,000 steps on 32 H100 GPUs.
A key technical innovation sets REKI apart: its approach to memory. Most VLAs process only the current camera frame, lacking temporal context that would help resolve ambiguity between visually similar states—a problem known as perceptual aliasing. REKI embeds memory directly into its action expert module rather than feeding past frames back into the vision-language model, avoiding the training and inference costs of those approaches. The mechanism uses 32 learned register tokens that cross-attend encoded prompts and current-frame views while also self-attending registers from earlier frames, with the cache covering the last three frames spaced one second apart.
This memory adds only 0.1 milliseconds to REKI's inference latency and uses approximately 2 megabytes of GPU memory per past frame. The benefit is measurable: on RoboTwin benchmarks, memory cuts the frequency of arm oscillations between two poses from 18.6% to 4.1%, a failure mode that stems directly from perceptual aliasing.
Performance and Deployment Benchmarks
REKI achieves 90.4% success rate on LIBERO-Plus, outperforming Qwen-RobotManip at 89.0% and π0 at 85.7%. On RoboTwin Clean2Rand, REKI scores 65.8%, trailing only Qwen-RobotManip at 68.5%. Performance varies across benchmarks: on RoboCasa365, REKI achieves 38.4%, ahead of RLDX-1 (36.0%) and Qwen-RobotManip (35.9%), but behind Xiaomi-Robotics-1 (57.4%). On the full LIBERO benchmark suite, REKI reaches 97.6%, and on RoboTwin 2.0 it achieves 85.9% on easy tasks and 84.6% on hard ones.
Compiled inference latency on a single NVIDIA H100 is 21.8 milliseconds per action chunk, processing input from two cameras at 256×256 resolution. This speed matters for real-world deployment: robots must respond to environmental changes and user commands within human time scales.
Deployment and Real-World Application
Kyutai provides six model checkpoints: the pretrained base plus task-specific finetunes for LIBERO, RoboTwin (two variants), RoboCasa365, and RoboCasa-GR1. All weights are available open-source under CC BY-NC-SA 4.0 license via Hugging Face, using BF16 precision without quantized variants currently announced. Deployment follows the LeRobot async-inference protocol. On a real UR5 arm, REKI was finetuned for 3,000 steps (one hour) using 50 demonstrations per task, demonstrating rapid task adaptation with minimal real-world data.
Economic and Labor Market Implications
A smaller, more efficient VLA model like REKI has direct economic consequences. Robot manipulation costs break into three layers: hardware (grippers, arms, sensors), software (the model and inference stack), and operational labor. REKI's efficiency addresses the software layer by eliminating the need for dedicated high-end GPU infrastructure. A 2.4B parameter model can run on more modest hardware than a 4.7B model, reducing the capital investment required to deploy robots in warehouses, factories, and distribution centers.
That cost reduction matters because robot manipulation has struggled to penetrate labor-intensive tasks not due to capability gaps—modern models can often solve defined picking or sorting problems—but because the compute cost per task did not justify replacing human workers in many contexts. Cheaper manipulation stacks compress that economics further. When manipulation becomes computationally cheaper to run than to staff, employers face lower barriers to substitution. The consequence extends to labor markets: tasks that have resisted automation because of software cost, not technical difficulty, become automation candidates. This shift will likely accelerate adoption in high-volume, repetitive tasks first—order fulfillment, parts sorting, assembly line support—where the cost per unit manipulated is measured in cents and where even modest reductions in software overhead can tip the business case toward automation.
The fact that REKI achieves top-tier performance on public benchmarks using only public training data also signals a shift in the robotics field. Earlier VLA models often benefited from proprietary robot datasets or synthetic data pipelines available only to well-funded organizations. REKI's success suggests that the frontier of efficient manipulation may not require privileged access to unique data, but rather smart architectural choices and training discipline. That democratization could accelerate research and broaden who can build and deploy capable manipulation systems.
Performance Gains from Pretraining and Memory
Decomposing REKI's performance into components reveals the leverage of different design choices. Pretraining contributes most to out-of-distribution robustness, adding 13.8 percentage points on Clean2Rand and 30.3 points under clutter conditions. Memory adds more modest but consistent gains: 1.5 points on LIBERO-Plus and 5.4 points on RoboCasa365. That distribution suggests that breadth of pretraining data matters more than architectural sophistication for achieving competence across diverse scenarios. However, memory prevents specific failure modes like pose oscillation, making it valuable for reliability even if it does not move benchmark needle uniformly.
The engineering discipline in REKI—choosing where to add complexity and where to stay simple—reflects maturation in the field. Efficient models that perform well are no longer novel; the question now is which efficiency tradeoffs preserve capability. REKI's answer: invest in data breadth and targeted memory for perceptual aliasing, but keep the backbone lean.
Sources
- MarkTechPost: Meet Kyutai REKI: The 2.4B VLA Model Bringing Efficient Memory to Robot Manipulation
- IEEE Spectrum: Learning to Play Like a Pro: Adaptive Motion Planning and Tracking for Humanoid Robots
- Financial Times: Robot dolls, chip shortages and Apple's soft sales
- 404 Media: There's Nothing Mysterious or Unusual About the Viral German Sexual Harassment Robot
- MachineHours Encyclopedia: Robotic Manipulation — The Dexterity Frontier and What Human-Level Means
Frequently Asked Questions
What is Kyutai's REKI model?
REKI is a 2.4 billion parameter vision-language-action model from Kyutai designed to give robots efficient memory for manipulation tasks while using less compute than larger comparable models, according to MarkTechPost.
Why does a smaller VLA model matter for robotics?
Smaller models like REKI can lower the hardware and compute costs of deploying manipulation robots, making automation of tasks like picking and sorting more economically viable for employers.
What did the Financial Times report about robot supply chains?
The FT reported that chip shortages are contributing to softer sales forecasts for consumer robotics and toy manufacturing, alongside weaker Apple device sales, heading into the holiday season.
What was the German robot incident covered by 404 Media?
404 Media reported on a viral incident involving a robot in Germany, arguing the security and behavioral flaws behind it are common among poorly secured robots rather than unusual or new.
Get MachineHours in your inbox
AI compute and the machine economy in your inbox.
