❌

Normal view

Video Friday: Heavy Robotic Machinery Operates Itself

15 May 2026 at 17:00


Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.

ICRA 2026: 1–5 June 2026, VIENNA
RSS 2026: 13–17 July 2026, SYDNEY
Summer School on Multi-Robot Systems: 29 July–4 August 2026, PRAGUE
Actuate 2026: 18–19 August 2026, SAN FRANCISCO

Enjoy today’s videos!

Bulk material handling is a critical, labor-intensive operation across various industries, traditionally performed by human operators using heavy hydraulic manipulators equipped with free-swinging, underactuated grippers. This work presents the first complete autonomous material-handling solution deployed on a real-world 40-ton material handler.

[ ETH Zurich ]

I don’t want to minimize this bedroom tidying by Figure (although I suppose I’m going to), but in the context of doing a task like this in place of a human, it really illustrates what these robots are comfortable with, and what they’re not.

[ Figure ]

Give me this over videos of robots doing backflips any day.

[ Hello Robot ]

Okay, but can it get them out of the can?

[ Generalist ]

The world’s first production-ready manned mecha. It can transform. It’s a civilian vehicle. It weighs ~500 kilograms with you inside.

[ Unitree ]

Curious about what happens when street dance meets embodied AI? From smooth choreography to dynamic flips, NIX is exploring movement, rhythm, and real-world interaction through embodied AI. We’ll make NIX available—FOR FREE!—to selected partners from global universities, robotics labs, and creative technologists.

[ Lumos ]

Thanks, Ni Tao!

We introduce and open-source the Unified Autonomy Stack, a novel solution for resilient autonomy across aerial and ground robot morphologies. The architecture combines multimodal perception, multibehavior planning, and multilayered safe navigation to deliver mission-level autonomy across diverse robot morphologies. It fuses lidar, radar, vision, and inertial sensing to enable robust localization and mapping, vision-language-based scene reasoning, multibehavior planning, and layered safety through map-based avoidance, deep learned policies, and control barrier functions. The system supports Global Navigation Satellite System–denied navigation in perceptually degraded environments, exploration, object discovery, and inspection, and has been validated on multirotor and legged robots in challenging settings, demonstrating resilient performance.

[ NTNU ]

Thanks, Kostas!

Cassie WAS the best robot!

The next video better be a Digit Centaur.

[ Agility ]

Any robot doing anything consistently over a long period of time is impressive. Having said that, you want to be very careful about claiming that any robot operates at “human performance levels,” especially in a somewhat complex manipulation task, because humans are very, very good at stuff like this.

[ Figure ]

Robust.AI cofounder and CTO Rodney Brooks, ranked #44 on the Forbes 250 America’s Greatest Innovators list, sits down for a Q&A ahead of his panel discussion at the Forbes America Innovates event in San Francisco. We asked him two questions: What makes innovation in robotics such a challenge? What does the current surge in AI mean for robotics today?

[ Robust AI ]

This is one of the best robotic research videos I’ve ever seen—and don’t worry, according to the credits it’s not AI. And make sure to watch after the credits!

[ Nature ]

EFGCL is a guided-reinforcement learning method that efficiently enables highly dynamic motions through the use of assistive forces. In this work, we successfully achieved several dynamic motions, including jumping, backflips, and lateral flips.

[ EFGCL ]

Thanks, Keita!

Legged robots: helping farmers one vegetable at a time.

[ University of Southern California ]

Humanoid robots promise general-purpose assistance, yet real-world humanoid loco-manipulation remains challenging because it requires whole-body stability, dexterous hands, and contact-aware perception under frequent contact changes. In this work, we study dexterous, contact-rich humanoid loco-manipulation.

[ Touch Dreaming ]

More than just technology, KATA Friends is a lifelike AI companion designed to see your world, feel your touch, and understand your heart. With expressive movements, evolving emotions, and natural conversations, Noa and Niko both grow alongside you to become a presence uniquely yours. From curious head tilts and playful reactions to ever-changing eye expressions and a soft, innocent voice, every interaction feels warm, personal, and alive.

[ SwitchBot ]

I really hate to say this, but despite how cute it is, Aibo may be showing its age.

[ Aibo ]

One of the biggest challenges in robotics right now isn’t the hardware. It’s data. While many data-collection methods are effective, handheld data collection can create a diverse dataset of environments, conditions, and strategies for completing manipulation tasks. The Koala platform codesigned the handheld grippers and robot grippers around the same linkage mechanism, the same degrees of freedom, and the same force transmission. The human feels through the linkages what the robot will feel through its actuators.

[ Robotics and AI Institute ]

Making LLMs faster without sacrificing accuracy

15 May 2026 at 13:00
Large language models (LLMs) keep getting bigger and better. But the cost of running them — generating text, answering questions, powering real-time applications — is scaling up, too. Obviously, model accuracy is important, but for real-time AI-based web applications, it can’t come at the expense of efficiency. In a paper we presented at the International Conference on Learning Representations (ICLR), we provide a framework for navigating this accuracy-versus-efficiency tradeoff, by connecting scaling laws directly to architectural-design decisions. The gap in current scaling laws In 2022, Google DeepMind announced the results of a study involving an experimental LLM called Chinchilla. The DeepMind researchers demonstrated a scaling law that enabled joint optimization of model size and training data to achieve a desired loss level, given a particular computational budget. More precisely, the law relates the model loss (L) to the number of model parameters (N) and the number of tokens in the training dataset: The other variables in this equation — E, A, B, α, and β — are all learnable coefficients. The DeepMind researchers did extensive experimentation to tune those coefficients. This "Chinchilla law" doesn't specify architectural choices, such as the size of the model's internal representations — the "hidden size" — or the relative number of parameters allocated to attention layers and multilayer perceptron (MLP) layers. However, two models, each with the same billion-parameter count, trained on the same data, with the same accuracy, can differ by up to 40% in inference-time throughput, depending on additional architectural choices. We set out to deduce scaling laws that can help predict those choices. The Transformer architecture The Transformer architecture — which lies at the heart of all LLMs — consists largely of stacked attention and MLP blocks. Attention blocks determine how much weight to give each prior token (word or word part) when updating the current token's representation; MLP blocks transform that representation further and are where much of the model's learned knowledge is stored. A separate output layer at the end of the stack converts the final representation into a probability distribution over the next token. The attention mechanism uses three matrices, with names borrowed from information retrieval: the query matrix encodes what each token is looking for in the rest of the sequence; the key matrix encodes what each token has to offer; and the value matrix holds the content each token can contribute when it's attended to. Comparing queries against keys tells the model how relevant each token is to each other token. Most LLMs use multihead attention: several attention computations run in parallel, each with its own query, key, and value projections. Different heads tend to specialize in different aspects of the input, letting the model capture a richer set of relationships than a single head would. Our approach: Architecture as a first-class variable In our ICLR paper, we introduce a scaling law that augments the Chinchilla framework with three architectural factors: the hidden size (the dimension of the vectors that flow through the embedding, attention, and MLP blocks); the ratio of the number of MLP parameters to the number of attention parameters; and grouped-query attention (GQA), in which groups of attention heads, while preserving distinct query matrices, share key and value matrices. Each factor has a direct impact on inference throughput: Hidden size (d_model): Under a fixed parameter budget, larger hidden sizes reduce total inference FLOPs and shrink the key-value cache, improving throughput. MLP-to-attention ratio (r_mlp/attn): A higher ratio allocates more parameters to the MLP and fewer to attention, shrinking the key-value cache and reducing memory-bandwidth bottlenecks. Grouped-query attention (GQA): Compressing key-value heads further cuts input/output costs during generation. Adjusting these factors purely for higher throughput comes at a cost of accuracy. Both hidden size and MLP-to-attention ratio exhibit U-shaped loss curves: there is an optimal point for each, and pushing too far in either direction has a negative effect on model accuracy. GQA has a more erratic effect on loss, so we treat it as a discrete hyperparameter tuned through local search. We deduce our scaling law in two stages. First, we fit the standard Chinchilla law to the model under investigation, calculating values for the coefficients E, A, B, α, and β. This establishes an optimal reference loss. Then we calibrate how each architectural choice — differences in the three factors we consider — affects that loss. Effectively, we learn a correction surface over the design space. Because the effects of hidden size and MLP-to-attention ratio on loss turn out to be separable, each factor can be optimized independently. Two model families: Panda and Surefire This scaling law enabled us to develop a search framework that identifies Pareto-optimal architectures for any given accuracy target. The result of that search was two model families: Panda (which maximizes accuracy) and Surefire (which is Pareto optimal on the accuracy–efficiency frontier). To validate the framework and identify our families of optimal models, we trained more than 200 models with varying architectures (80 million to three billion parameters, eight billion to 100 billion tokens). The results of our experiments are below (throughput measured on H200 GPU with batchsize-128-4096-input-1024-output tokens): Modeld_modelGQAr_mlp/attnLossAvg. accuracyThroughput vs. LLaMA-3.2-vLLMThroughput vs. LLaMA-3.2-SGLangLLaMA-3.2-1B204844.802.80354.9%baselinebaselinePanda-1B256041.072.78257.0%-33%-Surefire-1B256093.602.80455.4%+21%+47%LLaMA-3.2-3B307234.802.62561.9%baselinebaselinePanda-3B409631.002.61962.5%-23%-Surefire-3B409671.002.62062.6%+12%+17% The billion-parameter Panda model gains 2.1% over LLaMA-3.2-1B, and the three-billion parameter model gains 0.6% over LLaMA-3.2-3B — at the cost of lower throughput. Surefire models match or exceed LLaMA-3.2 accuracy while improving throughput by 12-47%, with gains reaching up to 42% on A100 (vLLM) and 47% on H200 (SGLang) under different model size and batch size configurations. Key takeaways Architecture is not an afterthought. The optimal MLP-to-attention ratio of LLaMA-3.2-style models is around 1.0, far lower than that of existing open-weight versions (e.g., 4.8 for LLaMA-3.2-1B). Current models overallocate to MLP layers. The right configurations of hidden size, MLP-to-attention ratio, and GQA configuration can unlock large efficiency gains with no accuracy cost. Small-scale experiments predict large-scale outcomes. The conditional scaling law, calibrated on models with as few as 80 million to 297 million parameters, reliably predicts the best architecture at one billion and three billion parameters, enabling low-cost exploration before expensive full-scale training. The framework generalizes across hardware and serving systems. Efficiency gains are consistent across A100/H200 GPUs and vLLM/SGLang, making the results directly actionable.
❌