RL environments and open evals for agentic commerce; CandyBench is their robot candy-handout eval
The Hook
“(No spoken dialogue — upbeat electronic backing track)”
Problem Agitation
“So we have a lot of people and zero functioning robots.”
Product Reveal
“The kids need to say trick or treat really, really loud. Trick or treat. Yay! Happy Halloween! And we've got a camera hooked up that is monitoring and looking at all of the robots and finding out which robot is able to trick or treat. Dude, it's a party in here. This is going to be the place that every kid in school is talking about for the rest of the year.”
Feature Teaser
“What's going on right now? We're trying to make the robots wave and dance. What's the biggest blocker? The biggest blocker? The Wi-Fi connection. Troubleshooting sessions, now we have all the robots operationally. Who ended up moving the router? I heard this is a hot topic. This is Raffi, who has moved the router for us. We're eternally grateful for Raffi.”
Feature Teaser
“It's total madness. There are so many kids and so many robots, we're trying to measure how well the robots are at handing out candy. I mean, alone, I think I'm at 250, is my guess. 250 in how long? In an hour? Yeah, the night is young. We've got lots to go. I am Gruuu! Hold your hands out. Both hands. Say trick or treat.”
Problem Agitation
“We've had a couple robots burn out. You know, it's a big night for them. They're working really hard, and sometimes it's just a lot of pressure. This one's sleeping right now. This one's having a little nap. How did they all get here? Do you know how that happened? I don't know, man. Are you teleoping back there, though? I just don't think God wanted this. I don't think God wanted us to, robots to be handing out candy. No, it's an atrocity.”
Call to Action
“I'm so grateful to be here tonight. I think this is a magical event. I've seen lots of spark come from children who get to see the robot happen, and lots of parents filming events, so you know that they're interested too. So I'm so grateful for the team that we put together tonight. Things came together. We've had some, you know, robots fall apart, but they're coming back up. We're together stronger.”
Synthesizable in Remotion · key components of the field-test-docu-vlog template.
Renders vector bounding boxes over detected hands and robot end-effectors with labels and frame telemetry.
Use absolute positioned divs driven by tracking coordinates; interpolate border width and text tags with spring animations.
Surrounds headline text with design tool transform handles and corner anchor points that animate in sequence.
Wrap headline in a relative container; calculate child dimensions via measureText; absolute-position SVG resize handles at corner offsets.
Purpose. Hook viewers with extreme scope contrasted immediately by critical technical failure.
Execution. Bold animated text cutting directly into crowded street and dead robots.
Purpose. Showcase live debugging, Wi-Fi fixes, and multi-robot teleoperation.
Execution. Rapid run-and-gun footage of laptops, routers, and VR headsets on the porch.
Purpose. Validate the effort with actual throughput data, happy trick-or-treaters, and celebratory reflections.
Execution. Computer vision annotation overlays mixed with confetti and warm porch interviews.