Examples#
Examples ordered as a learning path β from the end-to-end quickstart to
the release gate and real robots. Install per
Installation; the Needs column
names the uv sync --extra β¦ set, plus any credential or hardware.
Time is steady-state wall-clock: the first run of a session
additionally pays one-time costs β cold vision-model loads, and for
CuRobo examples a one-time CUDA-kernel JIT (~40 s) β so expect minutes
before the quoted per-trial rate kicks in.
All examples live under examples/ in the engine repo, each with a README and runnable code.
Start here#
Zero to a verified rollout.
Example |
What it shows |
Needs |
Time |
|---|---|---|---|
The end-to-end hero: DINO + SAM3 + VLM perception β OBB grasp β transport, verified against sim ground truth |
|
~25β55 s/trial |
|
A static graph with a real backward edge: perceive β grasp β transport, looped until every item is in the basket, with unprivileged VLM termination |
|
~min/item |
Benchmarks & evaluation#
The configs that gate releases.
Example |
What it shows |
Needs |
Time |
|---|---|---|---|
The flagship acceptance family: graphs LLM-generated per task, nothing hand-written |
|
minutes (smoke) |
|
Grid harness configs: 1-cell smoke β position-variance (posvar) grid β the release gate ( |
|
minutes β hours |
Learned policies#
Graphs and policies are complements: graphs steer, collect for, and verify learned policies.
Example |
What it shows |
Needs |
Time |
|---|---|---|---|
Hybrid graphs: perceive + hover above the target, then hand control to a VLA (vision-language-action) policy |
|
~min/trial |
|
Graph as scripted expert β HDF5/LeRobot dataset β train externally β policy back in a graph |
|
collection: s/episode |
Real robots#
These move hardware. Read Safety before anything else.
Example |
What it shows |
Needs |
Time |
|---|---|---|---|
Perception-only UR + ZED connector β motion structurally impossible (read-only RTDE) |
|
seconds |
|
Franka + Robotiq pick-place loop via the robots_realtime bridge |
|
s/cycle |