Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
88 commits
Select commit Hold shift + click to select a range
fe7a7de
spec: openspec init
TomCC7 Jun 4, 2026
76158b2
chore: revert change to doc folder
TomCC7 Jun 8, 2026
35c8b14
Merge branch 'main' into cc/feat/openspec
TomCC7 Jun 8, 2026
12d4346
Merge branch 'main' into cc/feat/openspec
TomCC7 Jun 10, 2026
6cd2fd3
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jun 12, 2026
45f7f73
Merge branch 'main' into cc/feat/openspec
TomCC7 Jun 15, 2026
86a600d
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jun 18, 2026
43fd853
Merge branch 'main' into cc/feat/openspec
TomCC7 Jun 20, 2026
8394a61
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jun 20, 2026
bae46c4
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jun 23, 2026
4cf815e
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jun 30, 2026
2c80dab
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jul 7, 2026
bc381cb
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jul 11, 2026
3a976da
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jul 14, 2026
4e25297
add mattskill
TomCC7 Jul 20, 2026
11f0d7f
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jul 23, 2026
9ffcd58
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jul 23, 2026
f873ddf
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jul 24, 2026
e87e93e
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jul 27, 2026
e689348
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jul 28, 2026
794e585
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Jul 29, 2026
cfa3e3a
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Aug 1, 2026
d221a4f
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Aug 4, 2026
df82a32
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Aug 5, 2026
9cac56d
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Aug 8, 2026
1d2b2d2
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Aug 11, 2026
8d84764
feat(g1): SONIC whole-body controller as a coordinator task
Nabla7 Aug 19, 2026
61daff9
fix(g1-sonic): full blueprint verified in sim; nav stack restored
Nabla7 Aug 19, 2026
7a192fb
feat(g1-sonic): rerun robot visualization config
Nabla7 Aug 19, 2026
c00e112
feat(g1-sonic): full ZMQ wire parity (Phase 4)
Nabla7 Aug 19, 2026
e52c5a7
feat(g1-sonic): motion-clip RPCs + models and clips in LFS
Nabla7 Aug 19, 2026
f454e4f
fix(g1-sonic): drop __init__.py — dimos task dirs are namespace packages
Nabla7 Aug 19, 2026
0d6b96b
feat(g1-sonic): VR 3-point teleop (encoder mode 1)
Nabla7 Aug 20, 2026
9b0cb4c
feat(g1-sonic): SONIC v1.1 checkpoint + PICO SMPL teleop wire parity
Nabla7 Aug 22, 2026
87f3513
refactor(g1-sonic): single-checkpoint build - v1.1 only
Nabla7 Aug 22, 2026
7d8986e
fix(g1-sonic): declare set_velocity_command; route blueprint validati…
Nabla7 Aug 22, 2026
7661c40
Merge origin/main into pim/feat/g1-sonic-wbc
Nabla7 Aug 24, 2026
779e42c
Merge branch 'main' into pim/feat/g1-sonic-wbc
Nabla7 Aug 24, 2026
a94e8b5
feat(g1-sonic): staged floor transitions + per-mode planner params
Nabla7 Aug 24, 2026
f8966dd
Merge remote-tracking branch 'origin/pim/feat/g1-sonic-wbc' into pim/…
Nabla7 Aug 24, 2026
631cd78
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Aug 25, 2026
2dc5633
feat(g1): stiffness soft-start in the whole-body connection
mustafab0 Aug 20, 2026
82d4c70
fix(control): hold the measured pose at servo startup and after preem…
mustafab0 Aug 20, 2026
6899f19
fix(control): keep unmeasured preempted joints pending on handoff
mustafab0 Aug 21, 2026
3b4a27b
fix(g1): reject a non-finite soft-start duration
mustafab0 Aug 21, 2026
83cd4a9
refactor(control): reuse trajectory task for joint servo
TomCC7 Aug 21, 2026
e3a8a21
revert(control): restore original trajectory streaming design
TomCC7 Aug 22, 2026
75534a0
[autofix.ci] apply automated fixes
autofix-ci[bot] Aug 22, 2026
51bb526
fix(control): wait for whole-body feedback before commands
TomCC7 Aug 25, 2026
d493317
fix(g1): hold arm positions between trajectories
TomCC7 Aug 25, 2026
2719158
[autofix.ci] apply automated fixes
autofix-ci[bot] Aug 25, 2026
910e90d
fix(control): restore contracts lost during stack rebase
TomCC7 Aug 25, 2026
e1c67b2
feat(g1): add Quest dual-arm teleoperation
TomCC7 Aug 14, 2026
1d0dc6f
fix(g1): adapt Quest teleop to trajectory-task base
TomCC7 Aug 25, 2026
f6a799e
fix(teleop): align rebased blueprint config APIs
TomCC7 Aug 25, 2026
cbcac63
fix(teleop): preserve joystick validity contract
TomCC7 Aug 25, 2026
9a2310d
fix(sim): restore G1 whole-body adapter contract
TomCC7 Aug 25, 2026
9abbf56
Add safe G1 upper-body manipulation workflow
TomCC7 Aug 26, 2026
1bd969d
fix: camera tf
TomCC7 Aug 26, 2026
456eeb7
feat(g1): expose manipulation visualizer
TomCC7 Aug 26, 2026
e6e7455
fix(g1): configure manipulation execution target
TomCC7 Aug 26, 2026
92e0daf
fix(g1): repair stacked PR CI contracts
TomCC7 Aug 26, 2026
11c8312
feat(g1): add guided activation command
TomCC7 Aug 26, 2026
d745984
refactor(g1): trim teleop runtime stack
TomCC7 Aug 26, 2026
388af20
spec: remove
TomCC7 Aug 26, 2026
7392232
fix(g1): address teleop review feedback
TomCC7 Aug 26, 2026
6bfa61f
refactor(teleop): rename Quest integration to WebXR
TomCC7 Aug 25, 2026
fdf8a9f
docs(teleop): preserve Pico WebXR tracking handoff
TomCC7 Aug 26, 2026
fd6dab7
spec: remove
TomCC7 Aug 26, 2026
540f88d
Delete docs/research/pico-webxr-body-tracking.md
TomCC7 Aug 26, 2026
a26ae78
refactor(teleop): finish WebXR naming cleanup
TomCC7 Aug 26, 2026
f14fc67
spec: remove
TomCC7 Aug 26, 2026
80a7d98
feat(teleop): add PICO WebXR body tracking
TomCC7 Aug 26, 2026
3d49b9a
Delete docs/research/pico-webxr-body-tracking.md
TomCC7 Aug 26, 2026
6580b8b
fix(teleop): accept PICO controller button layout
TomCC7 Aug 26, 2026
7fc9bd1
fix(webxr): simplify PICO input handling
TomCC7 Aug 26, 2026
6bcf67d
test(webxr): cover mixed message dispatch
TomCC7 Aug 26, 2026
82d7bc6
fix(webxr): reject short controller packets
TomCC7 Aug 26, 2026
838ca1e
fix(g1): address remaining teleop review feedback
TomCC7 Aug 26, 2026
635174e
fix(teleop): keep Quest pose stream controller-only
TomCC7 Aug 26, 2026
91fda14
test(webxr): isolate body monitor timing
TomCC7 Aug 26, 2026
6c91654
fix(manipulation): constrain locked IK joints in QP
TomCC7 Aug 27, 2026
becb567
Merge remote-tracking branch 'origin/main' into cc/feat/openspec
TomCC7 Aug 27, 2026
a56d925
Merge branch 'pim/feat/g1-quest-teleop-stacked' into cc/feat/pico-tel…
TomCC7 Aug 27, 2026
a027f70
Merge branch 'cc/feat/pico-bodypose' into cc/feat/pico-teleop-sonic
TomCC7 Aug 27, 2026
3dc5f95
Merge remote-tracking branch 'origin/pim/feat/g1-sonic-wbc' into cc/f…
TomCC7 Aug 27, 2026
c9774ee
feat(g1): add PICO SONIC WebXR teleoperation
TomCC7 Aug 27, 2026
61f59a6
fix(g1): align SONIC hardware lifecycle
TomCC7 Aug 27, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion AGENTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ dimos restart # stop + re-run with same original args
| `xarm-perception-agent` | xArm | real | gpt-5.6-luna | ✓ | Manipulation + perception + agent |
| `xarm-perception-sim-agent` | xArm | sim | gpt-5.6-luna | ✓ | Manipulation + perception + agent, sim |
| `xarm7-planner-coordinator` | xArm7 | real | — | — | Trajectory planner coordinator |
| `teleop-quest-xarm7` | xArm7 | real | — | — | Quest VR teleop |
| `teleop-webxr-xarm7` | xArm7 | real | — | — | WebXR teleop |
| `dual-xarm6-planner-coordinator` | xArm6×2 | mock | — | — | Dual-arm motion planner |

Run `dimos list` for the full list.
Expand Down
66 changes: 33 additions & 33 deletions CONTEXT.md
Original file line number Diff line number Diff line change
@@ -1,45 +1,45 @@
# DimOS Robotics
# Teleoperation

Canonical language for robot capabilities and operator interaction in DimOS.
This context defines the operator-tracking language used when human motion guides a robot through dimOS.

## Teleoperation
## Language

**Quest arm teleoperation**:
Arm teleoperation in which tracked Quest controllers provide clutched, relative Cartesian pose commands and gripper input.
_Avoid_: Keyboard teleoperation, leader-follower teleoperation
**Full-body SONIC teleoperation**:
An operating mode in which tracked motion of the operator's legs, pelvis, torso, arms, wrists, and head guides the G1 through SONIC. Articulated fingers are excluded.
_Avoid_: Full-body tracking, three-point teleoperation

**Operator hand**:
The left or right Quest controller as a source of teleoperation intent, independent of the robot arm it controls.
_Avoid_: Hand, side
**WebXR body snapshot**:
A set of named operator-joint poses observed together in one WebXR reference space.
_Avoid_: SMPL frame, SONIC pose

**Mixed-arm setup**:
Two independent manipulators teleoperated through separate control tasks, even when presented in one operator session.
_Avoid_: Bimanual robot, dual-arm robot
**Native-equivalent SONIC pose**:
An operator pose whose meaning matches the native SONIC PICO input, independently of the transport used to deliver it.
_Avoid_: Partial SONIC pose, policy-minimal pose

**Bimanual robot**:
One coupled robot with two manipulator groups represented by a single kinematic model and controlled by one bimanual task.
_Avoid_: Mixed-arm setup
**SONIC retargeting**:
The dimOS-owned interpretation of a WebXR body snapshot as a native-equivalent SONIC pose.
_Avoid_: Packet packing, vendor conversion

**Bimanual engagement**:
A two-hand deadman condition in which a bimanual teleoperation task is active only while both operator hands are engaged; releasing either hand disengages the whole task.
_Avoid_: Partial engagement, independent hand engagement
**Motion Tracker calibration**:
The PICO-managed process that establishes the operator skeleton and tracker relationship before a WebXR session.
_Avoid_: Teleoperation alignment

## Joint-limit safety
**Teleoperation alignment**:
The per-engagement association between a complete operator skeleton and the G1 heading. It does not reshape or rescale the operator.
_Avoid_: Calibration, body normalization

**Feedback limit tolerance**:
The bounded discrepancy beyond a nominal joint limit that is accepted only when interpreting measured hardware state.
_Avoid_: Command tolerance, expanded joint limit
**Full-body engagement**:
The interval while the operator holds the WebXR deadman control and fresh, complete body poses guide SONIC. Ending engagement returns SONIC to planner control without disarming the policy.
_Avoid_: Policy arming, robot activation

**Command limit margin**:
The inward distance from each nominal joint limit within which generated position commands must remain.
_Avoid_: Feedback tolerance, relaxed joint limit
**Complete operator pose**:
A WebXR body snapshot containing every joint required to produce one native-equivalent SONIC pose. Partial snapshots do not advance the robot target.
_Avoid_: Best-effort pose, partial target

## Inverse kinematics
**Operator motion source**:
The engaged operator pose as SONIC's sole whole-body motion reference. Planner locomotion resumes after full-body engagement ends.
_Avoid_: Hybrid locomotion, simultaneous planner control

**Pink task stack**:
The ordered, named set of kinematic objectives used by Pink to produce a robot command. Its structure is composed once per IK control context; reserved frame objectives ensure every commanded end effector participates, while subclasses may compose or replace named auxiliary objectives.
_Avoid_: Teleoperation behavior, solver implementation

**IK control context**:
The persistent inverse-kinematics state owned by one control-task instance for one robot model, controlled-joint selection, and target-frame selection, including its Pink task stack. Stateful Pink tasks are never shared between control-task instances.
_Avoid_: Planning group, teleoperation session
**Live PICO simulation test**:
An acceptance session in which a physical PICO and Motion Trackers guide the MuJoCo G1 through the production WebXR path.
_Avoid_: Synthetic replay, converter smoke test
3 changes: 3 additions & 0 deletions data/.lfs/sonic.tar.gz
Git LFS file not shown
Loading
Loading