Teleoperation on local network
How to control your robot arm using a Meta Quest 3 over a local WiFi network
Move in real time. Record datasets. Start training AI models.
Prerequisites
Connect to the junior dev kit through WiFi in the phospho Meta Quest app.
- Open the application. You should see a screen displaying phosphobot along with the server ping. Click the Connect button using the
Trigger Button
.
-
After connecting, you should see the main camera feed if a camera is connected. Move the windows with the
Grip button
to organize your space. -
Press
A
once to start teleoperation and begin moving your controller.- The robot will naturally follow the movement of your controller. Press the
Trigger button
to close the gripper. - Press
A
again to stop the teleoperation. The robot will stop.
- The robot will naturally follow the movement of your controller. Press the
-
Press
B
to start recording. You can leave the default settings for your first attempt.- Press
B
again to stop the recording. - Press
Y
(left controller) to discard the recording.
- Press
-
Continue teleoperating and stop the recording when you’re done.
-
The recording is automatically saved in LeRobot format and uploaded to your HuggingFace account. Check it in your profile.
Chess
The phospho Meta Quest app lets you operate the robot arm in real time. With the built-in stereo camera system, you can see the robot’s environment in 3D, allowing you to interact as if you were physically present.
What’s next?
Use your recorded datasets to train AI models.
Train your first AI model
Follow this guide to teleoperate the robot arm and train your first AI model.
Was this page helpful?