Teleoperation on local network
How to control your robot arm using a Meta Quest 3 over a local WiFi network
Move in real time. Record datasets. Start training AI models.
Prerequisites
- You need an assembled SO-100 robot arm. Get the phosphot starter pack here.
- Install the phosphobot software on your computer.
- Connect robots to your computer. Start the phosphobot server.
- Complete the quickstart and check that you can control your robot.
- The phosphobot teleoperation app is installed on your Meta Quest 2, Pro, 3 or 3s.
- If you bought the starter pack, you should have received a link to download the app. Please reach out if not.
- If you didn’t buy our products, we still can provide access to the app for a reasonable fee to cover our development costs. Reach out to the phospho team on Discord to get access.
Step by step guide
Connect to the dev kit through WiFi in the phospho teleoperation Meta Quest app.
- Open the application. You should see a screen displaying phosphobot along with the server ping. Click the Connect button using the
Trigger Button
.
-
After connecting, you should see the main camera feed if a camera is connected. Move the windows with the
Grip button
to organize your space. -
Press
A
once to start teleoperation and begin moving your controller.- The robot will naturally follow the movement of your controller. Press the
Trigger button
to close the gripper. - Press
A
again to stop the teleoperation. The robot will stop.
- The robot will naturally follow the movement of your controller. Press the
-
Press
B
to start recording. You can leave the default settings for your first attempt.- Press
B
again to stop the recording. - Press
Y
(left controller) to discard the recording.
- Press
-
Continue teleoperating and stop the recording when you’re done.
-
The recording is automatically saved in LeRobot format and uploaded to your HuggingFace account. Check it in your profile.
Examples
The phospho Meta Quest app lets you operate the robot arm in real time. With the built-in stereo camera system, you can see the robot’s environment in 3D, allowing you to interact as if you were physically present.
What’s next?
Use your recorded datasets to train AI models.
Train your first AI model
Follow this guide to teleoperate the robot arm and train your first AI model.
Was this page helpful?