Move in real time. Record datasets. Start training AI models.

Prerequisites

  1. You need an assembled SO-100 robot arm. Get the phosphot starter pack here.
  2. Install the phosphobot software on your computer.
curl -fsSL https://raw.githubusercontent.com/phospho-app/phosphobot/main/install.sh | bash
  1. Connect robots to your computer. Start the phosphobot server.
phosphobot run
  1. Complete the quickstart and check that you can control your robot.
  2. The phosphobot teleoperation app is installed on your Meta Quest 2, Pro, 3 or 3s.
    1. If you bought the starter pack, you should have received a link to download the app. Please reach out if not.
    2. If you didn’t buy our products, we still can provide access to the app for a reasonable fee to cover our development costs. Reach out to the phospho team on Discord to get access.

Step by step guide

Connect to the dev kit through WiFi in the phospho teleoperation Meta Quest app.

The app works with a Meta Quest. Compatible models: Pro, 2, 3, 3s.

  1. Open the application. You should see a screen displaying phosphobot along with the server ping. Click the Connect button using the Trigger Button.
Make sure you’re connected to the same WiFi as the phosphobot server or the control module

  1. After connecting, you should see the main camera feed if a camera is connected. Move the windows with the Grip button to organize your space.

  2. Press A once to start teleoperation and begin moving your controller.

    • The robot will naturally follow the movement of your controller. Press the Trigger button to close the gripper.
    • Press A again to stop the teleoperation. The robot will stop.
  3. Press B to start recording. You can leave the default settings for your first attempt.

    • Press B again to stop the recording.
    • Press Y (left controller) to discard the recording.
  4. Continue teleoperating and stop the recording when you’re done.

  5. The recording is automatically saved in LeRobot format and uploaded to your HuggingFace account. Check it in your profile.

Examples

The phospho Meta Quest app lets you operate the robot arm in real time. With the built-in stereo camera system, you can see the robot’s environment in 3D, allowing you to interact as if you were physically present.

What’s next?

Use your recorded datasets to train AI models.

Train your first AI model

Follow this guide to teleoperate the robot arm and train your first AI model.