The easiest way to record datasets is to use the phospho Meta Quest app to control your robot arm.

Recorded datasets are saved in the lerobot_v2 format from LeRobot and uploaded to your HuggingFace account.

Use the Start Recording Episode and Stop Recording Episode endpoints to start and stop recording episodes.

Alternatively, you can implement your own dataset recording logic on top of the phospshobot API.

Prerequisites

Make sure you have already managed to teleoperate your robot

In the phosphobot dashboard, add your HuggingFace token if you haven’t already. You can find it in your HuggingFace account settings.

Connect your arm to the the computer that will be running the phosphobot server using a cable.

Connect any additional cameras to the computer. phospshobot will look for all cameras connected to the computer, including the built-in cameras such as the webcam.

Once everything is connected and powered on, run the following command to start the phosphobot server:

phosphobot run

If you change the connected cameras or robot arm, you have to restart the server.

Set your dataset name and parameters

Go to the Admin Page of your phospshobot dashboard. In the User settings, you can set the dataset name and parameters for the next recording.

Record a dataset

Connect to the junior dev kit through WiFi in the phospho Meta Quest app.

  1. In the Meta Quest, open the phospho teleop application. You should see a screen displaying phosphobot along with the server ping. Click the Connect button using the Trigger Button.

Make sure you’re connected to the same WiFi as the control module. To control the robot over the internet, see the teleoperation from anywhere in the world guide.

  1. After connecting, you should see the main camera feed if a camera is connected. Move the windows with the Grip button to organize your space.

  2. Press A once to start teleoperation and begin moving your controller.

    • The robot will naturally follow the movement of your controller. Press the Trigger button to close the gripper.
    • Press A again to stop the teleoperation. The robot will stop.
  3. Press B to start recording. You can leave the default settings for your first attempt.

    • Press B again to stop the recording.
    • Press Y (left controller) to discard the recording.
  4. Continue teleoperating and stop the recording when you’re done.

  5. The recording is automatically saved in LeRobot format and uploaded to your HuggingFace account.

Check your dataset

Datasets are saved on the computer running the phosphobot server at ~/phosphobot/recordings/DATASET_NAME folder in the phosphobot directory. You can check all the recordings through the phosphobot dashboard in the File Browser.

If you added your HuggingFace token in the dashboard, the recorded datasets are automatically uploaded to your HuggingFace account. Go to your HuggingFace profile to see the uploaded datasets.

Visualize your dataset

Once your dataset is uplaoded to HuggingFace, you can visualize it using the LeRobot Dataset Visualizer.

What’s next

Train an AI model

How to train an AI model from a dataset you recorded