Cameras in Robotics

Most robotics models rely on data from one or more cameras to make decisions. The images, along with additional information such as joint positions, are fed into the model during both training and inference.

Generic Cameras

Most cameras pluged to the phosphobot server can be used for recording. We use the powerful OpenCV library to detected them automatically. By default all available cameras are used for recording.

OpenCV

Check the OpenCV project

Stereo Cameras

Stereo Cameras are made of two lenses that capture two images of the same scene from slightly different angles. The shift between the two images is used to calculate the depth of the scene. The greater the shift, the closer the object is to the camera.

Depth from Stereo Images

Learn how to compute a depth map from stereo images

Realsense Cameras

The phospho dev kit also supports the integration of Intel RealSense cameras. We use python bindings of Intel Realsense SDK 2.0 to interact with this type of camera.

Realsense depth cameras can directly return a depth map in addition to the color image.

Intel Realsense

Check the available Intel RealSense cameras here

Phosphobot

Every camera runs on its own thread. We create mp4 videos with OpenCV from the captured RGB frames. The number of FPS (frames per second), the mp4 codec as well as the video resolution can be configured for recording.

Anybody can contribute to add new types of cameras to the phospho dev kits by creating a new camera class inheriting from BaseCamera.

Contribute

Join the community and build new cameras for the phospho dev kits.