# Qualcomm Dragonwing Documentation: QLI 2.1.1 English SDKs ## SDKs ### Robotics SDKs (Linux) #### Robotics SDK(Linux) ##### Blog - [QIR SDK (Linux) Blog](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/blog.md) ##### Overview - [Qualcomm Intelligent Robotics SDK documentation](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/index.md) - [QIR software architecture](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/qir-software-architecture.md) - [Benefits](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/benefits.md) - [Release notes](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/release-notes.md) ##### Get started - [Get started with QIR SDK](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/get-started-with-qir-sdk.md) - [Run the demo application](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/run-demo-application.md) ###### Flash robotics image with QDL - [Download the prebuilt packages](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/download-the-prebuilt-packages.md): This information describes how to download the robotics prebuilt packages. - [Flash the robotics image](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/flash-the-robotics-image.md): Flash the QIR SDK robotics image onto your IQ-series development kit on Ubuntu, Windows, or macOS hosts. - [Set up the environment for running sample applications](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/set-up-env-for-sample-app.md) ##### Sample applications - [QIR SDK sample applications](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/qir-sdk-sample-applications.md) ###### AI samples - [Detect hands with sample_hand_detection](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/detect-hands-with-sample-hand-detection.md) - [Classify images with sample_resnet101](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/classify-images-with-sample-resnet101.md) - [Estimate image depth values with sample-depth-estimation](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/estimate-image-depth-values-with-sample-depth-estimation.md) - [Detect faces with sample_face_detection](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/detect-faces-with-sample-face-detection.md) - [Estimate human poses with sample_hrnet_pose_estimation](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/estimate-human-poses-with-sample-hrnet-pose-estimation.md) - [Detect objects with sample_object_detection](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/detect-objects-with-sample-object-detection.md) - [Segment objects with sample_object_segmentation](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/segment-objects-with-sample-object-segmentation.md) ###### Robotics samples - [Control AMR in the simulator with simulation_sample_amr_simple_motion](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/control-amr-in-the-simulator-with-simulation-sample-amr-simple-motion.md): This sample application demonstrates AMR control in the simulator. - [Enable 2D lidar SLAM with cartographer_ros](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/enable-2-d-lidar-slam-with-cartographer-ros.md) - [Enable AprilTag Pipeline with sample_apriltag](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/enable-april-tag-pipeline-with-sample-apriltag.md) - [Enable pick-and-place in the simulator with simulation_sample_pick_and_place](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/enable-pick-and-place-in-the-simulator-with-simulation-sample-pick-and-place.md) - [Experience remote assistant in the simulator with simulation_remote_assistant](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/experience-remote-assistant-in-the-simulator-with-simulation-remote-assistant.md) - [Enable 2D lidar SLAM in the simulator with cartographer_ros](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/enable-2-d-lidar-slam-in-the-simulator-with-cartographer-ros.md) - [Enable navigation in the simulator with navigation2](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/enable-navigation-in-the-simulator-with-navigation2.md) ###### Platform samples - [Enable Orbbec Gemini 335L with orbbec_camera](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/enable-orbbec-gemini-335-l-with-orbbec-camera.md) - [Enable basic RPLIDAR handling with rplidar-ros2](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/enable-basic-rplidar-handling-with-rplidar-ros2.md) - [Publish system status with qrb_ros_system_monitor](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/publish-system-status-with-qrb-ros-system-monitor.md) - [Run basic OCR with ocr_service](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/run-basic-ocr-with-ocr-service.md) - [Run a zero-copy camera with qrb_ros_camera](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/run-a-zero-copy-camera-with-qrb-ros-camera.md) - [Convert between NV12 and RGB888 with qrb_ros_colorspace_convert](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/convert-between-nv-12-and-rgb-888-with-qrb-ros-colorspace-convert.md) - [Encode and decode video with qrb_ros_video](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/encode-and-decode-video-with-qrb-ros-video.md) - [Enable core audio with qrb_ros_audio_service](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/enable-core-audio-with-qrb-ros-audio-service.md) - [Evaluate performance of ROS2 components with qrb_ros_benchmark](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/evaluating-performance-of-ros-2-components-with-qrb-ros-benchmark.md) - [Execute AI model inference with qrb_ros_nn_inference](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/execute-ai-model-inference-with-qrb-ros-nn-inference.md) ##### Develop applications - [Develop applications using the QIR SDK](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/develop-applications-using-the-qir-sdk.md) - [Develop a sample ROS2 application](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/develop-a-sample-ros-2-application.md) - [Develop a pipeline application](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/develop-a-pipeline-application.md) - [QIR SDK API list](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/explore-the-available-apis.md) ##### Build and customize - [Build and customize the QIR SDK](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/optional-developer-workflows.md) - [Upgrade QIR SDK artifacts](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/upgrade-qir-sdk-artifact.md): This information describes how to upgrade the QIR SDK artifacts without rebuilding the entire QIR SDK. - [Troubleshoot common issues](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/troubleshoot.md) ###### Build the QIR SDK - [Build the QIR SDK](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/build-the-qir-sdk.md) - [Build with GitHub workflow](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/build-with-git-hub-workflow.md) - [Build the robotics image with the prebuilt robotics eSDK](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/build-the-robotics-image-with-the-prebuilt-robotics-esdk.md) ##### Migration guide - [Migration from Qualcomm Linux 1.0 to 2.0](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/qir-sdk-migration-guide.md) - [Migration overview](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/migration-overview.md) - [Robotics OpenEmbedded layer changes](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/migration-robotics-oe-layer-changes.md) - [Robotics image composition changes](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/migration-image-composition.md) - [Enable and evaluate Qualcomm Linux overlays on QIR SDK](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/enable-and-evaluate-qualcomm-linux-overlays-on-QIR-SDK.md) ##### Appendices - [Appendices](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/appendices.md) - [Robotics layers specifications](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/robotics-layers-specifications.md) - [References](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-2.0/references.md) ### Robotics SDKs (Ubuntu) #### Robotics SDK(Ubuntu) ##### Get started - [QIR SDK for Ubuntu](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/index.md): The Qualcomm Intelligent Robotics (QIR) SDK for Ubuntu includes components that enable you to develop robotic features on Qualcomm platforms using the Ubuntu OS. - [Introduction](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/introduction.md): The Qualcomm Intelligent Robotics (QIR) SDK for Ubuntu includes components that enable you to develop robotic features on Qualcomm platforms using the Ubuntu OS. - [Install the QIR SDK](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/install-the-qir-sdk.md): Prepare the software image and dependencies required to run the QIR SDK sample applications on Qualcomm robotics platforms. ##### Sample applications - [QIR SDK sample applications](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/sample-applications.md): The QIR SDK provides various sample applications for platform, robotics, and AI use cases that you can combine to implement different functionalities. ###### Platform sample applications - [Platform sample applications](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/platform-sample-applications.md): The QIR SDK provides platform sample applications for cameras, lidar, audio, video, system status, and neural network inference. - [Enable Orbbec Gemini 335L with orbbec_camera](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/enable-orbbec-gemini-335l-with-orbbec-camera.md): The orbbec_camera sample application enables the Orbbec Gemini camera 335L to work in RGB or depth mode. This application generates the RGB and depth information by topics. - [Enable basic RPLIDAR handling with rplidar-ros](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/enable-basic-rplidar-handling-with-rplidar-ros2.md): The rplidar-ros2 sample application provides basic device handling for the 2D laser scanner RPLIDAR A1/A2/A3/S1/S2/S3. - [Publish system status with qrb_ros_system_monitor](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/publish-system-status-with-qrb-ros-system-monitor.md): The qrb_ros_system_monitor sample application has various ROS nodes that publish system status information, such as CPU loading, memory usage, and disk space. - [Run basic OCR with ocr_service](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/run-basic-ocr-with-ocr_service.md): The ocr_service sample application enables a service that provides the optical character recognition (OCR) function. It captures the image topic from the ROS system and publishes the result with ocr_topic. - [Publish the battery state with qrb_ros_battery](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/publish-the-battery-state-with-qrb_ros_battery.md): The qrb_ros_battery sample application is a package that publishes the battery state data from the system node. - [Explore the shared message interfaces in qrb_ros_interfaces](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/explore-message-interfaces.md): The qrb_ros_interfaces is a collection of ROS 2 interface packages designed to define and merge custom message, service, and action types. It's specifically adapted to communication within the QRB ROS ecosystem. - [Test ROS message transport with qrb_ros_transport](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/test-ros-message-transport-with-qrb_ros_transport.md): The qrb_ros_transport sample application implements zero-copy transport of ROS messages on Qualcomm robotics platforms. - [Implement model inference with qrb_ros_nn_inference](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/implement-model-inference-with-qrb_ros_nn_inference.md): qrb_ros_nn_inference is a ROS2 package for performing neural network model, providing AI-based perception for robotics applications. - [Publish the IMU data with qrb_ros_imu](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/publish-the-imu-data-with-qrb_ros_imu.md): The qrb_ros_imu sample application publishes the inertial measurement unit (IMU) data collected from the ICM-42688 hardware on Qualcomm Robotics Platforms. - [Run a zero-copy camera with qrb_ros_camera](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/run-a-zero-copy-camera-with-qrb_ros_camera.md): The qrb_ros_camera is a ROS package that publishes the images from Qualcomm CSI and GMSL cameras. - [Convert between NV12 and RGB888 with qrb_ros_colorspace_convert](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/convert-between-nv12-and-rgb888-with-qrb_ros_colorspace_convert.md): The qrb_ros_colorspace_convert sample application converts between NV12 and RGB888 formats. - [Playback and record audio with qrb_ros_audio_service](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/test-core-audio-functionalities-with-qrb_ros_audio_service.md): qrb_ros_audio_service is a ROS package that provides core audio functionalities. It serves as the primary interface for audio playback and recording within the ROS ecosystem. - [Encode and decode video with qrb_ros_video](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/test-video-functionalities-with-qrb_ros_video.md): qrb_ros_video is a ROS package that provides hardware-accelerated video processing for Qualcomm robotics platforms. - [Evaluate ROS component performance with qrb_ros_benchmark](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/evaluate-ros-component-performance-with-qrb_ros_benchmark.md): qrb_ros_benchmark is a benchmarking tool designed for evaluating the performance of ROS components on Qualcomm robotics platforms. It provides reusable components for benchmarking various message types and ROS nodes, with a focus on zero-copy transport mechanisms. ###### Robotics sample applications - [Robotics sample applications](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/robotics-sample-applications.md): The QIR SDK provides robotics sample applications for simulation, autonomous mobile robot control, SLAM, path following, AprilTag detection, and people tracking. - [Control AMR in the simulator with simulation_sample_amr_simple_motion](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/control-amr-in-the-simulator-with-simulation_sample_amr_simple_motion.md): The AMR simple motion is a simulated sample application that uses a Python-based ROS node to control the movements of QRB autonomous moving robots (AMRs) within the simulator. - [Enable pick-and-place in the simulator with simulation_sample_pick_and_place](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/enable-pick-and-place-in-the-simulator-with-simulation_sample_pick_and_place.md): The RML-63 Robotic Arm Pick and Place sample application implements a C++ based ROS2 node. It shows autonomous pick-and-place operations using MoveIt2 for motion planning and Gazebo for physics simulation. - [Experience remote assistant in the simulator with simulation_remote_assistant](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/experience-remote-assistant-in-the-simulator-with-simulation_remote_assistant.md): The simulation_remote_assistant sample application is a ROS package that uses an AMR as a remote assistant within a virtual office environment. - [Enable 2D lidar SLAM](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/enable-2d-lidar-slam-with-cartographer_node-and-cartographer_occupancy_grid_node.md): The 2D lidar SLAM sample application builds on Cartographer, which is capable of completing indoor map construction and localization based on 2D lidar sensors. It's suitable for indoor navigation of robots. - [Test follow-path with the qrb_ros_follow_path service](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/test-follow-path-with-the-qrb_ros_follow_path-service.md): The qrb_ros_follow_path service is a ROS2 package suite designed for path following navigation on the Qualcomm® Robotics Platform. - [Run basic AMR functionality with the AMR service](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/run-basic-amr-functionality-with-the-amr-service.md): qrb_ros_amr_service is a ROS2 package suite designed to manage the AMR behaviors on Qualcomm robotics platforms. - [Enable AprilTag pipeline with sample_apriltag](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/enable-apriltag-pipeline-with-sample-apriltag.md): The sample_apriltag is the ROS package to provide AprilTag pipeline samples for Qualcomm robotics platforms. - [Enable people tracking with follow_me](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/followme.md): follow_me is a lightweight application that enables robots to track targets in real-time. Currently, it only supports tracking people. - [Enable people tracking in the simulator with simulation_follow_me](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/enable-people-tracking-in-the-simulator-with-simulation_follow_me.md): The simulation_follow_me sample application is an AMR that detects, tracks, and follows a moving person in real time. The application integrates sensor emulation and motion control to achieve the human-following behavior in simulated environments. ###### AI sample applications - [AI sample applications](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/ai-sample-applications.md): The QIR SDK provides AI sample applications for hand detection, depth estimation, face detection, pose estimation, image classification, object detection, and segmentation. - [Detect hands with sample_hand_detection](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/detect-hands-with-sample_hand_detection.md): sample_hand_detection uses the Python-based hand recognition ROS node to detect hand and hand movement. It uses Qualcomm AI Engine Direct SDK (QNN) for model inference. - [Estimate image depth values with sample_depth_estimation](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/estimate-image-depth-values-with-sample_depth_estimation.md): This sample application allows you to input an RGB image named input_image.jpg or subscribe to the ROS topic /cam0_stream1 from qrb_ro_camera. It then uses QNN to perform model inference and publishes the result as the depth map ROS topic containing per-pixel depth values. - [Detect faces with sample_face_detection](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/detect-faces-with-sample_face_detection.md): The sample_face_detection sample application is a Python-based face detection ROS node that uses QNN for model inference. - [Estimate human poses with sample_hrnet_pose_estimation](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/estimate-human-poses-with-sample_hrnet_pose_estimation.md): The sample_hrnet_pose_estimation sample application provides high-precision human pose estimation capabilities. - [Classify images with sample_resnet101](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/classify-images-with-sample_resnet101.md): The sample_resnet101 is a Python-based ROS node that performs image classification using QNN-based inference. - [Detect objects with sample_object_detection](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/detect-objects-with-sample_object_detection.md): The sample_object_detection is a Python launch file utilizing QNN for model inference. It demonstrates camera data streaming, AI-based inference, and real-time visualization of object detection results. - [Segment objects with sample_object_segmentation](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/segment-objects-with-sample_object_segmentation.md): The sample_object_segmentation is a Python launch file utilizing QNN for model inference. It demonstrates camera data streaming, AI-based inference, and real-time visualization of object segmentation results. ##### Reference - [References](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/references.md): Reference documentation for each supported development kit, and definitions of the acronyms and terms used with the QIR SDK for Ubuntu. - [FAQs](https://dragonwingdocs.qualcomm.com/SDKs/QIR-SDK-Ubuntu/faq.md): Answers to common issues, including which QIR SDK package to use for the Ubuntu desktop and server images.