83 lines
1.8 KiB
Markdown
83 lines
1.8 KiB
Markdown
# hivecore_robot_vision
|
||
|
||
|
||
|
||
#### 安装教程
|
||
|
||
1. Gemini SDK:
|
||
|
||
> 安装 deb 依赖项:
|
||
```
|
||
# ssume you have sourced ROS environment, same blow
|
||
sudo apt install libgflags-dev nlohmann-json3-dev \
|
||
ros-$ROS_DISTRO-image-transport ros-${ROS_DISTRO}-image-transport-plugins ros-${ROS_DISTRO}-compressed-image-transport \
|
||
ros-$ROS_DISTRO-image-publisher ros-$ROS_DISTRO-camera-info-manager \
|
||
ros-$ROS_DISTRO-diagnostic-updater ros-$ROS_DISTRO-diagnostic-msgs ros-$ROS_DISTRO-statistics-msgs \
|
||
ros-$ROS_DISTRO-backward-ros libdw-dev
|
||
```
|
||
> 安装 udev 规则
|
||
```
|
||
cd ~/workspace/src/orbbec_camera/scripts
|
||
sudo bash install_udev_rules.sh
|
||
sudo udevadm control --reload-rules && sudo udevadm trigger
|
||
```
|
||
|
||
2. RealSense SDK:
|
||
|
||
```
|
||
sudo apt install ros-humble-librealsense2*
|
||
```
|
||
|
||
3. Dependency:
|
||
|
||
```
|
||
"idge=3.2.1"
|
||
"numpy>=1.23.0, <2.0.0",
|
||
"matplotlib>=3.3.0",
|
||
"opencv-python>=4.6.0",
|
||
"pillow>=7.1.2",
|
||
"pyyaml>=5.3.1",
|
||
"requests>=2.23.0",
|
||
"scipy>=1.4.1",
|
||
"torch>=2.7.1",
|
||
"torch>=1.8.0,!=2.4.0; sys_platform == 'win32'",
|
||
"torchvision>=0.9.0",
|
||
"tqdm>=4.64.0",
|
||
"psutil",
|
||
"py-cpuinfo",
|
||
"pandas>=1.1.4",
|
||
"open3d",
|
||
```
|
||
|
||
#### 使用说明
|
||
1. 启动相机和检测节点:
|
||
|
||
ros2 launch detect_part camera_detect.launch.py
|
||
|
||
> camera_detect.launch.py 中可以修改部分参数:set_confidence, output_boxes, output_masks, checkpoint_name
|
||
|
||
> 坐标系设置为：Z为图像深度，XY平面为图像成象平面
|
||
|
||
2. 接收位置话题节点:
|
||
|
||
ros2 run detect_part sub_pose_node
|
||
|
||
3. 位置话题接口:
|
||
|
||
interface/msg/PoseWithID.msg, PoseWithIDArray.msg
|
||
|
||
4. 话题名称:
|
||
|
||
/pose/cv_detect_pose # 位置
|
||
/image/detect_image # 目标识别图片
|
||
|
||
5. PoseWithID.msg：
|
||
|
||
string class_name
|
||
int32 class_id
|
||
geometry_msgs/Pose[] pose_list
|
||
|
||
6. PoseWithIDArray.msg：
|
||
|
||
PoseWithID[] objects
|