born in 2001. Master candidate. Student member of CCF. His main research interests include object detection and artificial intelligence
born in 1984. PhD, associate professor. Member of CCF. His main research interests include embedded operating systems, Internet of things, and artificial intelligence
born in 1979. PhD, professor. Member of CCF. His main research interests include intelligent computing, medical image processing, and big data analysis
born in 2004. Bachelor. His main research interests include artificial intelligence and object detection
born in 2001. Bachelor. His main research interests include machine vision and artificial intelligence
born in 1984. PhD, professor. His main research interests include multi-source information fusion, artificial intelligence, intelligent perception interconnection, and Internet of things systems
With the development of artificial intelligence technology, vision-based object recognition, as an important component of the Internet of things perception layer, can be applied in various cargo sorting scenarios when combined with sorting robots. However, in complex environments where objects are disorganized, relying solely on object recognition algorithms may not be sufficient to distinguish target objects from interfering ones, as the difference between them may be the spatial distance. This can negatively impact the robot’s normal grasping actions. To address this issue, we propose a lightweight object recognition method for complex environments—3Deus. This method combines deep learning with 3D point cloud data processing. It uses a depth camera to synchronously capture both RGB images and 3D point cloud data in the recognition scene. The method eliminates the plane where interfering objects are located using the 3D point cloud, and distinguishes the plane containing the target object from the stacked interfering objects with an improved RANSAC algorithm. It also employs a plane expansion mechanism to ensure the integrity of the plane point cloud where the target object is located. Finally, the object recognition algorithm is used to obtain the recognition bounding box of the target object and construct its mapping relationship with the specific point cloud cluster. We deploy 3Deus on edge computing devices and validate its effectiveness and robustness by constructing different experimental scenarios. Experimental results show that compared with the traditional random sampling consensus algorithm, 3Deus can effectively distinguish the target objects from interference objects, achieving an accuracy of over 95%. Moreover, by utilizing the plane expansion mechanism, the recognition accuracy of the target object is improved by 30.48%.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |