An environment state perception method based on knowledge representation in dual-arm robot assembly tasks

• Adjali, O., Amar, R.-C.: Knowledge processing using ekrl for robotic applications. Int. J. Cognit. Inf. Nat. Intell. (IJCINI) 11(4), 1–21 (2017)

  Google Scholar 

• Aein, M.J., Aksoy, E.E., Wrgtter, F.: Int. J. Robot. Res. 38(8), 910–934 (2019). https://doi.org/10.1177/0278364919850295

  Google Scholar 

• Aldoma, A., Marton, Z.-C., Tombari, F., Wohlkinger, W., Potthast, C., Zeisl, B., Rusu, R., Gedikli, S., Vincze, M.: Tutorial: point cloud library: three-dimensional object recognition and 6 dof pose estimation. IEEE Robot. Autom. Mag. 19(3), 80–91 (2012). https://doi.org/10.1109/MRA.2012.2206675. 6-dof pose estimations; Commodity hardware; Depth sensors; Low costs; Point cloud; Real time; Three dimensional object recognition; Threedimensional (3-d);

  Google Scholar 

• Breitenreicher, D., Schnorr, C.: Model-based multiple rigid object detection and registration in unstructured range data. Int. J. Comput. Vision 92(1), 32–52 (2011). https://doi.org/10.1007/s11263-010-0401-3. accurate registration; Geometric optimization; Laser scanning device; Multiple-object detections; Numerical techniques; Point-set registrations; Range data; Simultaneous detection;

  MATH  Google Scholar 

• Cong, Y., Tian, D., Feng, Y., Fan, B., Yu, H.: Speedup 3-d texture-less object recognition against self-occlusion for intelligent manufacturing. IEEE Transactions on CyberneticsHough voting; Hypothesis generation; K-d tree; Local references; Pose estimation; Solid model. https://doi.org/10.1109/TCYB.2018.2851666

• Correll, N., Bekris, K.E., Berenson, D., Brock, O., Causo, A., Hauser, K., Okada, K., Rodriguez, A., Romano, J.M., Wurman, P.R.: Analysis and observations from the first amazon picking challenge. IEEE Trans. Autom. Sci. Eng. 15(1), 172–188 (2016)

  Google Scholar 

• do Monte Lima, J.P.S., Simões, F.P.M., Uchiyama, H., Teichrieb, V., Marchand, E.: Depth-assisted rectification for real-time object detection and pose estimation. Mach. Vis. Appl. 27(2), 193–219 (2016)

• Fox, M., Long, D.: Pddl2. 1: an extension to pddl for expressing temporal planning domains. J. Artif. Intell. Res. 20, 61–124 (2003)

  MATH  Google Scholar 

• Gu, J., Wang, H., Chen, W., Wu, R.: Monocular visual object-localization using natural corners for assembly tasks. In: 2016 IEEE International Conference on Robotics and Biomimetics, ROBIO 2016, Qingdao, China, 2016, pp. 1383–1388, artificial markers; Corner detection; High capabilities; High flexibility; Inherent system uncertainty; Localization errors; Monocular cameras; Object localization. https://doi.org/10.1109/ROBIO.2016.7866520

• Hanh, L.D., Duc, L.M.: Planar object recognition for bin picking application. In: NICS 2018, Ho Chi Minh City, Viet nam, 2018, pp. 211–215, euclidian clustering; Kinect; Planar objects; Pose estimation; Vision control. https://doi.org/10.1109/NICS.2018.8606884

• Jiang, P., Ding, K., Leng, J.: Towards a cyber-physical-social-connected and service-oriented manufacturing paradigm: social manufacturing. Manufact. Lett. 7, 15–21 (2016). https://doi.org/10.1016/j.mfglet.2015.12.002. cyber physical social systems; Cyber-Physical System (CPS); Manufacturing industries; Operation and management; Service Oriented; Service oriented manufacturing; Social communities; Social interactions;

  Google Scholar 

• Jiang, P., Leng, J., Ding, K., Gu, P., Koren, Y.: Social manufacturing as a sustainable paradigm for mass individualization. Proc. Inst. Mech. Eng. Part B J. Eng. Manuf. 230(10), 1961–1968 (2016). https://doi.org/10.1177/0954405416666903. cyber physical social systems; Manufacturing paradigm; mass individualization; Personalizations; Personalized products; Self organizations; Social intelligence; sustainable paradigm;

  Google Scholar 

• Lee, S., Kim, J., Lee, M., Yoo, K., Barajas, L.G., Menassa, R.: 3d visual perception system for bin picking in automotive sub-assembly automation. In: IEEE International Conference on Automation Science and Engineering, Seoul, Korea, Republic of, 2012, pp. 706 – 713, 3-D vision systems; Geometric surfaces; Market innovation; Patch segmentation; Pervasive applications; Spherical surface; Surface normal estimation; Visual perception. https://doi.org/10.1109/CoASE.2012.6386359

• Lee, S., Wei, L., Naguib, A.M.: Adaptive bayesian recognition and pose estimation of 3d industrial objects with optimal feature selection. In: 2016 IEEE International Symposium on Assembly and Manufacturing, ISAM 2016, Fort Worth, TX, United states, 2016, pp. 50 – 55, 3d object recognition; Bayesian frameworks; Coarse registration; Industrial Objects; Optimal feature selections; Point cloud matching; Pose estimation; Pose estimation errors. https://doi.org/10.1109/ISAM.2016.7750717

• Lu, Y., Xu, X.: Cloud manufacturing for a service-oriented paradigm shift. In: 2014 IEEE International Conference on Industrial Engineering and Engineering Management, IEEE, pp. 1146–1150 (2014)

• Manhardt, F., Kehl, W., Navab, N., Tombari, F.: Deep model-based 6d pose refinement in rgb. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 11218 LNCS, Munich, Germany, 2018, pp. 833–849, appearance modeling; Geometrical symmetries; Model-based OPC; Object contour; Pose estimation; Pose refinement; Reproducibilities; Strong robustness. https://doi.org/10.1007/978-3-030-01264-9_49

• Marvel, J.A., Hong, T.-H., Messina, E.: solutions in perception challenge performance metrics and results. Proc. Workshop Perform Metrics Intell. Syst. 2012, 59–63 (2011)

  Google Scholar 

• McDermott, D., Ghallab, M., Howe, A., Knoblock, C., Ram, A., Veloso, M., Weld, D., Wilkins, D.: Pddl-the planning domain definition language (1998)

• Meng, S., Hu, R., Zhang, L., Dong, Q.: A method of autonomous assembly of large spacecraft components using robot. Robot 40(1), 81–88 (2018). +101

  Google Scholar 

• Mourtzis, D., Doukas, M.: The evolution of manufacturing systems: from craftsmanship to the era of customization. In: Handbook of Research on Design and Management of Lean Production Systems, IGI Global, pp. 1–29 (2014)

• Ogun, P.S., Usman, Z., Dharmaraj, K., Jackson, M.R.: 3d vision assisted flexible robotic assembly of machine components. In: Proceedings of SPIE - The International Society for Optical Engineering, Vol. 9875, Barcelona, Spain, 2015, 3-D vision; Assembly systems; Automated assembly; Flexible robotics; Industrial deployment; Point cloud data; Point cloud matching; Three degrees of freedom. https://doi.org/10.1117/12.2229053

• Sakcak, B., Bascetta, L., Ferretti, G.: Model based detection and 3d localization of planar objects for industrial setups. In: ICINCO 2016, Vol. 2, Lisbon, Portugal, 2016, pp. 360–367, chamfer matching; Changing parameter; Gradient orientations; Model-based OPC; Pose estimation; Synthetic images; Template generation; Template matching method

• Savarimuthu, T.R., Papon, J., Buch, A.G., Aksoy, E.E., Mustafa, W., Worgotter, F., Kruger, N.: An online vision system for understanding complex assembly tasks. In: VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings, Vol. 3, Berlin, Germany, 2015, pp. 454 – 461, complete system; Complex assembly; Integrated systems; Iterative Closest Points; Multiple objects; Recognition of objects; Semantic representation; Target application

• SONG Hai-tao, Y.K., Wen-hao, H.E.: A stereo vision system based on sift feature for robot environment perception. Control Decis. 34(7), 1545–1552 (2019)

  Google Scholar 

• Stoyanov, T., Vaskevicius, N., Mueller, C.A., Fromm, T., Krug, R., Tincani, V., Mojtahedzadeh, R., Kunaschk, S., Ernits, R.M., Canelhas, D.R., et al.: No more heavy lifting: robotic solutions to the container unloading problem. IEEE Robot. Autom. Magn. 23(4), 94–106 (2016)

  Google Scholar 

• Vaskevicius, N., Pathak, K., Ichim, A., Birk, A.: The jacobs robotics approach to object recognition and localization in the context of the icra’11 solutions in perception challenge. In: 2012 IEEE International Conference on Robotics and Automation, IEEE, pp. 3475–3481 (2012)

• Vidal, J., Lin, C.-Y., Marti, R.: 6d pose estimation using an improved method based on point pair features. In: Proceedings - 2018 4th International Conference on Control, Automation and Robotics, ICCAR 2018, Auckland, New Zealand, 2018, pp. 405–409, 3D computer vision; 3d object recognition; International workshops; Model based approach; Object pose; Pose estimation; Range images; Rutgers. https://doi.org/10.1109/ICCAR.2018.8384709

• J. Vidal, C.-Y. Lin, X. Llado, R. Marti, A method for 6d pose estimation of free-form rigid objects using point pair features on range data, Sensors (Switzerland) 18 (8), 3Dobject recognition; Consistency verifications; Feature-based method; Model based vision; Pre-processing step; Range data; Scene understanding; State-of-the-art methods. https://doi.org/10.3390/s18082678

• Wurman, P.R., Romano, J.M.: The amazonpicking challenge 2015. IEEE Robot. Autom. Mag. 22(3), 10–12 (2015)

  Google Scholar 

• Yu, W., Zhai, M., Chen, Y.: Model-based workpiece positioning for robotic fixtureless assembly using parallel monocular vision system. In: Lecture Notes in Electrical Engineering, Vol. 256 LNEE, Yangzhou, Jiangsu, China, 2013, pp. 671–680, algorithm development; Computation burden; Homography matrices; Model-based pose estimation; Monocular vision; Monocular vision system; Robotic grasping; Workpiece. https://doi.org/10.1007/978-3-642-38466-0_74

• Zech, P., Renaudo, E., Haller, S., Zhang, X., Piater, J.: Action representations in robotics: a taxonomy and systematic classification. Int. J. Robot. Res. 38(5), 518–562 (2019)

  Google Scholar 

• Zeng, A., Yu, K.-T., Song, S., Suo, D., Walker, E., Rodriguez, A., Xiao, J.: Multi-view self-supervised deep learning for 6d pose estimation in the amazon picking challenge. In: IEEE international conference on robotics and automation (ICRA). IEEE 2017, 1383–1386 (2017)

• Zhang, H., Cao, Y., Zhu, X., Fujie, M.G., Cao, Q.: An improved approach for model-based detection and pose estimation of texture-less objects. In: Proceedings of IEEE Workshop on Advanced Robotics and its Social Impacts, ARSO, Vol. 2016-November, No. 1989, Huangxiang Road, Minhang District, Shanghai, China, 2016, pp. 261–266, background clutter; Fast template matching; Gradient orientations; Iterative closest point algorithm; Model-based OPC; Non-maximum suppression; Searching methods; Threshold algorithms. https://doi.org/10.1109/ARSO.2016.7736292

Download references