Nothing Special   »   [go: up one dir, main page]
Skip to main content
SpringerLink
Log in

Development of a self reliant humanoid robot for sketch drawing

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper demonstrates the capability of humanoid robot in the field of sketch drawing. Sketch drawing is a complex job which requires three basic problems to be solved. The first problem is to extract prominent features (the image point) of the object shown. Second is to define the image points lying on the Humanoid’s camera plane with respect to its end effector position. The third problem is to provide the inverse kinematic solution and control strategy for smooth drawing. A H25 NAO humanoid robot is used as a test-bed in this paper to conduct this experiment and illustrate the whole process. A calibration matrix is defined which transforms image points in NAO body coordinate system while inverse kinematics has been solved using a gradient descent numerical method. The analytical solution of the inverse kinematics for NAO’s hands are not suitable due to its mechanical design which is not following the piper’s recommendation. The Denavit-Hartenberg (DH) parameters of the system has been defined in order to measure the working envelope of the right hand as well as to avoid singularities.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Alemi M, Meghdari A, Ghazisaedy M (2014) Employing humanoid robots for teaching english language in iranian junior high-schools. Int J Humanoid Robot 11(03):1450022

    Article  Google Scholar 

  2. Behnke S (2008) Humanoid robots-from fiction to reality?. KI 22(4):5–9

  3. Billard A (2003) Robota: clever toy and educational tool. Robot Auton Syst 42(3):259–269

    Article  MATH  Google Scholar 

  4. Brown S (2014) Meet Pepper, the emotion reading robot. Technology

  5. Burghart C, Mikut R, Stiefelhagen R, Asfour T, Holzapfel H, Steinhaus P, Dillmann R (2005) A cognitive architecture for a humanoid robot: A first approach. In: Humanoid robots, 2005 5th IEEE-RAS International Conference on. IEEE, pp 357–362

  6. Buss SR (2004) Introduction to inverse kinematics with jacobian transpose, pseudoinverse and damped least squares methods. IEEE J Robot Autom 17(1–19):16

    Google Scholar 

  7. Calinon S, Epiney J, Billard A (2005) A humanoid robot drawing human portraits. In: Humanoid robots, 2005 5th IEEE-RAS International Conference on. IEEE, pp 161–166

  8. Canny J (1986) A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell 8(6):679–698

    Article  Google Scholar 

  9. Cohen H (1988) How to draw three people in a botanical garden. In: AAAI, vol. 89, pp 846–855

  10. Collomosse J, Hall P (2002) Painterly rendering using image salience. In: Eurographics UK Conference, 2002. Proceedings. The 20th. IEEE, pp 122–128

  11. Deussen O, Lindemeier T, Pirk S, Tautzenberger M (2012) Feedback-guided stroke placement for a painting machine. In: Proceedings of the eighth annual symposium on computational aesthetics in graphics, visualization, and imaging. Eurographics Association, pp 25–33

  12. Dillmann R, Becher R, Steinhaus P (2004) Armar iia learning and cooperative multimodal humanoid robot system. Int J Humanoid Robot 1(01):143–155

    Article  Google Scholar 

  13. Fujita M, Kuroki Y, Ishida T et al (2003) A small humanoid robot sdr-4x for entertainment applications. In: Advanced intelligent mechatronics, 2003. AIM 2003. Proceedings. 2003 IEEE/ASME International Conference on, vol. 2. IEEE, pp 938–943

  14. Ghedini F, Bergamasco M (2010) Robotic creatures: anthropomorphism and interaction in contemporary art. In: RO-MAN, pp 731–736

  15. Goldenberg A, Benhabib B, Fenton RG et al (1985) A complete generalized solution to the inverse kinematics of robots. IEEE J Robot Autom 1(1):14–20

    Article  Google Scholar 

  16. Gonzalez RC, Woods RE (2002) Digital Image Processing, 2nd ed., Prentice Hall, Upper Saddle River, NJ

  17. Gouaillier D, Hugel V, Blazevic P, Kilner C, Monceaux JO, Lafourcade P, Marnier B, Serre J, Maisonnier B (2009) Mechatronic design of nao humanoid. In: Robotics and automation, 2009. ICRA’09. IEEE International Conference on. IEEE, pp 769–774

  18. Haeberli P (1990) Paint by numbers: abstract image representations. In: ACM SIGGRAPH Computer Graphics, vol. 24, no. 4. ACM, pp 207–214

  19. Hartley R et al (1997) In defense of the eight-point algorithm. IEEE Trans Pattern Anal Mach Intell 19(6):580–593

    Article  Google Scholar 

  20. Hertzmann A (1998) Painterly rendering with curved brush strokes of multiple sizes. In: Proceedings of the 25th annual conference on Computer graphics and interactive techniques. ACM, pp 453–460

  21. Kaneko K, Harada K, Kanehiro F, Miyamori G, Akachi K (2008) Humanoid robot hrp-3. In: Intelligent robots and systems, 2008. IROS 2008. IEEE/RSJ International Conference on. IEEE, pp 2471–2478

  22. Kawamura K, Wilkes DM, Pack T, Bishay M, Barile J (1996) Humanoids: future robots for home and factory. In: International symposium on humanoid robots, pp 53–62

  23. Kitano H, Asada M, Kuniyoshi Y, Noda I, Osawa E (1997) Robocup: The robot world cup initiative. In: Proceedings of the first international conference on autonomous agents. ACM, pp 340–347

  24. Kobayashi S, Tamagawa S, Morita T, Yamaguchi T (2011) Intelligent humanoid robot with japanese wikipedia ontology and robot action ontology. In: Human-robot interaction (HRI), 2011 6th ACM/IEEE International Conference on. IEEE, pp 417–424

  25. Kudoh S, Ogawara K, Ruchanurucks M, Ikeuchi K (2009) Painting robot with multi-fingered hands and stereo vision. Robot Auton Syst 57(3):279–288

    Article  Google Scholar 

  26. Kwok KW, Yam Y, Lo KW (2005) Ga-based homography transformation for vision rectification in robot drawing system. In Decision and control, 2005 and 2005 European Control Conference. CDC-ECC’05. 44th IEEE Conference on. IEEE, pp 2047–2052

  27. L. Fujitsu Automation Co. HOAP-2 instruction manual. http://biorob2.epfl.ch/pages/studproj/birg54248/hoap2designspec_1.pdf

  28. L. Honda Motor Co. Asimo instruction manual. http://asimo.honda.com/downloads/pdf/asimo-technical-information.pdf

  29. Lin P, Bekey G, Abney K (2008) Autonomous military robotics: risk, ethics, and design, DTIC Document, Tech. Rep

  30. Lu Y, Lam JH, Yam Y (2009) Preliminary study on vision-based pen-and-ink drawing by a robotic manipulator. In: Advanced intelligent mechatronics, 2009. AIM 2009. IEEE/ASME International Conference on. IEEE, pp 578–583

  31. Marchant GE, Allenby B, Arkin R, Barrett ET, Borenstein J, Gaudet LM, Kittrie O, Lin P, Lucas GR, OMeara R et al (2011) International governance of autonomous military robots. Columbia Sci Technol Law Rev 12:272–276

    Google Scholar 

  32. Metta G, Sandini G, Vernon D, Natale L, Nori F (2008) The icub humanoid robot: an open platform for research in embodied cognition. In: Proceedings of the 8th workshop on performance metrics for intelligent systems. ACM, pp 50–56

  33. Moura L (2007) A new kind of art: The robotic action painter. X Generative Art Conference, Politecnico di Milano University

  34. Ogura Y, Aikawa H, Shimomura K, Morishima A, Lim H.-O, Takanishi A (2006) Development of a new humanoid robot wabian-2. In: Robotics and automation, 2006. ICRA 2006. Proceedings 2006 I.E. International Conference on. IEEE, pp 76–81

  35. Okada K, Kojima M, Sagawa Y, Ichino T, Sato K, Inaba M (2006) Vision based behavior verification system of humanoid robot for daily environment tasks. In: Humanoid robots, 2006 6th IEEE-RAS International Conference on. IEEE, pp 7–12

  36. Pechev AN (2008) Inverse kinematics without matrix inversion. In: Robotics and automation, 2008. ICRA 2008. IEEE International Conference on. IEEE, pp 2005–2012

  37. Robotics A (2012) Nao datasheet h25corporatealdebaran robotics— discover nao

  38. Sakagami Y, Watanabe R, Aoyama C, Matsunaga S, Higaki N, Fujimura K (2002) The intelligent asimo: System overview and integration. In: Intelligent robots and systems, 2002. IEEE/RSJ International Conference on, vol. 3. IEEE, pp 2478–2483

  39. Schaal S (1999) Is imitation learning the route to humanoid robots? Trends Cogn Sci 3(6):233–242

    Article  Google Scholar 

  40. Shamsuddin S, Yussof H, Ismail L, Hanapiah FA, Mohamed S, Piah HA, Zahari NI (2012) Initial response of autistic children in human-robot interaction therapy with humanoid robot nao. In: Signal processing and its applications (CSPA), 2012 I.E. 8th International Colloquium on. IEEE, pp 188–193

  41. Singh AK, Nandi GC (2016) NAO humanoid robot: Analysis of calibration techniques for robot sketch drawing. Robotics and Autonomous Systems 79:108–121

  42. Singh AK, Chakraborty P, Nandi GC (2015, November). Sketch drawing by NAO humanoid robot. In TENCON 2015-2015 IEEE Region 10 Conference (pp. 1-6). IEEE

  43. Srikaew A, Cambron M, Northrup S, Peters R II, Wilkes D, Kawamura K (1998) Humanoid drawing robot. In: IASTED international conference on robotics and manufacturing

  44. Stein MR (2003) The pumapaint project. Auton Robot 15(3):255–265

    Article  Google Scholar 

  45. Stein MR, Madden CP (2005) The pumapaint project: long term usage trends and the move to three dimensions. In: Robotics and automation, 2005. ICRA 2005. Proceedings of the 2005 I.E. International Conference on. IEEE, pp 2779–2784

  46. Suzuki S et al (1985) Countour. Comput Vis Graph Image Process 30(1):32–46

    Article  Google Scholar 

  47. Tiwari R (2012) Intelligent planning for mobile robotics: algorithmic approaches: algorithmic approaches. IGI Global

  48. Tresset P, Leymarie FF (2005) Generative portrait sketching. In: Proceedings of VSMM, pp 739–748

  49. Tresset P, Leymarie (2013) Portrait drawing by Paul the robot. Comput Graph 37(5):348–363

    Article  Google Scholar 

  50. Yamauchi B (2004) Packbot: a versatile platform for military robotics. Proc SPIE 5422:228–237

Download references

Author information

Authors and Affiliations

  1. Robotics & Artificial Intelligence Laboratory, Indian Institute of Information Technology, Allahabad, UP, 211012, India

    Avinash Kumar Singh, Neha Baranwal & G. C. Nandi

Authors
  1. Avinash Kumar Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Neha Baranwal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. G. C. Nandi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Avinash Kumar Singh.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, A.K., Baranwal, N. & Nandi, G.C. Development of a self reliant humanoid robot for sketch drawing. Multimed Tools Appl 76, 18847–18870 (2017). https://doi.org/10.1007/s11042-017-4358-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4358-x

Keywords

Search

Navigation