Teaching music to children with autism: A social robotics challenge

Document Type : Article


1 Social & Cognitive Robotics Laboratory Center of Excellence in Design, Robotics and Automation (CEDRA) Sharif University of Technology, Tehran, Iran

2 Faculty of Humanities, West Tehran Branch, Islamic Azad University, Tehran, Iran

3 Institute for Cognitive and Brain Sciences (ICBS), Shahid Beheshti University, Tehran, Iran


Utilizing a humanoid social robot to systematically teach music to children with autism has not received wide attention to date. In this study, a novel robot-assisted music-based scenario has been designed in order to: 1) teach fundamentals of music via a xylophone-/drum-player robot as a teacher assistant, and 2) improve social/cognitive skills through active music games in children with autism. The educational-therapeutic interventions were conducted in an eleven-session case study program on three high-functioning and one low-functioning children with autism taking into consideration the children’s, parents’, and therapists’ experience during the program. The results indicated that as a tool and facilitator, the NAO robot does have the ability to teach musical notes/rhythms to the participants with high-functioning autism. It was also observed that the severity of the participants’ autism as well as the stress of the parents decreased somewhat during these sessions. Furthermore, noticeable improvements were seen in social/cognitive skills of all four participants; as well as the positive effect of this program on fine motor imitation skills of two subjects after the interventions. The progress reported from this preliminary exploratory study confirmed the potential benefits of using social robots and intelligent technologies as a facilitator in music-teaching and cognitive-rehabilitation.


Main Subjects

1. Geretsegger, M., Holck, U., Bieleninik, L., and Gold, C. Feasibility of a trial on improvisational music therapy for children with autism spectrum disorder", Journal of Music Therapy, 53(2), pp. 93-120 (2016). 2. Kim, J., Wigram, T., and Gold, C. The e ects of improvisational music therapy on joint attention behaviors in autistic children: A randomized controlled
study", Journal of Autism and Developmental Disorders, 38(9), pp. 1758-1766 (2008). 3. Wan, C.Y., Bazen, L., Baars, R., et al. Auditorymotor mapping training as an intervention to facilitate speech output in non-verbal children with autism: a
proof of concept study", PloS one, 6(9), e25505 (2011). 4. Overy, K., Classroom Rhythm Games for Literacy Support, Music and Dyslexia: A Positive Approach, pp. 26-44 (2008). 5. Pouretemad, H.R., Diagnosis and Treatment of Joint Attention in Autistic Children (in Persian), Tehran, Iran: Arjmand Book (2011). 6. Bhat, A.N. and Srinivasan, S. A review of 'music
and movement' therapies for children with autism: embodied interventions for multisystem development", Frontiers in Integrative Neuroscience, 7(22), pp. 1-15 (2013). 7. Kern, P., Rivera, N.R., Chandler, A., and Humpal, M., Music therapy services for individuals with autis M spectrum disorder: A survey of clinical practices and training needs", Journal of Music Therapy, 50(4), pp. 274-303 (2013). 8. Kern, P., Whipple, J., Wakeford, L. et al., Early Childhood Music Therapy and Autism Spectrum Disorders: Developing Potential in Young Children and Their Families, Jessica Kingsley publishers (2012).
9. Lim, H.A. and Draper, E. The e ects of music therapy incorporated with applied behavior analysis verbal behavior approach for children with autism spectrum disorders", Journal of music therapy, 48(4), p. 532 (2011). 10. Corbett, B.A., Shickman, K., and Ferrer, E. Brief report: the e ects of Tomatis sound therapy on language in children with autism", Journal of Autism and Developmental Disorders, 38(3), pp. 562-566 (2008). 11. Kalas, A. Joint attention responses of children with autism spectrum disorder to simple versus complex music", Journal of Music Therapy, 49(4), pp. 430-452
(2012). 12. Lanovaz, M.J., Fletcher, S.E., and Rapp, J.T. Identifying stimuli that alter immediate and subsequent levels of vocal stereotypy a further analysis of functionally matched stimulation", Behavior Modi cation,  33(5), pp. 682-704 (2009).
13. Wood, S., A study of the e ects of music on attending behavior of children with autistic-like syndrome", Master's Thesis, San Jose State University (1991). 14. LaGasse, A.B. E ects of a music therapy group intervention on enhancing social skills in children with autism", Journal of Music Therapy, 51(3), pp. 250-275 (2014). 15. Pasiali, V. The use of prescriptive therapeutic songs in a home-based environment to promote social skills acquisition by children with autism: Three case studies", Music Therapy Perspectives, 22(1), pp. 11-20 (2004). A. Taheri et al./Scientia Iranica, Special Issue on: Socio-Cognitive Engineering 26 (2019) 40{58 57 16. Katagiri, J. The e ect of background music and song texts on the emotional understanding of children with autism", Journal of Music Therapy, 46(1), pp. 15-31 (2009). 17. Simpson, K., and Keen, D. Music interventions for children with autism: narrative review of the literature", Journal of Autism and  evelopmental Disorders, 41(11), pp. 1507-1514 (2011). 18. Carnahan, C., Basham, J., and Musti-Rao, S. A low-technology strategy for increasing engagement of students with autism and signi cant learning needs", Exceptionality, 17(2), pp. 76-87 (2009). 19. Taheri, A., Meghdari, A., Alemi, M., Pouretemad, H.R, Poorgoldooz, P., and Roohbakhsh, M. Social
robots and teaching music to autistic children: Myth or reality?", Lecture Notes in Computer Science (LNCS): Social Robotics, 9979, pp. 541-550 (2016). 20. Mavadati, S.M., Feng, H., Gutierrez, A., and Mahoor, M.H. Comparing the gaze responses of children with autism and typically developed individuals in humanrobot interaction", In Humanoid Robots (Humanoids), 14th IEEE-RAS International Conference, pp. 1128- 1133 (2014). 21. Scassellati, B., Admoni, H., and Mataric, M. Robots for use in autism research", Annual Review of Biomedical Engineering, 14, pp. 275-294 (2012). 22. Soleiman, P., Salehi, S., Mahmoudi, M., Ghavami, M., Moradi, H. and Pouretemad, H.R. RoboParrot: A robotic platform for human robot interaction, case of autistic children", Second RSI/ISM International Conference on Robotics and Mechatronics (ICRoM), IEEE, pp. 711-716 (2014). 23. Gi ord, T., Srinivasan, S., et al. Using Robots to Teach Musical Rhythms to Typically Developing Children and Children with Autism, University of Connecticut (2011). 24. Peng, Y.H., Lin, C.W., Mayer, N.M., and Wang, M.L. Using a humanoid robot for music therapy with autistic children", In Automatic Control Conference
(CACS), International, IEEE, pp. 156-160 (2014). 25. Srinivasan, S.M., Eigsti, I.M., Neelly, L., and Bhat, A.N. The e ects of embodied rhythm and robotic interventions on the spontaneous and responsive social attention patterns of children with autism spectrum disorder (ASD): A pilot randomized controlled trial", Research in Autism Spectrum Disorders, 27, pp. 54-72 (2016). 26. https://www.softbankrobotics.com/emea/en (2018) 27. Taheri, A., Alemi, M., Meghdari, A., Pouretemad,
H.R., Basiri, N.M., and Poorgoldooz, P. Impact of humanoid social robots on treatment of a pair of Iranian autistic twins", Lecture Notes in Computer Science (LNCS): Social Robotics, 9388, pp. 623-632 (2015). 28. Zadeh Mohammadi, A., Music Education and Music Therapy for Exceptional Children (in Persian), Tehran, Iran, Kargah Nashr Publication (1995). 29. Kazdin, A.E., Single-Case Research Designs: Methods for Clinical and Applied Settings, Oxford University Press (2011).
30. Robb, S.L., Reporting guidelines for musicbased interventions by Sheri L. Robb, Janet S. Carpenter and Debra S. Burns" (2010) doi: 10.1177/1359105310374781. 31. Gardner, H. Children's duplication of rhythmic patterns",
Journal of Research in Music Education, 19(3), pp. 355-360 (1971). 32. Mundy, P., Delgado, C., Block, J., Venezia, M., Hogan, A., and Seibert, J., Early Social Communication Scales (ESCS), Coral Gables, FL: University of Miami (2003).
33. Gilliam, J.E., Gilliam Autism Rating Scale: Examiner's Manual, Pro-ed, Austin, TX (1995). 34. Bellini, S. and Peters, J.K. Social skills training for youth with autism spectrum disorders", Child and Adolescent Psychiatric Clinics of North America, 17(4), pp. 857-873 (2008). 35. Abidin, R.R., Parenting Stress Index-Short Form, Charlottesville, VA: Pediatric Psychology Press (1990). 36. Cohen, J., Statistical Power Analysis for the Behavioral Sciences, Revised Ed. (1977).
37. Peters, J.S., Music Therapy: An Introduction. Charles C Thomas Publisher (2000). 38. Finnigan, E. and Starr, E. Increasing social responsiveness in a child with autism A comparison of music and non-music interventions", Autism, 14(4), pp. 321- 348 (2010). 39. Tapus, A., Peca, A., Aly, A., et al. Children with autism social engagement in interaction with Nao, an imitative robot - A series of single case experiments", Interaction Studies, 13(3), pp. 315-347 (2012).
40. Feil-Seifer, D. and Matari, M.J. Toward socially assistive robotics for augmenting interventions for children with autism spectrum disorders", In: Experimental Robotics: The Eleventh International Symposium. Springer, Berlin, pp. 201-210 (2009). DOI: 10.1007/978-3-642-00196-3 24. 41. Werry, I., Dautenhahn, K., Ogden, B., and Harwin, W. Can social interaction skills be taught by a social agent? The role of a robotic mediator in autism therapy", In Cognitive Technology: Instruments of Mind, Springer Berlin Heidelberg, pp. 57-74 (2001). 42. Booth, P.B. and Jernberg, A.M., Theraplay: Helping
Parents and Children Build Better Relationships Through Attachment-Based Play, John Wiley and Sons (2009).
43. Alemi, M., Meghdari, A., and Ghazisaedy, M. The impact of social robotics on L2 learners' anxiety and attitude in English vocabulary acquisition", International Journal of Social Robotics, 7(4), pp. 523-535 (2015). 44. Taheri, A.R., Alemi, M., Meghdari, A., PourEtemad, H.R., and Basiri, N.M. Social robots as assistants for autism therapy in Iran: Research in progress", Second 58 A. Taheri et al./Scientia Iranica, Special Issue on: Socio-Cognitive Engineering 26 (2019) 40{58
RSI/ISM International Conference on Robotics and Mechatronics (ICRoM), pp. 760-766, IEEE (2014). 45. Alemi, M., Meghdari, A., Basiri, N.M., and Taheri, A. The e ect of applying humanoid robots as teacher assistants to help Iranian autistic pupils learn English as a foreign language", Lecture Notes in Computer Science (LNCS): Social Robotics, 9388, pp. 1-10 (2015). 46. Noor Mohammadi, F., E ect of the or  music on improving rhythm structuring", (in Persian),  evelopmental Psychology Quarterly, Tehran (2003). 47. Taheri, A., Meghdari, A., Alemi, M., and Pouretemad, H.R. Human-robot interaction in autism treatment: A case study on three pairs of autistic children as twins, siblings, and classmates", International Journal of Social Robotics, 10(1), pp. 93-113 (2018). 48. Taheri, A., Meghdari, A., Alemi, M., and Pouretemad,
H.R. Clinical interventions of social humanoid robots in the treatment of a set of high- and low-functioning autistic Iranian twins", Journal of Scientia Iranica, Transactions B: Mechanical Engineering, 25(3), pp. 1197-1214 (2018).
49. Brownell, M.D. Musically adapted social stories to modify behaviors in students with autism: Four case studies", Journal of Music Therapy, 39(2), pp. 117-144 (2002). 50. Merriam, S.B. Case study research in education: a qualitative approach", The Jossey-Bass Education Series, The Jossey-Bass Higher Education Series and The Jossey-Bass Social and Behavioral Science Series, San Francisco, CA, US: Jossey-Bass (1988).