Verification of a classification prediction method for the development of musical expression in early childhood using a machine learning method based on 3D motion capture data
DOI:
https://doi.org/10.14738/assrj.79.9028Abstract
It is widely acknowledged that children take developmental steps in performing musical expression through body movement dynamics. The author presents an approach to verify the method of classification prediction by machine learning using multiple classifiers to evaluate and classify the developmental degree of musical expressions in early childhood. The author addresses this potential solution by showing statistical analysis of full-body 3D motion captured data using such statistical analysis, and applies machine learning measures to predict developmental degrees of musical expression.
In 2016, the author extracted the feature quantities of movement based on the results of the movement analysis of the musical expressions in the MEB program regarding 3-year-old, 4-year-old, and 5-year-old children (n=76). The developmental degree of musical expression was classified into three stages based on video analysis of the musical expression of each child. The 2016 training data as the feature quantity of movement (factors) and the three-stage evaluation (categorical dependent variables) were used as the model training for machine learning. Based on the results in 2017 with 2018, the classification model training results were applied to the acquired data (n=87) in 2019.
The result of sensitivity analysis showed that the moving average acceleration of pelvis, the moving distance of right foot and the moving distance of right hand had a strong influence on the development of musical expression in early childhood. From those analysis results, the appropriateness of the machine learning method using decision trees for classifying the developmental degree of musical expression in early childhood was verified.
References
Akira, F., Hiroshi, and F., Naoyoshi, T. (2012) Automated evaluation as Japanese compositions based on features along Japanese education and construction of the individual evaluation model, Journal of natural language processing, 19(4): 281-301. 356
Sano, M. (2020). Verification Of A Classification Prediction Method For The Development Of Musical Expression In Early Childhood Using A Machine
Ando, A., Sumikawa, Y. (2012). Development and function evaluation of teaching materials for “sawing” observation by using motion capture and the virtual world, Japan Journal of educational technology, 36(2): 103-110. https://doi.org/10.15077/jjet.KJ00008274459
Ballema, G. (2005). Year’ round dramatic play, Michigan: Frank Schaffer Publications.
Burger, B. (2013). Move the way you feel: Effects of musical features, perceived emotions, and personality on musicinduced movement, University of Jyväskylä, Jyväskylä, Finland.
Burger,B., Thompson, M., Saarikallio, S., Luck, G., Toiviainen, P. (2013) Influences of rhythm and timbre-related musical features on characteristics of music-induced movement, Frontiers in Psychology, 4(183): 1-9. doi: 10.3389/fpsyg.2013.00183
Burton, L., Kudo, T. (2000) Sound play: Understanding music through creative movement (1), Rowman & Little field Education.
Cauwenberghs, G., Poggio, T. (2001). Incremental and decremental support vector machine learning. Advances in Neural Information Processing Systems, Cambridge MA: MIT Press,13(5): 409-412. http://isn.ucsd.edu/papers/nips00_inc.pdf
Chou, P. (1991). Optimal partitioning for classification and regression trees. IEEE Transactions Pattern Analysis and Machine Intelligence, 13 (4): 340-354. doi:10.1109/34.88569
Friedman, H. (2002). Stochastic gradient boosting. Computational. Statistics & Data Analysis, 38(4): 367–378. https://doi.org/10.1016/S0167-9473(01)00065-2
Hannon, E., and Johnson, S. (2005). Infants use meter to categorize rhythms and melodies: Implications for musical structure learning, Cognitive Psychology, 50: 354- 377. doi:10.1016/j.cogpsych.2004.09.003
Hendy, L., and Toon, L. (2001). Supporting drama and imaginative play in the early years, Buckingham, Philadelphia: Open University Press.
Heys, J.(2018). Machine Learning as a Tool to Identify Critical Assignments, Chemical Engineering Education, 52 (4): 243-250. http://journals.fcla.edu/cee/index
Igarashi, S., Ueno, K., and Furukawa, K. (2001). Analysis of Respiration during Musical Performances by Machine Learning, SIG Technical Reports, MUS, (82(2001-MUS-041)), 27-32.
Jalongo, M., and Isenberg, J. (2001). Creative expression and play in early childhood, New Jersey: Merrill Prentice Hall.
Kashiwagi, Y, Ochi, Y., and Iguchi, N. (2016). Estimation approach of a touching finger pattern for guitar performance using machine learning, IEICE technical report : 116(351): 11-14.
Marigliano, M., & Russo, M., 2011 Moving bodies, building minds: Foster preschooler’s critical thinking and problem solving through movement, Young Children, 66(5): 44-49. https://www.jstor.org/stable/42730771
Matsumoto, A., Mikami, H., and Kojima, A. (2012). Support for motor learning by clustering of sports forms: Examine effective image features as a target children back hip circle, ITE technical report, 38, 51(0): 9-12.
Moreno-Estevaa, E., White, S., Woodc,J., and Blackc, A.(2019). Application of mathematical and machine learning techniques to analyze eye tracking data enabling better understanding of children’s visual cognitive behaviours, Frontline Learning Research, 6(3) Special issue: 72 – 84. https://doi.org/10.14786/flr.v6i3.365
Murphy, K. P. (2012). Machine learning: A probabilistic perspective, Cambridge: MIT Press.
Phiilips Silver, J., and Trainor, L., 2005 Feeling the beat: Movement influences infant rhythm perception, Science, l.308: 1430. doi: 10.1126/science.1110922
Provasi, J., and Begue, A., 2003 Spontaneous motor tempo and rhythmical synchronization in 21/2 and 4 year old, International Journal of Behavioral Development, 27(3): 220-231. doi.org/10.1080/01650250244000290
Rubin, J., and Merrion, M. (1996). Drama and Music Methods, Portsmouth: Linner Professional Publications. 357
Sano, M. (2015) Characteristics of musical expressions showing the formation process of beat perception in early childhood: Through the practice of musical expression bringing-up program for 5-year-old children in K nursery school, Japanese Journal of Music Educational Practice, 12(2): 120-131. https://doi.org/10.20614/jjomep.12.2_120
Sano, M. (2017). Analysis of elements of movement in musical expression in early childhood, Japan Journal of Educational Technology, 41: 5-8, https://doi.org/ 10.15077/jjet.s41003.
Sano, M. (2018a). Development of a quatitative methodology to analyze the growth of recognition of musical elememts in early childhood from a viewpoint of change of body movement, Asia-Pacific Journal of Research of Early Childhood Education (International), 12(1): 61-80. http//dx.doi.org/10.17206/apjrece.2018.12.1.61.
Sano, M. (2018b). Statistical analysis of elements of movement in musical expression in early childhood using 3D motion capture and evaluation of musical development degrees through machine learning, World Journal of Education, 8(3): 118-130. https//doi.org/10.5430/wje.v8n3p118.
Sano, M. (2019). Predicting developmental degrees of music expression in early childhood by machine learning lassifiers with 3D motion captured body movement data, Journal of Educational Research and Reviews, 7(7): 155-168. https//doi.org/10.33495/jerr_v7i7.19.128
Sato, K., Kaiga, T., and Watabe, S. (2010). The utilization of motion capture to support proficiency of the dancing, Japan Journal of educational technology, 34: 133-136. https://doi.org/10.15077/jjet.KJ00007086695
Schriimacher, R. (2005). Art and creative development for young children, New York: Thompson.
Trainor, L., (2007) Do preferred beat rate and entrainment to the beat have a common origin in movement?, Emprical Musicology Review, 21: 17-20.
Widmer, G. (2001) Using AI and machine learning to study expressive music performance: project survey and first report, Ai Communications, 14(3):149-162.
Yamagami, S., Tajima, Y., and Kotani, Y. (2008). Analysis and attach of musical expression by machine learning using analysis of musical structure, IPSJ SIG technical reports, MUS, 74: 71-76.
Young, D. (2008) Classification of Common Violin Bowing Techniques Using Gesture Data from a Playable Measurement System, Proceedings of the 2008 Conference on New Interfaces for Musical Expression (NIME08), Genova, Italy.
Zatore, R., Chen, J., and Penhune, V. (2007). When the brain plays music: Auditory-motor interactions in music perception and production, Nature Reviews Neuroscience, 9: 547-558. doi: 10.1038/nrn2152
Zentner, M., and Eerola, T., 2010 Rhythmic engagement with music in infancy, PNA, 1073: 5768-5773. doi: 10.1073/pnas.1000121107
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2020 Mina Sano
This work is licensed under a Creative Commons Attribution 4.0 International License.
