Study of the Learning Performance and User Experience of the Interactive Systems of the Catavento Cultural Museum
DOI:
https://doi.org/10.31686/ijier.vol7.iss3.1358Keywords:
Museums, interactive systems, educational games, user experienceAbstract
Educational interactive technologies are placed in museums to enhance the visitor experience. Great time and money and hard work hours are spent to design, develop and deploy these systems. But do these systems actually achieve their pedagogical goals? Do they contribute to greater effectiveness and user experience (UX)? In this article we report the use of the technological attraction "Adventure in the Solar System", from the Catavento Cultural Museum, in São Paulo, Brazil. The attraction simulates an adventure in space through a spaceship composed of collaborative games designed to teach about astronomy, physics and mathematics. 129 students participated in this empirical study and were classified into three groups (ESI - Elemental Scholl I; ESII - Elemental Scholl II; HS - High Scholl), all aged between 7 and 16 years. The main objective of the study was to analyze learning performance and user experience (UX). The results showed that there were no statistically significant results betwen groups, but higher proportions of positive scores were observed in the ESII and SH groups. Regarding the user experience, ESI and ESII presented more expressive results than SH. The main results are discussed and ideas for future research are presented.
Downloads
Download data is not yet available.
References
[1] H. Kraemer. “Media Are, First of All, for Fun: The Future of Media Determines the Future of Museums”, The Future of Museums, Springer, Cham, 2018, pp. 81-100.
[2] H. Setiadi. “Designing a Supplementary Reading Using Cultural Language Learning Approach (CLLA)”, International Journal for Innovation Education and Research, 5(8), 2017, pp. 111-128.
[3] H.C. Huang and M.C. Chuang. “An Aesthetic Practice in Higher Education through Exhibition Transformation”, International Journal for Innovation Education and Research, 3(3), 2015, pp. 117-131.
[4] P. Zaharias, D. Michael and Y. Chrysanthou. “Learning through multi-touch interfaces in museum exhibits: An empirical investigation”, Journal of Educational Technology & Society, 16(3), 2013, pp. 374-384.
[5] R. Hammady, M. Ma and A. Powell, A. “User Experience of Markerless Augmented Reality Applications in Cultural Heritage Museums:‘MuseumEye’as a Case Study”, In: International Conference on Augmented Reality, Virtual Reality and Computer Graphics. Springer, Cham, 2018, pp. 349-369.
[6] H. Huang, C.W. Chen, and Y.W. “Hsieh. Factors Affecting Usability of Interactive 3D Holographic Projection System for Experiential Learning”, In: International Conference on Learning and Collaboration Technologies, Springer, Cham, 2018, pp. 104-116.
[7] C.C. Chen, an T.C. Huang, “Learning in a u-museum: Developing a context-aware ubiquitous learning environment”, Computers & Education, 59(3), 2012, pp. 873–883.
[8] K.E. Chang, C.T. Chang, H.T. Hou, Y.T. Sung, H.L. Chao and C.M. Lee. “Development and behavioral pattern analysis of a mobile guide system with augmented reality for painting appreciation instruction in an art museum”, Computers & Education, 71(1), 2014, pp. 185-197.
[9] M.S. Horn, B.C. Phillips, E.M. Evans, F. Block, J. Diamond and C. Shen, C. “Visualizing biological data in museums: Visitor learning with an interactive tree of life exhibit”, Journal of Research in Science Teaching, 53(6), 2016, pp. 895-918.
[10] L. Andre, T. Durksen and M.L. Volman. “Museums as avenues of learning for children: A decade of research”, Learning Environments Research, 20(1), 2017, pp. 47-76.
[11] G. Vavoula, M. Sharples, P. Rudman, J. Meek and P. Lonsdale. “Myartspace: Design and evaluation of support for learning with multimedia phones between classrooms and museums”, Computers & Education, 53(2), 2009, pp. 286-299.
[12] J. Wishart and P. Triggs P. “MuseumScouts: Exploring how schools, museums and interactive technologies can work together to support learning”, Computers & Education, 54(2), 2010, pp. 669-678.
[13] L.J. Rennie and T.P. McClafferty.” Science centres and science learning”, Studies in Science Education, 27(1), 1996, pp. 53–98.
[14] J.H. Falk and M. Storksdieck. “Using the Contextual Model of Learning to Understand Visitor Learning from a Science Center Exhibition”, Science Education, 89(1), 2005, pp. 744–778.
[15] S.D. Coll, R. Coll and D. Treagust. “Making the most of out-of–school visits: How does the teacher prepare? Part II: Implementation & Evaluation of the Learner Integrated Field Trip Inventory (LIFTI)”, In: International Journal of Innovation in Science and Mathematics Education (formerly CAL-laborate International), 26(4), 2018, pp. 1-19.
[16] Hawkey, R. Learning with digital technologies in museums, science centres and galleries [Report 9, Futurelab Series]. London, UK: King’s College, 2004.
[17] K.F. Lee, Y.L. Chen, H.C. Hsieh and K.Y. Chin, K. Y. “Application of intuitive mixed reality interactive system to museum guide activity”, In: 2017 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW), IEEE, 2017, pp. 257-258.
[18] Z. Mu, M. Liu and Z. Tan. “On the Interactive Display of Virtual Aerospace Museum Based on Virtual Reality”, In: 2018 IEEE International Conference on Robots & Intelligent System (ICRIS), IEEE, 2018, pp. 144-146.
[19] A. Caraban, T. Paulino, R. Pereira, R. Spence, M.I.M.I. Madeira-ITI and P. Campos). “The Monarch Room: An Interactive System for Visualization of Global Migration Data”, In: Proceedings of the 32nd International BCS Human Computer Interaction Conference. BCS Learning & Development Ltd., 2018. p. 1-5.
[20] T. Kunkel, M. Averkiou and Y. Chrysanthou, Y. “A web-based virtual museum application”, In M. Ioannides, A. Addison, A. Georgopoulos, L. Kalisperis (Eds.), Proceedings of the 14th International Conference on Virtual Systems and Multimedia Budapest, Hungary, 2008, pp. 275-277.
[21] P. Patias, Y. Chrysanthou, S. Sylaiou, C. Georgiades, D. Michael and S. Stylianidis. “The development of an e-museum for contemporary arts”, In M. Ioannides, A. Addison, A. Georgopoulos, L. Kalisperis (Eds.), Proceedings of the 14th International Conference on Virtual Systems and Multimedia Budapest, Hungary, 2008, pp. 1-7.
[22] Y. Day. “Visitor centered design in contemporary art museum. Research on the interactive development trend and digital strategy of contemporary art museum”, Tesi Specialistiche/Magistrali in Design della comunicazione, Politecnico di Milano, 2018.
[23] A. Origli, E. Leone, A. Sorgente, P. Vanacore, M. Parascandolo, F. Mele and F. Cutugno. “Designing interactive experiences to explore artwork collections: a multimedia dialogue system supporting visits in museum exhibits”, In: Proceedings of the 10th AI*IA 2016, 1772, 2016, pp. 26–33.
[24] R. Rosales, M. Castañón-Puga, F. Lara-Rosano, J.M. Flores-Parra, R. Evans, N. Osuna-Millan and C. Gaxiola-Pacheco. “Modelling the Interaction Levels in HCI Using an Intelligent Hybrid System with Interactive Agents: A Case Study of an Interactive Museum Exhibition Module in Mexico”, Applied Sciences, 8(3), 2018, pp. 1-21.
[25] R. Reynolds, K. Walker and C. Speight. “Web-based museum trails on PDAs for university-level design students: Design and evaluation”, Computers & Education, 55(3), 2010, pp. 994-1003.
[26] M.L. Hallack and M.C. Lavalhegas. “Discurso Científico: Um estudo de caso do Museu Catavento Cultural no Município de São Paulo”, Sensos-e, 4(1), 2017, 88-97.
[27] G.G. Bitter, J. Puglisi, A. Gorges and H.P. Uppal. “The effects of an online collaborative elementary math program using team-based games to improve student math achievement, attitude and motivation”, International Journal for Innovation Education and Research, 4(7), 2016, pp. 113-138.
[28] Keller, J.M. Motivational design for learning and performance: the ARCS model approach. New York, Springer, 2009.
[29] R. Savi, C.G. von Wangenheim and A.F. Borgatto. “A model for the evaluation of educational games for teaching software engineering”, In: 2011 25th Brazilian Symposium on Software Engineering (SBES), IEEE, 2011, pp. 194-203.
[30] Bloom, T. M. E. Bloom’s taxonomy of educational objectives. Longman, 1965.
[31] Moore, B. J. Situated cognition versus traditional cognitive theories of learning. Education, 1998.
[32] Moore, B. J. Cognitive Theories of Learning, 1999.
[33] Crawley, M.J. The R book. John Wiley & Sons, Chichester, UK, 2007.
[34] Zar, J.H. Biostatistical analysis. Prentice Hall, Upper Saddle River, NJ, 1999.
[2] H. Setiadi. “Designing a Supplementary Reading Using Cultural Language Learning Approach (CLLA)”, International Journal for Innovation Education and Research, 5(8), 2017, pp. 111-128.
[3] H.C. Huang and M.C. Chuang. “An Aesthetic Practice in Higher Education through Exhibition Transformation”, International Journal for Innovation Education and Research, 3(3), 2015, pp. 117-131.
[4] P. Zaharias, D. Michael and Y. Chrysanthou. “Learning through multi-touch interfaces in museum exhibits: An empirical investigation”, Journal of Educational Technology & Society, 16(3), 2013, pp. 374-384.
[5] R. Hammady, M. Ma and A. Powell, A. “User Experience of Markerless Augmented Reality Applications in Cultural Heritage Museums:‘MuseumEye’as a Case Study”, In: International Conference on Augmented Reality, Virtual Reality and Computer Graphics. Springer, Cham, 2018, pp. 349-369.
[6] H. Huang, C.W. Chen, and Y.W. “Hsieh. Factors Affecting Usability of Interactive 3D Holographic Projection System for Experiential Learning”, In: International Conference on Learning and Collaboration Technologies, Springer, Cham, 2018, pp. 104-116.
[7] C.C. Chen, an T.C. Huang, “Learning in a u-museum: Developing a context-aware ubiquitous learning environment”, Computers & Education, 59(3), 2012, pp. 873–883.
[8] K.E. Chang, C.T. Chang, H.T. Hou, Y.T. Sung, H.L. Chao and C.M. Lee. “Development and behavioral pattern analysis of a mobile guide system with augmented reality for painting appreciation instruction in an art museum”, Computers & Education, 71(1), 2014, pp. 185-197.
[9] M.S. Horn, B.C. Phillips, E.M. Evans, F. Block, J. Diamond and C. Shen, C. “Visualizing biological data in museums: Visitor learning with an interactive tree of life exhibit”, Journal of Research in Science Teaching, 53(6), 2016, pp. 895-918.
[10] L. Andre, T. Durksen and M.L. Volman. “Museums as avenues of learning for children: A decade of research”, Learning Environments Research, 20(1), 2017, pp. 47-76.
[11] G. Vavoula, M. Sharples, P. Rudman, J. Meek and P. Lonsdale. “Myartspace: Design and evaluation of support for learning with multimedia phones between classrooms and museums”, Computers & Education, 53(2), 2009, pp. 286-299.
[12] J. Wishart and P. Triggs P. “MuseumScouts: Exploring how schools, museums and interactive technologies can work together to support learning”, Computers & Education, 54(2), 2010, pp. 669-678.
[13] L.J. Rennie and T.P. McClafferty.” Science centres and science learning”, Studies in Science Education, 27(1), 1996, pp. 53–98.
[14] J.H. Falk and M. Storksdieck. “Using the Contextual Model of Learning to Understand Visitor Learning from a Science Center Exhibition”, Science Education, 89(1), 2005, pp. 744–778.
[15] S.D. Coll, R. Coll and D. Treagust. “Making the most of out-of–school visits: How does the teacher prepare? Part II: Implementation & Evaluation of the Learner Integrated Field Trip Inventory (LIFTI)”, In: International Journal of Innovation in Science and Mathematics Education (formerly CAL-laborate International), 26(4), 2018, pp. 1-19.
[16] Hawkey, R. Learning with digital technologies in museums, science centres and galleries [Report 9, Futurelab Series]. London, UK: King’s College, 2004.
[17] K.F. Lee, Y.L. Chen, H.C. Hsieh and K.Y. Chin, K. Y. “Application of intuitive mixed reality interactive system to museum guide activity”, In: 2017 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW), IEEE, 2017, pp. 257-258.
[18] Z. Mu, M. Liu and Z. Tan. “On the Interactive Display of Virtual Aerospace Museum Based on Virtual Reality”, In: 2018 IEEE International Conference on Robots & Intelligent System (ICRIS), IEEE, 2018, pp. 144-146.
[19] A. Caraban, T. Paulino, R. Pereira, R. Spence, M.I.M.I. Madeira-ITI and P. Campos). “The Monarch Room: An Interactive System for Visualization of Global Migration Data”, In: Proceedings of the 32nd International BCS Human Computer Interaction Conference. BCS Learning & Development Ltd., 2018. p. 1-5.
[20] T. Kunkel, M. Averkiou and Y. Chrysanthou, Y. “A web-based virtual museum application”, In M. Ioannides, A. Addison, A. Georgopoulos, L. Kalisperis (Eds.), Proceedings of the 14th International Conference on Virtual Systems and Multimedia Budapest, Hungary, 2008, pp. 275-277.
[21] P. Patias, Y. Chrysanthou, S. Sylaiou, C. Georgiades, D. Michael and S. Stylianidis. “The development of an e-museum for contemporary arts”, In M. Ioannides, A. Addison, A. Georgopoulos, L. Kalisperis (Eds.), Proceedings of the 14th International Conference on Virtual Systems and Multimedia Budapest, Hungary, 2008, pp. 1-7.
[22] Y. Day. “Visitor centered design in contemporary art museum. Research on the interactive development trend and digital strategy of contemporary art museum”, Tesi Specialistiche/Magistrali in Design della comunicazione, Politecnico di Milano, 2018.
[23] A. Origli, E. Leone, A. Sorgente, P. Vanacore, M. Parascandolo, F. Mele and F. Cutugno. “Designing interactive experiences to explore artwork collections: a multimedia dialogue system supporting visits in museum exhibits”, In: Proceedings of the 10th AI*IA 2016, 1772, 2016, pp. 26–33.
[24] R. Rosales, M. Castañón-Puga, F. Lara-Rosano, J.M. Flores-Parra, R. Evans, N. Osuna-Millan and C. Gaxiola-Pacheco. “Modelling the Interaction Levels in HCI Using an Intelligent Hybrid System with Interactive Agents: A Case Study of an Interactive Museum Exhibition Module in Mexico”, Applied Sciences, 8(3), 2018, pp. 1-21.
[25] R. Reynolds, K. Walker and C. Speight. “Web-based museum trails on PDAs for university-level design students: Design and evaluation”, Computers & Education, 55(3), 2010, pp. 994-1003.
[26] M.L. Hallack and M.C. Lavalhegas. “Discurso Científico: Um estudo de caso do Museu Catavento Cultural no Município de São Paulo”, Sensos-e, 4(1), 2017, 88-97.
[27] G.G. Bitter, J. Puglisi, A. Gorges and H.P. Uppal. “The effects of an online collaborative elementary math program using team-based games to improve student math achievement, attitude and motivation”, International Journal for Innovation Education and Research, 4(7), 2016, pp. 113-138.
[28] Keller, J.M. Motivational design for learning and performance: the ARCS model approach. New York, Springer, 2009.
[29] R. Savi, C.G. von Wangenheim and A.F. Borgatto. “A model for the evaluation of educational games for teaching software engineering”, In: 2011 25th Brazilian Symposium on Software Engineering (SBES), IEEE, 2011, pp. 194-203.
[30] Bloom, T. M. E. Bloom’s taxonomy of educational objectives. Longman, 1965.
[31] Moore, B. J. Situated cognition versus traditional cognitive theories of learning. Education, 1998.
[32] Moore, B. J. Cognitive Theories of Learning, 1999.
[33] Crawley, M.J. The R book. John Wiley & Sons, Chichester, UK, 2007.
[34] Zar, J.H. Biostatistical analysis. Prentice Hall, Upper Saddle River, NJ, 1999.
Downloads
Published
2019-03-01
Issue
Section
Journal Articles
License
Copyright (c) 2019 Ana Grasielle Dionísio Corrêa, Marcelo Nogueira Rossi, Irene Karaguilla Ficheman, Roseli de Deus Lopes
This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License.
Copyrights for articles published in IJIER journals are retained by the authors, with first publication rights granted to the journal. The journal/publisher is not responsible for subsequent uses of the work. It is the author's responsibility to bring an infringement action if so desired by the author for more visit Copyright & License.
How to Cite
Corrêa, A. G. D., Rossi, M. N., Ficheman, I. K., & Lopes, R. de D. (2019). Study of the Learning Performance and User Experience of the Interactive Systems of the Catavento Cultural Museum. International Journal for Innovation Education and Research, 7(3), 186-221. https://doi.org/10.31686/ijier.vol7.iss3.1358
