Evaluation of the Quality of Learning Objects in the Health Care Area

Evidence of Validity and Internal

Authors

  • Carolina Sturm Trindade Federal University of Health Sciences of Porto Alegre
  • Sérgio Kakuta Kato Federal University of Health Sciences of Porto Alegre
  • Otavio Pereira Davila Federal University of Health Sciences of Porto Alegre
  • Ana Célia da Silva Siqueira Federal University of Health Sciences of Porto Alegre
  • Roberto Nunes Umpierre Federal University of Health Sciences of Porto Alegre
  • Ana Paula Borngraber Correa Federal University of Health Sciences of Porto Alegre
  • Alessandra Dahmer Federal University of Health Sciences of Porto Alegre
  • Caroline Tozzi Reppold Federal University of Health Sciences of Porto Alegre

DOI:

https://doi.org/10.31686/ijier.vol6.iss8.1110

Keywords:

Teaching Materials, Distance Education, Health Education, Validation Studies, Psychometrics

Abstract

In Brazil, distance education plays an important role in the training of human resources in the health area. In this context, learning objects, understood as modular digital resources used to support learning, are widely used tools in the process of knowledge construction, although not all are valid resources. To date, the literature does not have a specific instrument in Portuguese to evaluate the quality of learning objects in the health area. In order to fill this gap, this paper describes the search for evidence of validity of internal structure and convergent validity of Equalis-OAS: Scale to evaluate the quality of learning objects in the health area. For the study, Equalis-OAS was applied to professionals and undergraduate students from the different areas of Health Sciences, all participants taking a continuing education health course about Food and Nutrition in Primary Health Care. One thousand and sixty-nine volunteers participated in the study. An Exploratory Factor Analysis revealed that the instrument, which has as its construct “Quality of learning objects for the health area”, covers three dimensions: “Intrinsic Concepts of Learning Objects in the Health Area”, “Educational Characteristics” and “Presentation”. The final instrument consisted of 41 items, which explained 66.8% of the total variance of the scores. The scale had excellent internal consistency indexes (overall scale: α = 0.979; “Intrinsic Concepts of Learning Objects”: α = 0.927; “Educational”: α = 0.947; “Presentation”: α = 0.977). Regarding convergent validation, Pearson’s correlation indicated that Equalis-OAS had a moderate correlation (r=0.59, p<0.01) with LORI version 2.0, translated into Portuguese, an instrument for the evaluation of learning objects in general (i.e., not specific to the health area). These results indicate that Equalis-OAS is an instrument that presents good evidence of validity, indicating its use in the context of health education and research.

Downloads

Download data is not yet available.

Author Biography

  • Carolina Sturm Trindade, Federal University of Health Sciences of Porto Alegre

    UFCSPA- Universidade Federal de Ciências da Saúde de Porto Alegre

References

[1] Akpinar, Y. (2008) Validation of a learning object review instrument: relationship between ratings of learning objects and actual learning outcomes. IJELLO - Interdisciplinary Journal of E-Learning and Learning Objects. 4, pp.291-302.
[2] Amador, C.E.V. Arteaga, J.M., Rodriguez, F.A. (2007) Aspectos de la calidad de oetos de aprendizaje en el metadato de LOM. Anais do Encuentro Internacional Virtual Educa Brasil 2007; Iniciativa de cooperación multilateral em matéria de Educación, Formación e Innov@ción. São José dos Campos-SP, Brasil. Available at: http://e-spacio.uned.es/fez/eserv/bibliuned:19211/n03velazquez07.pdf Accessed 12 November 2015.
[3] Bath-Hextal, F., Wharrad, H., Leonardi-Bee, J. (2011) Teaching tools in evidence based practice: evaluation of reusable learning objects (ROLs) for learning about meta-analysis. BMC Med Educ. 11, pp.18.
[4] Blake H. (2010) Computer-based learnig objects in healthcare: the student experience. Int J Nurs Educ Scholarsh. 7, pp.1-15
[5] Brasil. Ministério da Saúde. (2007) Portaria Nº 1996, de 20 de agosto de 2007. Dispõe sobre as diretrizes para a implementação da Política Nacional de Educação Permanente em Saúde. Brasília, DF; 2007. Available at: http://bvsms.saude.gov.br/bvs/saudelegis/gm/2007/prt1996_20_08_2007.html. Accessed 25 March 2018.
[6] Bucarey, S., Alvarez, L. (2006) Metodología de construcción de objetos de aprendizaje para la enseñanza de anatomía humana en cursos integrados. Int J Morphol. 24, pp.357-362.
[7] Campos, G.H.B., Martins, I., Nunes, B.P. (2008) Instrumento para a avaliação da qualidade de objetos de aprendizagem: perspectiva do usuário. Available at: http://web.ccead.puc-rio.br/condigital/portal/InstrAvaliacao.pdf
[8] Cezar, D.M., Costa, M.R., Magalhães, C.R. (2017) Educação a distância como estratégia para a educação permanente em saúde? Revista EmRede - revista de educação à distância. 4, pp.106-115. Available at: https://www.aunirede.org.br/revista/index.php/emrede/article/download/184/259

[9] Coluci, M.Z.O., Alexandre, N.M.C., Milani, D. (2015) Construction of measurement instruments in the area of health. Ciênc Saúde Coletiva. 20, pp.925-936.
[10] Cunha, N.S., Bastos, C.G.M., Corrêa, A.P.B., Silva, F.R., Nobre, F.O., D’Ávila, O.P.; Umpierre, R.N. (2016) Educação a distância no TelessaúdeRS/UFRGS a importante função do apoiador pedagógico. Anais da 36ª Semana Científica do Hospital de Clínicas de Porto Alegre. Clin Biomed Res. 36, pp. 110-111.
[11] Dahmer, A., Tubelo, R.A., Pinheiro, L.B., Costa, M.R., Pinto, M.E.B. (2016) Virtual cities as content environments in a family health postgraduate programme. J Int Soc Telemed eHealth. 4, pp.1-6.
[12] Dahmer, A., Portella, F.F., Tubelo, R.A., Mattos, L.B., Gomes, M.Q., Costa, M.R., Pinto, M.E.B. (2017) Regionalization of contents of an e-learning Family Health graduate course: the Open University of Brazilian National Health System experience (UNA-SUS/FCSPA), Porto Alegre, Brazil.. Interface (Botucatu. Online). 21, pp.449-463. Available at: http://www.scielo.br/pdf/icse/v21n61/1414-3283-icse-21-61-0449.pdf
[13] França, R.M., Rabelo, A.M.O., Oliveira, A.E.F., Dahmer, A. Pinto, M.E.B. Tubelo, R.A. (2016) APS APS Game: a serious game for simulating clinical cases applied to Continuing Health Education in Brazil. J Bras Tele. 4, pp.294-298. Available at: http://www.e-publicacoes.uerj.br/index.php/jbtelessaude/article/view/33582/23811
[14] Gama, C.L.G. (2007) Método de construção de objetos de aprendizagem com aplicação em métodos numéricos. Tese em Métodos Numéricos em Engenharia. Faculdade de Matemática, Universidade Federal do Paraná, Curitiba (PR) Brasil.
[15] Gonzáles, R., Artega, J.M., Rodrigues, F.A. (2007). ―Evaluación de Objetos de Aprendizaje a través del Aseguramiento de Competencias Educativas, Universidad Autónoma de Aguascalientes Centro de Ciencias Básicas – México. Grupo de Objetos de Aprendizaje - Virtual Educa Brasil. Available at:http://e-spacio.uned.es/fez/view.php?pid=bibliuned:19233
[16] Granville, M.L., Souza, D.O.G., Calabró, L., Martins, L.M. (2017) Uma análise sobre os alunos de Especialização em Saúde da Família da UNA-SUS. Anais do XI ENPEC - Encontro Nacional de Pesquisa em Educação em Ciências. Universidade Federal de Santa Catarina, Florianópolis/SC. Available at: http://www.abrapecnet.org.br/enpec/xi-enpec/anais/listaresumos.htm
[17] Harzheim, E., Gonçalves, M.R., Umpierre, R.N., Silva Siqueira, A.C., Katz, N. Agostinho, M.R., Oliveira, E.B., Basso, J., Roman, R., Dal Moro, R.G., Pilz, C., Heinzelmann, R.S., Schmitz, C.A.A., Hauser, L. Mengue, S.S. (2016) Telehealth in Rio Grande do Sul, Brazil: bridging the gaps. Telemed J e-Health. 22, pp.938-944.
[18] Henkel, C.K. (2010) Creating interactive learning objects with PowerPoint: primer for lecture on the autonomic nervous system. Med Teach. 32, pp.355-359.
[19] IEEE. Learning Technology Standars Committee (LTSC). (2007) The Learning object metadata standard. Available at: http://www.ieeeltsc.org/working-groups/wg12LOM/lomDescription.
[20] Kay, R.H., Knaack, L. (2007) Evaluating the learning in learning objects. Open Learning: The Journal of Open, Distance and e-Learning.22, pp.5-28.
[21] Kay, R.H., Knaack, L. (2008) A multi-component model for assessing learning objects: the learning object evaluation metric (LOEM). Australasian Journal of Educational Technology. 24, pp.574-591.
[22] Krauss, F., Ally, M. (2005) A study of the design and evaluation of learning object and implications for content development. Interdisciplinary Journal of Knowledgeand Learning Objects. 1, pp.1-22. Available at: http://ijklo.org/Volume1/v1p001-022Krauss.pdf
[23] Laraia, B.A., Dodds, J.M., Benjamin, S., Jones, S.J., Carbone, E.T. (2008). Can Distance Education Prepare Future Public Health Nutritionists? A Case Study. J Nutr Educ Behav. 40, pp.34-38.
[24] Lymn, J.S., Bath-Hextall, F., Wharrad, H.J. (2008) Pharmacology education for nurse prescribing students: a lesson in reusable learning objects. BMC Nurs. 7, pp.1-11.
[25] Maroco, J., Garcia-Marques, T. (2006) Qual a fiabilidade do alfa de Cronbach? Questões antigas e soluções modernas? Laboratório de Psicologia. 4, pp.65-90.
[26] Mattos, L.B., Dahmer, A., Magalhães, C.R. (2015) Contribuição do curso de especialização em Atenção Primária à Saúde à prática de profissionais da saúde. ABCS Health Sciences. 40, pp.184-189.
[27] Munhoz, A.S. (2013) Objetos de aprendizagem. InterSaberes, Curitiba (PR), Brasil.
[28] Nesbit, J., Belfer, K., Leacock, T. (2009) Instrumento para a avaliação de objectos de aprendizagem (LORI): manual do usuário. Versão 2.0. Available at: http://docplayer.com.br/3164866-Instrumento-para-a-avaliacao-de-objectos-de-aprendizagem-lori.html
[29] Oliveira, F.P., Vanni, T., Pinto, H.A., Santos, J.T.R., Figueiredo, A.M., Araújo, S.Q., Matos, M.F.M., Cyrino, E.G. (2015) “Mais Médicos”: a Brazilian program in an international perspective. Interface (Botucatu). 19, pp. 623-634.
[30] Pasquali, L. (2009) Psicometria. Rev Esc Enferm USP. 43, pp.992-999. Available at: http://www.scielo.br/pdf/reeusp/v43nspe/a02v43ns.pdf.
[31] Pasquali, L. (2003) Psicometria: teoria dos testes na psicologia e na educação. Vozes, Petrópolis (RJ), Brasil.
[32] Reategui, E., Boff, E., Finco, M.D. (2010) Proposta de diretrizes para avaliação de objetos de aprendizagem considerando aspectos pedagógicos e técnicos. Renote Novas Tecnologia na Educação. 8, pp.1–10. Available at: http://seer.ufrgs.br/index.php/renote/article/view/18066/10653
[33] Reeves, S., Fletcher S., McLoughlin, C., Yim, A., Patel, K.D. (2017) Interprofessional online learning for primary healthcare: findings from a scoping review. BMJ Open. Available at: https://bmjopen.bmj.com/content/bmjopen/7/8/e016872.full.pdf
[34] Rozados, H.B.F. (2009) Objetos de aprendizagem no contexto da construção do conhecimento. C&D-Revista Eletrônica da Fainor. 2, pp.46-63. Available at: http://srv02.fainor.com.br/revista/index.php/memorias/article/viewFile/62/36
[35] Silva, A.N., Santos, A.M.G., Cortez, E.A., Cordeiro, B.C. (2015) Limits and possibilities of distance learning in continuing education in health: integrative review. Ciênc Saúde Coletiva. 20, pp.1099-1107.
[36] Tomaz, J.B.C., Mariano, R.E.M., Fonseca, J.J.S., Cavalcante, E.G.F., Nogueira, F.N.A. (2004) Educação à distância como estratégia de capacitação permanente em saúde: um relato de experiência. Available at: http://www.abed.org.br/congresso2004/por/htm/169-TC-D4.htm
[37] Trindade, C.S., Dahmer, A., Reppold, C.T. (2014) Learning Objects: An Integrative Review in Healthcare. J Health Inform. 6, pp.20-9. Available at: http://www.jhi-sbis.saude.ws/ojs-jhi/index.php/jhi-sbis/article/view/300/187
[38] Trindade, C.S. (2016) Desenvolvimento e validação de um instrumento para avaliação da qualidade dos objetos de aprendizagem da área da saúde. Tese. Universidade Federal de Ciências da Saúde de Porto Alegre, Porto Alegre (RS), Brasil.
[39] Vargo, J., Nesbit, J.C., Belfer, K., Archambault, A. (2003) Learning object evaluation: computer-mediated collaboration and inter-rater reability. Int J Comput Appl. 25, pp.1-8.
[40] Viguier M, Rist S, Aubin F, Leccia MT, Richard MA, Esposito-Farèse M, Pham, T. Richette, P., Wendling, D., Sibilia, J., Tubach, F. Online training on skin cancer diagnosis in rheumatologists: results from a nationwide randomized web-based survey. PLoS ONE. Available at: http://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0127564&type=printable
[41] Vollmar, H.C., Schürer-Maly, C.C., Frahne, J., Lelgemann, M., Butzlaff, M. (2006) An e-learning platform for guideline implementation-evidence- and case-based knowledge translation via the Internet. Methods Inf Med. 45, pp.389-396.
[42] Wiley, D.A. (2000) Connecting learning objects to instructional design theory: a definition, a metaphor, and a taxonomy. Available at: http://wesrac.usc.edu/wired/bldg-7_file/wiley.pdf
[43] Windle, R.J., McCormick, D., Dandrea, J., Wharrad, H. (2011) The characteristics of reusable learning objects that enhance learning: a case-study in health-science education. Brit J Educ Technol. 42, pp.811-823.

Downloads

Published

2018-08-01

How to Cite

Trindade, C. S. ., Kato, S. K. ., Davila, O. P. ., Siqueira, A. C. da S. ., Umpierre, R. N. ., Correa, A. P. B. ., Dahmer, A. ., & Reppold, C. T. . (2018). Evaluation of the Quality of Learning Objects in the Health Care Area: Evidence of Validity and Internal. International Journal for Innovation Education and Research, 6(8), 15-27. https://doi.org/10.31686/ijier.vol6.iss8.1110