Assessment in the competency-oriented curriculum in the health area: integrative literature review

Authors

  • Elza de Fátima Ribeiro Higa Faculdade de Medicina de Marilia (Famema)
  • Magali Aparecida Alves de Moraes Alves de Moraes Faculdade de Medicina de Marília - Famema
  • Luzmarina Aparecida Doretto Bracccialli Doretto Braccialli Faculdade de Medicina de Marília
  • Odilon Marques de Almeida Filho Almeida Filho Faculdade de Medicina de Marília

DOI:

https://doi.org/10.14571/brajets.v17.n4.1390-1402

Keywords:

Assessment, Education medical, Competency-Based Education, Review, Qualitative research

Abstract

Through the theoretical foundation on competence, the National Curricular Guidelines for Medicine courses, guide that the organization of the curriculum should focus on the development of areas of competence, integrating content from real or simulated situations of professional practice (Brazil, 2014). This research aimed to analyze what the scientific literature presents about the possibilities of evaluating students in the competency-oriented curriculum in the health area. It was developed through an Integrative Literature Review, in the following databases: LILACS, BDENF, MEDLINE, ERIC and SciELO. Established as inclusion criteria: texts available online in full, primary research, in Portuguese, English and Spanish and that answered the research and exclusion question: theses, dissertations, editorials and literature review research. From the analysis of data obtained in 28 selected articles, three thematic categories emerged: 1. Different types of assessment, 2. Assessment of the reliability and validity of assessment instruments e 3. Need for training. This compilation highlighted the diversity of strategies and assessment instruments for assessing competence (s). Furthermore, the articles indicated that assessment methods must be consistent with the pedagogical proposals of their respective courses.

Author Biographies

Magali Aparecida Alves de Moraes Alves de Moraes, Faculdade de Medicina de Marília - Famema

Núcleo de avaliação da Famema

Luzmarina Aparecida Doretto Bracccialli Doretto Braccialli, Faculdade de Medicina de Marília

Núcleo de Avaliação da Famema

Odilon Marques de Almeida Filho Almeida Filho, Faculdade de Medicina de Marília

Núcleo de Avaliação da Famema

References

Aulet T. H., Moore J. S., Callas P. W., Nicholas C., & Hulme M. (2020). (En)trust me: Validating an assessment rubric for documenting clinical encounters during a surgery clerkship clinical skills exam. Am J Surg., 219(2), 258-262. https://doi. org/10.1016/j.amjsurg.2018.12.055.

Bloom B. S., Engelhart M. D., Furst E.J., Hill W. H., & Krathwohl D. R. (1956). Taxonomy of educational objectives. New York (NY): David Mckay.

Brasil. (2014). Diretrizes Curriculares Nacionais do Curso de Graduação em Medicina. Brasília: Ministério da Educação Disponível em: https://normativasconselhos.mec.gov.br/normativa/pdf/CNE_PAR_CNECPN62014.

Brits H., Bezuidenhout J., Van der Merwe L. J., & Joubert G. (2020). Assessment practices in undergraduate clinical medicine training: What do we do and how we can improve? Afr J Prim Health Care Fam Med., 12(1). https://doi. org./10.4102/phcfm.12i1.2341.

Butani L., Plant J., Barone M. A., & Dallaghan G. L. B. (2021). Entrustable Professional Activity-Based Assessments in Undergraduate Medical Education: A Survey of Pediatric Educators. Acad Pediatr., 21(5), 907-911. https://doi.org./10.1016/j.acap.2021.03.020.

Chirelli, M. Q., & Sordi M. R. L. (2021). Rev Bras Enferm., 74(Suppl5). https://doi.org./10.1590/0034-7167-2020-0979.

Ciardo A., Möltner A., Rüttermann S., & Gerhardt-Szép S. (2019). Students' self-assessment of competencies in the phantom course of operative dentistry. Eur J Dent Educ., 23(2), 204-211. https://doi.org./10.1111/eje.12422.

Couto L. B., Durand M. T., Wolff A. C. D., Restini C. B. A., Faria M. Jr, Romão G. S., & Bestetti R. B. (2019). Formative assessment scores in tutorial sessions correlates with OSCE and progress testing scores in a PBL medical curriculum. Med Educ Online, 24(1). https://doi. org./10.1080/10872981.2018.1560862.

Dart J., Twohig C., Anderson A., Bryce A., Collins J., Gibson S., Kleve S., Porter J., Volders E., & Palermo C. (2021). The Value of Programmatic Assessment in Supporting Educators and Students to Succeed: A Qualitative Evaluation. J Acad Nutr Diet., 121(9),1732-1740. https://doi.org./10.1016/j.jand.2021.01.013.

Dunne D., Green M., Tetrault J., & Barakat L. A. (2020). Development of a Novel Competency-Based Evaluation System for HIV Primary Care Training: the HIV Entrustable Professional Activities. J Gen Intern Med., 35(1), 331-335 https://doi.org./10.1007/s11606-019-04956-1.

Esteves A., McConnell M., Ferretti E., Garber A., & Fung-Kee-Fung K. (2021). "When in Doubt, Ask the Patient": A Quantitative, Patient-Oriented Approach to Formative Assessment of CanMEDS Roles. MedEdPORTAL., 21(17), 11169. https://doi.org./10.15766/mep_2374-8265.11169.

Famema. (2023). Faculdade de Medicina de Marília. Organograma Institucional. Marília. https://www.famema.br/institucional/ documentos/docs/Organograma% 20ap%C3%B3s%20reuni% C3%A3 o%20da%20congrega%C3%A7%C3%A3o%2012-05-2023.

Famema. (2021). Faculdade de Medicina de Marília. Caderno de avaliação: cursos de medicina e Enfermagem. Faculdade de Medicina de Marília. Marília.

Ferraz APCM, & Belhot RV. (2010). Taxonomia de Bloom: revisão teórica e apresentação das adequações do instrumento para definição de objetivos instrucionais. Gestão Prod. 17, 421-31. https://doi.org./10.1590/S0104-530X2010000200015.

Fincke, F., Prediger, S., Schick, C., Furstenberg, S., Spychala, N., OBerberat, P., Harendza, S., & Kadmon, M. (2020). Entrustable professional activities and facets of competence in a simulated workplace-based assessment for advanced medical students. EPUB, 42(9), 1019-1020. https://doi.org./10.1080/0142159x.2020.1779204.

Ganong, L. H. (1987). Integrative reviews of nursing research. Res Nurs Health., 10(1).

Hobday P. M., Borman-Shoap E., Cullen M. J., Englander R., & Murray K. E. (2021). The Minnesota Method: A Learner-Driven, Entrustable Professional Activity-Based Comprehensive Program of Assessment for Medical Students. Acad Med.,96(7S), S50-S55. https://doi.org./10.1097/ACM.0000000000004101.

Hu, J., Jones, A. Y. M., Zhou, X., Zhai, H., Ngai, S. P. C., Siu, K-C., & Dalton, M. (2020). Acceptance of the assessment of physiotherapy practice (Chinese) as a standardised evaluation of professional competency in chinese physiotherapy students: an observational study. BMC MED EDUC, 20(1), 108. https://doi.org./10.1186/s12909-020-02026-3.

Johnson N. R., Pelletier A., & Berkowitz L. R. (2020). Mini-Clinical Evaluation Exercise in the Era of Milestones and Entrustable Professional Activities in Obstetrics and Gynaecology: Resume or Reform? J Obstet Gynaecol Can., 42(6) 718-725. https://doi.org./10.1016/j.jogc.2019.10.002.

Kassab S. E., Du X., Toft E., Cyprian F., Al-Moslih A., Schmidt H., Hamdy H., & Abu-Hijleh M. (2019). Measuring medical students' professional competencies in a problem-based curriculum: a reliability study. BMC Med Educ., 19(1), 155. https://doi.org./10.1186/s12909-019-1594.

Kim, S., Choi, I., Yoon, B. Y., Kwon, M. J., Choi, S.-J.,Kim, S. H., Lee, J. T., & Rhee, B. D. (2019). How do medical students actually think while solving problems in three diferente types of clinical assessments in Korea: Clinical performance examination (CPX), multimedia case-based assessment (CBA), and modified essay question (MEQ). J Educ Eval Health Prof., 16(10). https://doi.org./10.3352/jeehp.2019.16.10.

Kumra T., McGuire M., Stein A., & Pahwa A. K. (2022).Telemedicine Clinical Skills Needs Assessment in Early Medical Students. Fam Med., 54(4), 294-297. https://doi.org./10.22454/FamMed.2022.904873.

Lemes, M. A., Marin, M. J. S., Lazarini, C. A., Bocchi, S. C. M., & Higa, E. F. R. (2021). Estratégias de avaliação em aprendizagem ativa no ensino superior em saúde: revisão integrativa. Rev. Bras. Enferm. 74 (2). https://doi.org./10.1590/0034-7167-2020-1055.

Lima V. V., Ribeiro E. C. O. (2022). Abordagem dialógica de competência: pressupostos e percurso metodológico para a construção de perfis na área da Saúde. Interface (Botucatu); 26, e210737. https://doi.org./10.1590/interface.210737.

Lockwood C., Porrit K., Munn Z., Rittenmeyer L., Salmão S., Bjerrum M., Loveday H., Carrier J., & Stannard D. (2020). Chapter 2: Systematic reviews of qualitative evidence. In: Aromataris E, Munn Z (Editors). JBI Manual for Evidence Synthesis. JBI. https://doi.org./10.46658/JBIMES-20-03.

McClintic J. A., Snyder C. L., & Brown K. M. (2018). Curricular Innovation in the Surgery Clerkship: Can Assessment Methods Influence Development of Critical Thinking and Clinical Skills? J Surg Educ., 75(5), 1236-1244.https://doi.org./10.1016/j.jsurg.2018.02.012.

Moher D, Liberati A, Tetzlaff J, & Altman DG. (2009). The PRISMA Group. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PloS Med. 2009; 6(7). https://doi.org/10.1371/journal.pmed.1000097.

Oudkerk Pool A., Govaerts M. J. B., Jaarsma D. A. D. C., & Driessen E. W. (2018). From aggregation to interpretation: how assessors judge complex data in a competency-based portfolio. Adv Health Sci Educ Theory Pract., 23(2), 275-287. https://doi.org./10.1007/s10459-017-9793-y.

Peters, H., Holzhausen, Y., Maaz, A., Driessen, E., & Czekleba, A. (2019). Introducing an assessment tool based on a full set of end-of-training EPAs to capture the workplace performance of final-year medical students. BMC Med Educ, 19(207), https://doi.org/10.1186/s12909-019-1600-4.

Postmes, L., Tammer F., Posthumus I., Wijnen-Meijer M., van der Schaaf M., & Ten Cate O. (2021). EPA-based assessment: Clinical teachers' challenges when transitioning to a prospective entrustment-supervision scale. Med Teach., 43(4), 404-410. https://doi.org./10.1080/0142159X.2020.1853688.

Sidebotham, M., Baird K., Walters C., & Gamble J. (2018). Preparing student midwives for professional practice: Evaluation of a student e-portfolio assessment item. Nurse Educ Pract., 32, 84-89. https://doi.org./10.1016/j.nepr.2018.07.008.

Silva, D. S. M., Gasparetto Sé, E. V. G., Lima,V. V., Borim. F. S. A., Oliveira, M. S., & Padilha R.Q. (2022). Metodologias ativas e tecnologias digitais na educação médica: novos desafios em tempos de pandemia. Rev Bras Educ Méd., 46 (2), e058. https://doi.org/10.1590/1981-5271v46.2-20210018.

Souza, M. T., Silva, M. D., & Carvalho, R. (2010). Integrative review: what is it? How to do it? Einstein. 8(1),102-6. https://doi.org./10.1590/s1679-45082010rw1134.

Stephens, M., & Ormandy, P. (2019). An Evidence-based Approach to Measuring Affective Domain Development. J Prof Nurs., 35(3), 216-223. https://doi.org./10.1016/j.profnurs2018.12.004.

Talwalkar, J. S., Murtha, T. D., Prozora, S., Fortin, A. H., Morrison, L.J. & Ellman M. S. (2020). Assessing Advanced Communication Skills via Objective Structured Clinical Examination: A Comparison of Faculty Versus Self, Peer, and Standardized Patient Assessors. Teach Learn Med., 32(3), 294-307. https://doi.org./10.1080/10401334.2019.1704763.

Violato, C., Cullen, M. J., Englander, R., Murray, K. E., Hobday, P. M., Borman-Shoap, E., & Ersan, O. (2021). Validity Evidence for Assessing Entrustable Professional Activities During Undergraduate Medical Education. Acad Med., 96( 7S), S70-S75. https://doi.org./10.1097/ACM.0000000000004090.

Yoo, D. M., Cho, A. R., & Kim, S. (2019). Evaluation of a portfolio-based course on self-development for pre-medical students in Korea. Educ Eval Health Prof., 16, 38. https://doi.org./ 10.3352/jeehp.2019.16.38.

Yu, J. H., Lee, M. J., Kim, S. S., Yang, M. J., Cho, H. J., Noh, C. K., Lee; G. H., Lee, S. K., Song, M. R., Lee, J. H., Kim, M., & Jung, Y. J. (2021). Assessment of medical students' clinical performance using high-fidelity simulation: comparison of peer and instructor assessment. BMC Med Educ., 21(1), 506. https://doi.org./10.1186/s12909-021-02952-w.

Yung, J. Q., & McClure, M. (2020). Fast, Easy, and good: assessing entrustable professional activities in psychiatry residents with a mobile APP. Acad. Med, 95(10), 1546-1549. https://doi.org/10.1097/acm.0000000000003390.

Zaidi, N. L. B., Kreitter, C. D., Castaneda, P. R., Schiller, J. H., Yang, J., Grum, C. M., Hammoud, M.M., Gruppen, L. D., & Santen, S. A. (2018). Generalizability of Competency Assessment Scores Across and Within Clerkships: How Students, Assessors, and Clerkships Matter. Acad Med, 93(8),1212-1217. https://doi.org./10.1097/ACM.0000000000002262.

Downloads

Published

2024-12-29

Issue

Vol. 17 No. 4 (2024)

Section

Article

License

Copyright (c) 2024 Elza de Fátima Ribeiro Higa, Magali Aparecida Alves de Moraes Alves de Moraes, Luzmarina Aparecida Doretto Bracccialli Doretto Braccialli, Odilon Marques de Almeida Filho Almeida Filho

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

The BRAJETS follows the policy for Open Access Journals, provides immediate and free access to its content, following the principle that making scientific knowledge freely available to the public supports a greater global exchange of knowledge and provides more international democratization of knowledge. Therefore, no fees apply, whether for submission, evaluation, publication, viewing or downloading of articles. In this sense, the authors who publish in this journal agree with the following terms: A) The authors retain the copyright and grant the journal the right to first publication, with the work simultaneously licensed under the Creative Commons Attribution License (CC BY), allowing the sharing of the work with recognition of the authorship of the work and initial publication in this journal. B) Authors are authorized to distribute non-exclusively the version of the work published in this journal (eg, publish in the institutional and non-institutional repository, as well as a book chapter), with acknowledgment of authorship and initial publication in this journal. C) Authors are encouraged to publish and distribute their work online (eg, online repositories or on their personal page), as well as to increase the impact and citation of the published work.