Revista de Odontologia da UNESP
https://revodontolunesp.com.br/article/doi/10.1590/1807-2577.00525
Revista de Odontologia da UNESP
Original Article

Comparison of assessment methods in dental education

Comparação de métodos de avaliação no ensino odontológico

Denise Campos AMARAL; Diogo Rodrigues CRUVINEL; Gabriella Lopes DE REZENDE BARBOSA; Carolina Cintra GOMES

http://dx.doi.org/10.1590/1807-2577.00525 Rev. odontol. UNESP, vol.54, e20250005, 2025
PDF
Downloads: 1
Views: 80

Abstract

Introduction: Assessment in dental education, especially in competency-based curricula, should reflect the different learning domains by combining methodologies for a more complete assessment of students.

Objective: To compare the outcomes of three assessment methods (written, clinical and Objective Structured Clinical Exam - OSCE) used in Dental Clinics disciplines.

Material and method: Two samples were used for this performance analysis: 179 students attending four different dental clinics disciplines in the same semester; and 33 students from the same class during their 5th, 6th, 7th and 8th periods, taking the four disciplines along four semesters sequentially. From the mean grades obtained by the students in each examination, the comparative analyses were carried out using repeated measures analysis of variance.

Result: The results showed similarity between the theoretical and OSCE evaluations, which differ significantly from the results obtained in the clinical evaluation. Comparing the performance of the same students during sequential periods, the results showed a statistically significant difference in all evaluations, with periods of positive progression and decrease in student performance along the semesters.

Conclusion: Written and OSCE assessments were similar while clinical evaluations presented significantly higher grades. Therefore, teachers should be aware of the particularities of the assessment methods and apply them, solely or combined, in order to obtain the best outcomes from the students. Evaluation methods should value teacher orientation and consider the validity of subjective evaluation, paying attention to the educational value of the assessments.

Keywords

Educational measurement; teaching; academic performance

Resumo

Introdução: A avaliação no ensino odontológico, especialmente em currículos baseados em competências, deve refletir os diferentes domínios de aprendizagem combinando metodologias para uma avaliação mais completa dos estudantes.

Objetivo: Comparar os resultados de três métodos de avaliação (escrito, clínico e Exame Clínico Objetivo Estruturado - OSCE) utilizados em disciplinas de Clínica Odontológica.

Material e método: Duas amostras foram utilizadas para esta análise de desempenho: 179 alunos que cursavam quatro disciplinas diferentes de clínica odontológica no mesmo semestre; e 33 alunos da mesma turma durante seus 5º, 6º, 7º e 8º períodos, cursando as quatro disciplinas ao longo de quatro semestres sequencialmente. A partir das notas médias obtidas pelos alunos em cada exame, as análises comparativas foram realizadas utilizando análise de variância de medidas repetidas.

Resultado: Os resultados mostraram similaridade entre as avaliações teórica e OSCE, que diferem significativamente dos resultados obtidos na avaliação clínica. Comparando o desempenho dos mesmos alunos durante períodos sequenciais, os resultados mostraram diferença estatisticamente significativa em todas as avaliações, com períodos de progressão positiva e queda no desempenho dos alunos ao longo dos semestres.

Conclusão: As avaliações escritas e do OSCE foram semelhantes, enquanto as avaliações clínicas apresentaram notas significativamente mais altas. Portanto, os professores devem estar cientes das particularidades dos métodos de avaliação e aplicá-los, isoladamente ou combinados, para obter os melhores resultados dos alunos. Os métodos de avaliação devem valorizar a orientação do professor e considerar a validade da avaliação subjetiva, atentando para o valor educacional das avaliações.

Palavras-chave

Avaliação educacional; ensino; desempenho acadêmico

References

1 Savin-Baden M. Problem-based learning in higher education: untold stories. Buckingham: The Society for Research into Higher Education & Open University Press; 2000.

2 Plasschaert AJ, Holbrook WP, Delap E, Martinez C, Walmsley AD. Profile and competences for the european dentist. Eur J Dent Educ. 2005 Aug;9(3):98-107. http://doi.org/10.1111/j.1600-0579.2005.00369.x. PMid:15982379.

3 Patel US, Tonni I, Gadbury-Amyot C, Van der Vleuten CPM, Escudier M. Assessment in a global context: An international perspective on dental education. Eur J Dent Educ. 2018 Mar;22(S1 Suppl 1):21-7. http://doi.org/10.1111/eje.12343. PMid:29601682.

4 van der Vleuten CP, Schuwirth LW. Assessing professional competence: from methods to programmes. Med Educ. 2005 Mar;39(3):309-17. http://doi.org/10.1111/j.1365-2929.2005.02094.x. PMid:15733167.

5 van Merrienboer JJG. Training complex cognitive skills: a four-component instructional design model for technical training. Englewood Cliffs, NJ: Educational Technology Publications; 1997.

6 Cowpe J, Plasschaert A, Harzer W, Vinkka-Puhakka H, Walmsley AD. Profile and competences for the graduating European dentist - update 2009. Eur J Dent Educ. 2010 Nov;14(4):193-202. http://doi.org/10.1111/j.1600-0579.2009.00609.x. PMid:20946246.

7 Conceição HCF. Avaliação de competências através de OSCE. [Internet]. 2009 [cited 2024 Dec 1]. Available from: https://www.uc.pt/site/assets/files/1469069/essencias13.pdf.

8 Bok HG, Teunissen PW, Favier RP, Rietbroek NJ, Theyse LF, Brommer H, et al. Programmatic assessment of competency-based workplace learning: when theory meets practice. BMC Med Educ. 2013 Sep;13(1):123. http://doi.org/10.1186/1472-6920-13-123. PMid:24020944.

9 Nulty DD, Short LM, Johnson NW. Improving assessment in dental education through a paradigm of comprehensive care: a case report. J Dent Educ. 2010 Dec;74(12):1367-79. http://doi.org/10.1002/j.0022-0337.2010.74.12.tb05012.x. PMid:21123504.

10 Bloom BS, Englehart MD, Furst EJ, Hill WH, Krathwohl DR. Taxonomy of educational objectives: the classiication of educational goals. Handbook 1: cognitive domain. New York: Longman; 1956.

11 Graham R, Zubiaurre Bitzer LA, Mensah FM, Anderson OR. Dental student perceptions of the educational value of a comprehensive, multidisciplinary OSCE. J Dent Educ. 2014 May;78(5):694-702. http://doi.org/10.1002/j.0022-0337.2014.78.5.tb05721.x. PMid:24789829.

12 Gadbury-Amyot CC, Overman PR. Implementation of portfolios as a programmatic global assessment measure in dental education. J Dent Educ. 2018 Jun;82(6):557-64. http://doi.org/10.21815/JDE.018.062. PMid:29858251.

13 Tonni I, Gadbury-Amyot CC, Govaerts M, Ten Cate O, Davis J, Garcia LT, et al. ADEA-ADEE shaping the future of dental education iii: assessment in competency-based dental education: Ways forward. J Dent Educ. 2020 Jan;84(1):97-104. http://doi.org/10.1002/jdd.12024. PMid:31977092.

14 Lurie SJ. History and practice of competency-based assessment. Med Educ. 2012 Jan;46(1):49-57. http://doi.org/10.1111/j.1365-2923.2011.04142.x. PMid:22150196.

15 Touchie C, Ten Cate O. The promise, perils, problems and progress of competency-based medical education. Med Educ. 2016 Jan;50(1):93-100. http://doi.org/10.1111/medu.12839. PMid:26695469.

16 Burrows RS. Understanding self-assessment in undergraduate dental education. Br Dent J. 2018 Jun;224(11):897-900. http://doi.org/10.1038/sj.bdj.2018.437. PMid:29855594.

17 Albino JE, Young SK, Neumann LM, Kramer GA, Andrieu SC, Henson L, et al. Assessing dental students’ competence: best practice recommendations in the performance assessment literature and investigation of current practices in predoctoral dental education. J Dent Educ. 2008 Dec;72(12):1405-35. http://doi.org/10.1002/j.0022-0337.2008.72.12.tb04620.x. PMid:19056620.

18 Terry R, Hing W, Orr R, Milne N. Do coursework summative assessments predict clinical performance? A systematic review. BMC Med Educ. 2017 Feb;17(1):40. http://doi.org/10.1186/s12909-017-0878-3. PMid:28209159.
 

Submitted date:
02/20/2025

Accepted date:
04/07/2025

68263e25a953955463354144 rou Articles
Links & Downloads
1807-2577 (Electronic)
Rev. odontol. UNESP ©2025 All rights reserved.

Rev. odontol. UNESP

Share this page
Page Sections