Assessing the Feasibility and Acceptability of Direct Observation of Procedural Skills (DOPS) in Internal Medicine: A Cross-Sectional Study

##plugins.themes.academic_pro.article.main##

Mariem Essouri
Yosr Daoud
Neirouz Toujeni
Imen Mariem Abbassi
Zeineb Teyeb
Naziha Khammassi

Abstract

Introduction: The assessment of clinical competencies is a fundamental component of competency-based medical education. Direct Observation of Procedural Skills (DOPS) is a workplace-based assessment method that evaluates learners’ performance during real clinical procedures while promoting a formative approach through immediate feedback.


Aim: To assess the feasibility and acceptability of DOPS among medical students and clinical teachers in a university Internal Medicine department.


Methods: We conducted a 15-week observational cross-sectional study involving 22 third-year medical students (DCEM3) assigned to the Internal Medicine department of Razi Hospital. The assessed procedure was the pathergy test. The evaluation covered eight domains: explanation of the indication and procedure, obtaining consent, preparation, aseptic technique, technical skills, communication, professionalism, and post-procedure management.


Results: The mean duration of a DOPS session was 14 minutes, including observation, documentation, and feedback. Competency levels were globally satisfactory in several domains, particularly in explaining the indication, aseptic technique, communication, and technical skills. Both students and teachers expressed good acceptance of the method and emphasized the value of direct observation and immediate feedback.


Conclusion: DOPS appears to be a feasible, well-accepted, and relevant method for assessing clinical competencies in Internal Medicine. Its progressive integration into clinical training programs may strengthen competency-based education and promote a culture of feedback.

Keywords:

DOPS, clinical competency assessment, medical education, direct observation , Internal Medicine, Tunisia

##plugins.themes.academic_pro.article.details##

Author Biographies

Mariem Essouri, Department of Internal Medicine. Razi Hospital, 2010, La Manouba, Faculty of Medicine of Tunis, University ofTunis el Manar, 1007, Tunis, Tunisia

University of Tunis El Manar
Faculty of Medicine of Tunis, 1007
Department of Internal Medicine
Razi Hospital, 2010
La Manouba, Tunisia

Yosr Daoud, Department of Internal Medicine. Razi Hospital, 2010, La Manouba, Faculty of Medicine of Tunis, University ofTunis el Manar, 1007, Tunis, Tunisia

University of Tunis El Manar
Faculty of Medicine of Tunis, 1007
Department of Internal Medicine
Razi Hospital, 2010
La Manouba, Tunisia

Neirouz Toujeni, Department of Internal Medicine. Razi Hospital, 2010, La Manouba, Faculty of Medicine of Tunis, University ofTunis el Manar, 1007, Tunis, Tunisia

University of Tunis El Manar
Faculty of Medicine of Tunis, 1007
Department of Internal Medicine
Razi Hospital, 2010
La Manouba, Tunisia

Imen Mariem Abbassi, Department of Internal Medicine. Razi Hospital, 2010, La Manouba, Faculty of Medicine of Tunis, University ofTunis el Manar, 1007, Tunis, Tunisia

University of Tunis El Manar
Faculty of Medicine of Tunis, 1007
Department of Internal Medicine
Razi Hospital, 2010
La Manouba, Tunisia

Zeineb Teyeb, Department of Internal Medicine. Razi Hospital, 2010, La Manouba, Faculty of Medicine of Tunis, University ofTunis el Manar, 1007, Tunis, Tunisia

University of Tunis El Manar
Faculty of Medicine of Tunis, 1007
Department of Internal Medicine
Razi Hospital, 2010
La Manouba, Tunisia

Naziha Khammassi, Department of Internal Medicine. Razi Hospital, 2010, La Manouba, Faculty of Medicine of Tunis, University ofTunis el Manar, 1007, Tunis, Tunisia

University of Tunis El Manar
Faculty of Medicine of Tunis, 1007
Department of Internal Medicine
Razi Hospital, 2010
La Manouba, Tunisia

References

  1. Qi D, Zhu L, Wang S, et al. Application of formative evaluation with DOPS in graduation internship in general practice department. Chin Gen Pract. 2020;23(25):3216–9.
  2. Wang Y, Chen G, Chen J, et al. Application of Mini-CEX combined with DOPS in standardized training of community outpatient
  3. residents. BMC Med Educ. 2024;24:780.
  4. Profanter C, Perathoner A. DOPS (Direct Observation of Procedural Skills) in undergraduate skills-lab: does it work? Analysis of skills-
  5. performance and curricular side effects. GMS Z Med Ausbild. 2015;32(4):Doc45.
  6. Rela M, Price T. Review of the validity of DOPS as an assessment tool for the procedural skills of surgical trainees. Ann R Coll Surg
  7. Engl. 2023;105(7):599–606
  8. Kumar N, Singh NK, Rudra S, Pathak S. Effect of formative evaluation using Direct Observation of Procedural Skills in assessment of
  9. postgraduate students of obstetrics and gynecology: prospective study. J Med Educ Curric Dev. 2017;5:1–5.
  10. Naeem N. Validity, reliability, feasibility, acceptability and educational impact of direct observation of procedural skills
  11. (DOPS). J Coll Physicians Surg Pak. 2013 Jan;23(1):77–82.
  12. Fromme HB, Karani R, Downing SM. Direct observation in medical education: a review of the literature and evidence for validity. Mt
  13. Sinai J Med. 2009 Aug;76(4):365–71.
  14. Bamforth M, Agarwal M. Direct observation of procedural skills (DOPS). Workplace-based assessments in psychiatry. 2007; p. 56.
  15. Miller GE. The assessment of clinical skills/competence/ performance. Acad Med. 1990 Sep;65(9 Suppl):S63–7.
  16. Shah Gheybi Sh, et al. Evaluation of the effects of direct observation of procedural skills (DOPS) on clinical externship students’ learning level in obstetrics ward of Kurdistan University of Medical Sciences. 2009;29–33.
  17. FMH, ISFM. Trois années d’expérience avec l’évaluation en milieu de travail (Mini-CEX et DOPS) dans la formation postgraduée
  18. médicale. Bull Méd Suisses. 2010;91:4.
  19. Dabir S, Hoseinzadeh M, Mosaffa F, Hosseini B, Dahi M, Vosoughian M,et al. The effect of repeated direct observation of procedural skills (R-DOPS) assessment method on the clinical skills of anesthesiology residents. Anesthesiol Pain Med. 2021;11(1):e111074.