Implementing work place based assessment: The modified direct observation of procedural skills (DOPS) across medical specialties - An experience from a developing country

To assess the skill level of residents regarding central venous catheterisation insertion, and to assess the reliability of scores in a simulated situation. The quasi-experimental study with pre- and post-test design was conducted from February to June 2013 at the Aga Khan University, Karachi, and comprised four workshops attended by residents. The workshops were video-recorded for feedback and self-assessment. At the end of the workshops, knowledge and procedural skills were assessed using a self-generated 38-item, task-specific instrument after ensuring its content validity. Data was analysed using SPSS 19. There were 40 residents in the sample. The self-generated instrument was reliable with Cronbach's alpha value 0.83 and inter-rater coefficient 0.79. There was significant improvement in the skills level post-intervention compared to the baselines mean values (p=0.001). The subjects were satisfied with the workshops, as indicated by a mean score of 8.83±1.367. The workshops appeared to improve the central venous catheterisation insertion skills of the residents.