Home            Past Issues            About IP            About IAP           Author Information            Subscription            Advertisement              Search  

   
medical education

Indian Pediatr 2015;52: 787-794

Teaching and Assessing Clinical Reasoning Skills

 

*Jyoti Nath Modi, $Anshu, #Piyush Gupta and Tejinder Singh

From Departments of *Obstetric and Gynecology, People’s College of Medical Sciences and Research Centre, Bhopal;
$Pathology, Mahatma Gandhi Institute of Medical Sciences, Sevagram; #Pediatrics, University College of Medical Sciences, New Delhi; and CMCL-FAIMER Regional Institute, Christian Medical College, Ludhiana, Punjab; India.

Correspondence to: Dr Tejinder Singh, Professor of Pediatrics and Medical Education, Christian Medical College,
Ludhiana 141 008, India.
Email: [email protected]



Clinical reasoning is a core competency expected to be acquired by all clinicians. It is the ability to integrate and apply different types of knowledge, weigh evidence critically and reflect upon the process used to arrive at a diagnosis. Problems with clinical reasoning often occur because of inadequate knowledge, flaws in data gathering and improper approach to information processing. Some of the educational strategies which can be used to encourage acquisition of clinical reasoning skills are: exposure to a wide variety of clinical cases, activation of previous knowledge, development of illness scripts, sharing expert strategies to arrive at a diagnosis, forcing students to prioritize differential diagnoses; and encouraging reflection, metacognition, deliberate practice and availability of formative feedback. Assessment of clinical reasoning abilities should be done throughout the training course in diverse settings. Use of scenario based multiple choice questions, key feature test and script concordance test are some ways of theoretically assessing clinical reasoning ability. In the clinical setting, these skills can be tested in most forms of workplace based assessment. We recommend that clinical reasoning must be taught at all levels of medical training as it improves clinician performance and reduces cognitive errors.

Keywords: Assessment, Clinical problem solving, Clinical reasoning, Diagnostic reasoning, Medical decision-making, Medical education.


T
he challenge of medicine lies in its complexity. One of the most important skills that a doctor needs to have is the ability to translate the unorganized information received from the patient into the language of medicine. In a short period of time, physicians are expected to work their way, starting from the presenting symptoms of patients to the diagnosis, and plan of management pertinent to the patient’s specific context. They also need to decide about which direction to proceed in, which information to discard, and when to stop looking for more information. This calls for a phenomenal degree of observation, comprehension, recall, alertness and reasoning.

What is Clinical Reasoning?

Clinical reasoning has been defined as ‘ability to sort through a cluster of features presented by a patient and accurately assign a diagnostic label, with the develop-ment of an appropriate treatment strategy as the end goal’ [1]. Clinical reasoning has also been defined as ‘the ability to integrate and apply different types of knowledge, to weigh evidence, critically think about arguments and to reflect upon the process used to arrive at a diagnosis’ [2,3]. The terminology may vary to include terms such as ‘clinical/medical problem solving’ or ‘diagnostic reasoning’, but the essence remains that it is a complex cognitive process leading to meaningful interpretation of patients’ problems and formulation of an effective management plan.

Experts agree that clinical reasoning is an essential skill that must be developed during the early years in training and further refined during subsequent years of practice. It must be taught at all levels of medical training [4-6]. Over the last few decades, it has been considered a crucial aspect of physician competence and is explicitly included in most medical schools’ documents [6]. The Medical Council of India’s proposed Graduate Medical Education Regulations (2012) also lists ‘effective clinical problem solving’ as one of the skills to be developed in medical graduates [7].

Advantages of Learning Clinical Reasoning Skills

Clinical reasoning skills not only help physicians in reaching an appropriate diagnosis, but are also the key to preventing diagnostic errors. Diagnostic errors in medicine may occur in 5-15% of cases [8]; two-thirds of these are cognitive errors which include flaws in diagnostic reasoning, and decision making. Deeper understanding of the processes involved in acquisition of clinical reasoning skills will thus help in reducing cognitive errors.

Process of Clinical Reasoning

Educational psychologists have explored the process of medical decision making extensively, and these perspectives have changed over time [6, 9]. It is not within the scope of this article to discuss these theories, their evolution or evidence. We shall restrict ourselves to merely mentioning one of the models of clinical reasoning- namely Croskerry’s dual processing theory [10, 11].

Dual Processing Theory

Croskerry’s model proposes that clinicians use two types of cognitive processes to arrive at a diagnosis: System 1 approaches and System 2 approaches. System 1 approaches are intuitive, draw on past experience, and may be based entirely on pattern recognition or heuristics [10, 11]. On the other hand, System 2 approaches are slower, analytical, more deliberate and involve deeper thinking (Table I). The two processes are not mutually exclusive.

TABLE I Dual Processing Theory: System 1 and System 2 Approaches

Clinicians tend to switch between both approaches depending on the complexity of the case [12]. In the learning phase, one tends to use more of System 2 or analytical approaches, and as expertise sets in there is a tendency to use more of System 1 or pattern recognition approaches. However even when experts encounter challenging cases, they tend to revert to System 2 approaches. During teaching, more emphasis is laid on System 2 processes, but in practice, physicians use System 1 processes more often. Hence there is need to train learners in System 1 approaches right from the beginning.

Educational Strategies to Teach Clinical Reasoning

Problems with clinical reasoning often occur because of inadequate knowledge of the disease, failure to activate prior knowledge, flaws in data gathering and improper approaches to information processing [5]. It is a challenge for clinical educators to diagnose the learner’s approach to clinical reasoning and guide them towards correct approaches.

Clinical reasoning is perhaps best taught during the course of a clinical encounter either conducted by the physician-teacher (for demonstration), or preferably during observation of a clinical encounter being carried out by the student. Clinical case presentations, case based discussions/ chart stimulated recall, clinical problem solving exercises and structured case presentation models like SNAPPS (refer Box 1) and One Minute Preceptor (all discussed in detail later) are good settings for teaching clinical reasoning skills.

We enumerate some strategies which when used consciously by educators will encourage students to learn clinical reasoning approaches (Table II) [13,14].

TABLE II Educational Strategies to Encourage Clinical Reasoning

Exposure to a wide variety of clinical conditions: Learning is contextual. Success in solving one kind of clinical problem is a poor predictor of success when faced with another clinical situation. A student thus needs exposure to a wide variety and large numbers of clinical cases during training [1, 6]. Students can learn prototypes of different diseases by this approach [15].

Activation of prior knowledge: Asking students for their reasoning based on pathophysiologic knowledge also enables them to recall and contextualize relevant basic sciences concepts [16, 17].

Emphasize forceful features: Many clinical conditions may be recognized by certain ‘key features’ or ‘forceful features’ or ‘anchor points’. Students must be asked to observe these forceful features that serve as trigger in the memory for recognition of the condition when encountered again [13]. Pattern recognition based on above helps the physicians not only in identification of clinical condition but also in discriminatory thinking processes [9].

Categorization and illness scripts: It is impossible to learn the frequency of every sign and symptom of each disease. One of the basic differences between the approaches of experts and novices is that experts are able to mentally categorize diseases in a logical manner [18]. The expert’s mind stores the information pertaining to clinical conditions or diseases in the form of ‘illness scripts’– or the predictable details of the condition such as predisposing factors, clinical presentation, complications, etc. [1, 19]. They learn to retrieve and apply this information reflexively.

Students need to be taught or exposed to clinical cases in a manner that they gradually develop these mental prototypes of disease or ‘illness scripts’. This can be done by guiding learners’ thought processes by way of asking relevant questions. These questions should encourage them to (a) propose differential diagnoses based on minimal clinical details; (b) modify diagnostic hypothesis as more information is available; and (c) justify or refute hypotheses based on their background knowledge or by asking them to compare and contrast most likely differential diagnoses [13,19]. Another way of teaching students to build on their illness scripts is to ask them to reflect on a previous patient with similar findings and compare presentations.

Two models of structured case presentations which encourage building of illness scripts or mental schemata are discussed here –the SNAPPS model, and the One Minute Preceptor (OMP) model. These can be utilized for teaching as well for formative assessment and are designed for use by the physician-teacher in a busy office or out-patient setting [20].

Box 1: SNAPPS Model for Structured Case Presentation

Summarize the case

Narrow the differential diagnosis

Analyse the differentials

Probe the preceptor about uncertainties

Plan management for the patient

Select case related issues for self study

• SNAPPS model (Box 1) can help learners build illness scripts essentially by way of comparing differential diagnoses and clarifications of uncertainties [21]. This method encourages expression of intuitive as well as analytical thinking and promotes self-reflection by the student [20, 21].

• The One Minute Preceptor (OMP) model is another useful model of structured clinical case discussion. In this model, the student presents a case, he/she is then asked to commit to a diagnosis, and is probed for reasoning for the same [22]. The preceptor, now aware of patient as well as student’s diagnosis, teaches general rules (e.g. key features, principles of management, effective communication). The final two steps are to reinforce what was done well by the student and to correct the mistakes made. Usually it takes about 10 minutes (arbitrary division of time could be: 6 minutes for case presentation, 3 minutes for questioning and 1 minute for teaching the general rule and feedback) [23]. Despite being a teacher-initiated model, it drives the student to propose and justify the diagnosis, employing appropriate clinical reasoning skills by the learner.

Use of checklists has also been mooted to help in avoiding errors of omission [24].

Formative feedback: The role of providing effective formative feedback to the learner is the single most important feature which affects learning. Both SNAPPS and OMP models have an inherent component of providing feedback to the students.

Encourage learners to use both System 1 and System 2 approaches: There is often a mismatch between what we know about diagnostic reasoning and the way we teach our students. We have already discussed that expert clinicians first make use of intuitive processes, and go to analytical processes only later when the case does not fit our illness scripts. We should make a deliberate effort to promote intuitive thinking by asking the students at periodic intervals during the presentation (i.e. when he still does not have the complete clinical history or physical findings), the various possibilities that can be considered. As each new piece of information is presented as the history or physical finding, this list should change. The knowledge of epidemiology further contributes to speed and accuracy of diagnosis. Students should be trained to utilize the epidemiological data such as seasonal, geographical or demographic variation of disease conditions for narrowing down the diagnosis [25, 26]. Students must learn to prioritize in a list of differential diagnoses in a given context, enumerating points in favor and against each diagnosis. They should be encouraged to explain the reason why any further particular information is being sought, and how they arrived at a particular conclusion [27].

Another method, the Clinical Problem Solving (CPS) exercise serves as a good setting to demonstrate clinical reasoning. An expert physician is presented an unknown case in a stepwise fashion. During the course of an interactive discussion between the expert and the audience, the diagnostic process and its nuances are demonstrated [28].

Reflection and metacognition: Students must be encouraged and provided an opportunity to reflect on their diagnostic approach, and think about what they could be missing. Morbidity and mortality conferences are a good place to do this. Residents can be asked to reflect on their delivery of patient care based on actual case records (case based discussions) or on the discharge papers of patients (chart stimulated recall) [29]. Portfolios may also be useful in achieving this purpose. Such a metacognitive approach may help learners to recognize the need to slow down and avoid errors that occur due to premature closure of reasoning [30].

Deliberate practice: Just like a musician needs to practise again and again to play well, clinicians too need to hone their skills through training activities which are designed to maximize improvement. Ericsson called these activities ‘deliberate practice’ [31]. Deliberate practice includes finding opportunities for repeated practice, requesting honest feedback on performance at frequent intervals, maximizing learning from each case, reflecting on feedback and errors to improve performance and using mental practice to support clinical experiences. This can be done during regular clinical activities such as, asking students to report back during the morning rounds or after an emergency floor/ call duty.

Assessment of Clinical Reasoning Ability

The assessment of clinical reasoning is challenging as these skills are not measurable and must be inferred from behavior. As clinical reasoning is context specific, it has to be assessed across multiple domains, on multiple clinical scenarios, using multiple assessment methods to draw meaningful and valid interpretations. Moreover, these skills should be assessed throughout the course. Learning strategies for developing clinical reasoning rely heavily on feedback and reflection, and this is possible only when continuous ongoing formative assessment is in place.

The assessment of clinical reasoning can be carried out either in an authentic workplace-based clinical setting or outside it. The standardization of assessment, reliability, feasibility and resource efficacy may appear higher for assessments carried out in formal examination settings. However, assessment carried out in authentic clinical settings inherently scores higher in terms of validity and educational impact. Reliability of these assessments can be improved by increasing the number of clinical encounters. The issue of feasibility can also be addressed by structured assessment tools such as the mini clinical evaluation exercise (mini-CEX). Usefulness of some methods in assessment of clinical reasoning ability is discussed below:

1. Multiple Choice Questions (MCQ)

A well blueprinted MCQ-based examination has the potential of assessing wide content areas across different contexts in a short time. Simple recall type MCQs contribute little to assessment of medical decision making. However they can be improved to explore clinical problem solving ability by making them contextual. This is done by inserting clinical scenarios (Box 2).

Box 2: Converting a Recall type MCQ into a Higher Order MCQ

Recall type MCQ:

The commonest cause of childhood anemia in India is:

a) Nutritional anemia b) Thalassemia major

c) Sickle cell disease d) Aplastic anemia

Higher order Scenario-based MCQ:

A two year old boy presents with severe pallor. He has been fed on milk-based diet. Anthropometry revealed weight for length below -3 Z score and length for age between -2 to -3 Z score. The child also has tachypnea, tachycardia, angular stomatitis, and koilonychia. There is no significant lymphadenopathy. Liver is palpable 5 cm below costal margin. Spleen is not palpable. Rest of the examination is normal. The most likely cause of anemia in this child is:

a) Nutritional anemia b) Thalassemia major

c) Sickle cell disease d) Aplastic anemia

Extended matching questions (EMQs) are also good for testing reasoning ability. Here learners have to pick the answers to context-specific clinical scenarios around a single theme from a list of options [32]. An example can be seen in Box 3.

Box 3: Extended Matching Questions

Consider the following options

A. Nutritional Anemia

B. Thalassemia minor

C. Thalassemia major

D. Sickle cell trait

E. Sickle cell disease

F. Hookworm infestation

G. Aplastic Anemia

Lead in question: For each child with anemia, select the most appropriate diagnosis:

Q. 1: A two-year-old girl presented with severe anemia, icterus, hepatospenomegaly and failure to thrive. Her malar bones were prominent. She has a history of receiving two blood transfusions in the last year.

Key: C

Q. 2: A five-year-old boy presents with increasing pallor for 1 month and cutaneous bleeds for 7 days. Child is febrile. There is severe pallor but no lymphadenopathy. Liver and spleen are not enlarged. Child has been consuming 1300 kcal daily including food items from all the four food groups.

Key: G

2. Key Feature Test

These are clinical scenario-based questions that focus on critical steps in diagnosing or managing a particular clinical condition. These test a step in which examinees are most likely to make errors or a challenging aspect of the diagnosis and management in practice. The questions are designed as case scenarios to prompt learners to identify the key clinical feature in a clinical presentation and plan essential steps in diagnostic and management strategies [33]. An example is shown in Box 4.

Box 4: Key Feature Test

An 18-month-old girl presented to emergency with loose stools of 4 days duration. The weight for length of the child was below -3Z score. Peripheral pulses were weak and poorly palpable. Extremities and abdomen were cold to touch.

Q1. Provide a list of 2 problems that need immediate attention in this child.

[Score key: The question carries 2 marks. 1 mark is awarded each for any of the following answers: severe dehydration, shock/septic shock, hypothermia. Any other response (such as diarrhea, dehydration, gastroenteritis, hypoglycemia, electrolyte imbalance, malnutrition) will carry minus 1 mark].

Q2. Outline the three most important life-saving measures in managing this child.

[Score key: The question carries 3 marks. 1 mark is awarded for each of the following answers; Warm the child by placing under radiant warmer; Secure IV access and provide bolus fluid (N/2 saline or Ringer lactate); Start systemic (IV) antibiotics. Any other response will carry minus 1 mark].

3. Script Concordance Test (SCT)

This is based on the principle that the steps in the clinical reasoning process can be assessed and compared to the reasoning ability of a panel of experts [34]. The test design conforms to the possible organizational structure of illness scripts in the minds of the experts.

In Step 1, short ill-defined clinical scenario is first provided and the examinee’s opinion is sought in terms of diagnostic hypothesis or investigation or judgment. In Step 2, a new piece of information is provided (clinical feature, test result, disease progression etc.). The examinee is then asked how this new piece of information affects their initial judgment. The decision making process of the learners is reflected in their responses at the addition or availability of each new piece of information. Learners’ responses are scored using the responses by a panel of experts on the same case as a reference [9, 19, 34]. An example of SCT is shown in Box 5.

Box 5: Design and Example of Script Concordance Test (SCT)

[Step 1: Clinical Scenario] A four year old girl presents to the outpatient department with history of fever and sore throat since the last 3 days.

[Step 2: Diagnostic hypotheses] [Step 3: Additional information provided] [Step 4: Change in clinical  judgment]
If you were thinking: And then on subsequent interview This diagnosis becomes: (Use
and examination, you found that: the scale below)*
1. Viral pharyngitis •  Fever was high grade; -2 ,  -1,  0,  +1,  +2
•  She had difficulty in swallowing  
2. Streptococcal sore throat •  Recently developed red rash -2 ,  -1,  0,  +1,  +2
•  Neck glands palpable  
3. Diphtheria •  Tonsils enlarged and with a white coating -2 ,  -1,  0,  +1,  +2

*-2 =Ruled out or almost ruled out; -1 = Less likely; 0= Neither more nor less likely; +1 = More likely; +2 = Certain or almost certain.

4. Oral/ Viva voce Examination

Despite being resource-intensive, oral examinations are ubiquitous in Indian medical schools. Though they are often reduced to mere recall of facts, they have the potential of being utilized for assessing clinical reasoning and medical decision making. Clinical scenario based questions that probe the analytical skills of the examinee may be utilized. Further, multiple clinical scenarios may be used to assess across subject areas [32].

5. Long Case Examination

Long case remains the mainstay of most clinical examinations conducted in our country. Usually the student works-up an allotted case (unobserved) and presents the same to the assessor. The assessor then asks clarifying questions or may ask to demonstrate a clinical sign. Though the long case examination is effort-intensive as well as time-consuming, it provides an oppportunity to the examiner to assess the clinical reasoning process of the learner by asking appropriate questions. Structuring of long case, like in Objective Structured Long Examination Record (OSLER)- may improve the reliability of the long case, make it time efficient as well as impart it the valuable formative feedback function [35].

6. Mini-Clinical Evaluation Exercise (mini-CEX)

This method involves observing the learner during an actual clinical encounter. This exercise could be observed on an out-patient, inpatient or in an emergency-room setting. The assessor scores the performance of the learner on a standard scoring sheet (global rating) containing items pertaining to seven core clinical skills (medical interviewing, physical examination, professionalism, clinical judgment, counseling, organization/ efficacy and overall clinical competence) [36]. However all skills need not be assessed in a single encounter. The assessor then provides an immediate and contextual feedback. Scores of ‘clinical judgment’ are likely to reflect clinical reasoning ability.

7. Portfolios

These are case logs maintained by the student along with their reflective and narrative writing. They are able to offer rich and authentic evidence of learners’ achievements and developments. When used properly, they can be suitable for monitoring and assessing learner competence and growth [29, 37].

Faculty Development

Faculty need to be sensitized about their role in facilitating learning and promoting development of clinical reasoning skills in students. Teachers need to consciously share their own clinical problem solving approaches. This guides learners through the developmental phases of this skill acquisition [38]. Additionally, faculty development initiatives are needed to train teachers in assessment of clinical reasoning skills and in giving effective feedback. Designing and conducting assessment to test reasoning ability requires a great deal of team work among experts.

Conclusions

Clinical reasoning skills are core competencies to be acquired and demonstrated by every physician. Conscious and sustained efforts are needed to encourage training medical graduates in the acquisition of these crucial skills.

Contributors: TS: conceptualized the draft; JNM, Anshu, TS: wrote the manuscript; PG: provided critical comments and edited the manuscript.

Funding: None; Competing interests: None stated.

References

1. Eva KW. What every teacher needs to know about clinical reasoning. Med Educ. 2004;39:98-106.

2. Anderson KJ. Factors affecting the development of undergraduate medical students’ clinical reasoning ability. PhD Thesis. The University of Adelaide, 2006; 1-4.

3. Linn A, Khaw C, Kildea H, Tonkin A. Clinical reasoning. A guide to improving teaching and practice. Aust Fam Physician. 2012;41:18-20.

4. Elstein AS. Thinking about diagnostic thinking: a 30 year perspective. Adv Health Sci Educ Theory Pract. 2009;14:7-18.

5. Kassirer JP. Teaching clinical reasoning: case-based and coached. Acad Med 2010;85:1118-24.

6. Norman G. Research in clinical reasoning: past history and current trends. Med Educ. 2005;39:418-27.

7. Medical Council of India Regulations on Graduate Medical Education 2012. Available from: http://www.mciindia.org/tools/announcement/Revised_GME_2012.pdf . Accessed October 2, 2014.

8. Graber ML. Educational strategies to reduce diagnostic error: can you teach this stuff. Adv Health Sci Educ Theory Pract. 2009;14:63-9.

9. Grant J, Anshu, Burch V, Zachariah A. Learning clinical problem solving. FAIMER-Keele Master’s in Health Professions Education: Accreditation and Assessment. Module 6, Unit 6. FAIMER Centre for Distance Learning. London: CenMEDIC;2014.

10. Croskerry P. The theory and practice of clinical decision making. Can J Anesth. 2005;52:R1-R8.

11. Pelaccia T, Tardif J, Emmanuel T, Charlin B. An analysis of clinical reasoning through a recent and comprehensive approach: the dual process theory. Medical Education Online. 2011;16. Available from: www.ncbi.nlm. nih.gov/pmc/articles/PMC3060310/. Accessed May18, 2015.

12. Norman G. Dual processing and diagnostic errors. Adv Health Sci Educ Theory Pract. 2009;14:37-9.

13. Bowen JL. Educational strategies to promote clinical diagnostic reasoning. N Engl J Med. 2006;355:2217-25.

14. Rencic J. Twelve tips for teaching clinical reasoning. Med Teach. 2011;33:887–92.

15. Bordage G. Prototypes and semantic qualifiers: From past to present. Med Educ. 2007;41:1117-21.

16. Woods NN. Science is fundamental: The role of biomedical knowledge in clinical reasoning. Med Educ. 2007;41:1173-7.

17. Woods NN, Brooks LR, Norman GR. The role of biomedical knowledge in diagnosis of difficult clinical cases. Adv Health Sci Educ Theory Pract. 2007;12:417-26.

18. Wigton RS. Use of linear models to analyse physicians’ decisions. Med Decis Making. 1988;8:241-52.

19. Custers EJFM. Thirty years of illness scripts: Theoretical origins and practical applications. Med Teach. 2015; 37:457-62.

20. Bannister SL, Hanson JL, Maloney CG, Raszka WV. Using the student case presentation to enhance diagnostic reasoning. Pediatrics. 2011;128:211-3.

21. Wolpow T, Papp KK, Bordage G. Using SNAPPS to facilitate the expression of clinical reasoning and uncertainties: a randomized clinical trial. Acad Med. 2009;84:517-24.

22. Neher JO, Stevens NG. The one-minute preceptor: Shaping the teaching conversation. Fam Med. 2003; 35:391-3.

23. Neher JO, Gordon KC, Meyer B, Stevens N. A five-step "microskills" model of clinical teaching. J Am Board Fam Pract.1992;5:419-24.

24. Gawande A. The Checklist Manifesto: How to Get Things Right. New York: Henry Holt and Company; 2009.

25. Custers E, Boshuizen HPA, Schmidt HG. The role of illness scripts in the development of medical diagnostic expertise: Results from an interview study. Cognit Instruct. 1998;16:367-98.

26. Custers E, Boshuizen HPA, Schmidt HG. The influence of medical expertise, case typicality, and illness script component on case processing and disease probability estimates. Mem Cognit. 1998;24:384-99.

27. Audetat MC, Laurin S, Sanche G, Beique C, Fon NC, Balais JG, et al. Clinical reasoning difficulties: A taxonomy for clinical teachers. Med Teach. 2013; 35:e984-9.

28. Dhaliwal G, Sharpe BA. Twelve tips for presenting a clinical problem solving exercise. Med Teach. 2009;31:1056-9.

29. Joshi MK, Gupta P, Singh T. Portfolio-based learning and assessment. Indian Pediatr. 2015;52:231-5.

30. Moulton CE, Regehr GE, Mylopoulos M, MacRae HM. Slowing down when you should: A new model of expert judgment. Acad Med. 2007;82:S109-S116.

31. Ericsson KA. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 1988;79:S1-S12.

32. Beullens J, Struyf E, van Damme B. Do extended matching multiple-choice questions measure clinical reasoning? Med Educ. 2005;39:410-7.

33. Page G, Bordage G, Allen T. Developing key-feature problems and examinations to assess clinical decision-making skills. Acad Med. 1995;70:194–201.

34. Lubarsky, S, Dory V, Duggan P, Gagnon R, Charlin B. Script concordance testing: From theory to practice: AMEE Guide No. 75. Med Teach. 2013;35:184-93.

35. Gleeson F. Assessment of clinical competence using the objective structured long examination record (OSLER). Med Teach.1997;19:7-14.

36. Norcini, JJ, Blank LL, Arnold GK, Kimbal HR. The mini-CEX (clinical evaluation exercise): a preliminary investigation. Ann Intern Med. 1995;123:795-9.

37. Driessen EW, Overeem K, van Tartwijk J, van der V leuten CPM, Muijtjens AMM. Validity of portfolio assessment: which qualities determine ratings? Med Educ. 2006;40:862-6.

38. Askew K, Manthey D, Mahler S. Clinical reasoning: Are we testing what we are teaching? Med Educ. 2012;46:540-1.   

 

Copyright © 1999-2015 Indian Pediatrics