Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Filter by Categories
Acknowledgements
Authors’ reply
Book Review
Book Reviews
Classics In Indian Medicine
Clinical Case Report
Clinical Case Reports
Clinical Research Methods
Clinico-pathological Conference
Clinicopathological Conference
Conferences
Correspondence
Corrigendum
Editorial
Eminent Indians in Medicine
Errata
Erratum
Everyday Practice
Film Review
History of Medicine
HOW TO DO IT
Images In Medicine
Indian Medical Institutions
Letter from Bristol
Letter from Chennai
Letter From Ganiyari
Letter from Glasgow
Letter from London
Letter from Mangalore
Letter From Mumbai
Letter From Nepal
Masala
Medical Education
Medical Ethics
Medicine and Society
News From Here And There
Notice of Retraction
Notices
Obituaries
Obituary
Original Article
Original Articles
Review Article
Selected Summaries
Selected Summary
Short Report
Short Reports
Speaking for Myself
Speaking for Ourselve
Speaking for Ourselves
Students@nmji
Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Filter by Categories
Acknowledgements
Authors’ reply
Book Review
Book Reviews
Classics In Indian Medicine
Clinical Case Report
Clinical Case Reports
Clinical Research Methods
Clinico-pathological Conference
Clinicopathological Conference
Conferences
Correspondence
Corrigendum
Editorial
Eminent Indians in Medicine
Errata
Erratum
Everyday Practice
Film Review
History of Medicine
HOW TO DO IT
Images In Medicine
Indian Medical Institutions
Letter from Bristol
Letter from Chennai
Letter From Ganiyari
Letter from Glasgow
Letter from London
Letter from Mangalore
Letter From Mumbai
Letter From Nepal
Masala
Medical Education
Medical Ethics
Medicine and Society
News From Here And There
Notice of Retraction
Notices
Obituaries
Obituary
Original Article
Original Articles
Review Article
Selected Summaries
Selected Summary
Short Report
Short Reports
Speaking for Myself
Speaking for Ourselve
Speaking for Ourselves
Students@nmji
View/Download PDF

Translate this page into:

Students@nmji
35 (
6
); 370-371
doi:
10.25259/NMJI_35_6_370

Importance of critical appraisal skills training in medical students

Room 48, Hostel 4, All India Institute of Medical Sciences, Ansari Nagar, New Delhi 110029, India

Correspondence to: amulyagupta@gmail.com

Licence
This is an open-access article distributed under the terms of the Creative Commons Attribution-Non Commercial-Share Alike 4.0 License, which allows others to remix, tweak, and build upon the work non-commercially, as long as the author is credited and the new creations are licensed under the identical terms.

[To cite: Gupta A. Importance of critical appraisal skills training in medical students. Natl Med J India 2022;35:370–1.]

Critical appraisal is defined as ‘the process of carefully and systematically examining research to judge its trustworthiness and its value and relevance in a particular context’.1 Critical appraisal allows one to interpret the relevance, validity and trustworthiness of the conclusions drawn from a particular study. Since medical science is a rapidly evolving field, clinicians from all specialties are required to read and interpret upcoming evidence for effective application in their practice. However, a variety of factors including a lack of emphasis in medical curriculum, rigidity and ignorance of practising clinicians, and a paucity of constraints on malpractice preclude the implementation of an evidence-based approach to healthcare in India.2 The magnitude of this problem was realized during the Covid-19 outbreak in India. For example, favipiravir—an antiviral drug originally developed against influenza, has been widely prescribed in India despite poor evidence related to its efficacy.3 Similarly, convalescent plasma therapy has been indiscriminately used to treat severe Covid-19 despite conclusive evidence of its futility4 and an advisory by the Indian Council of Medical Research.5 Besides being costly, such interventions lead to mental harassment of patients’ attendants as they try to find suitable donors and sources.

The new National Medical Commission (NMC) syllabus for MBBS (implemented in 2019) includes critical appraisal of medical literature, but only as a single competency in clinical pharmacology ‘PH3.3. Perform a critical evaluation of drug promotional literature’.6 However, this placement is flawed as biostatistics and study designs will not be taught before this, which are essential for interpreting literature. The MBBS syllabus at the All India Institute of Medical Sciences (AIIMS), New Delhi is different from that of NMC and does not include critical appraisal at all.7

Recognizing this problem, the Scientific Society of AIIMS New Delhi organized an intramural ‘Online critical appraisal competition’ for second-semester MBBS students (batch of 2020) in May 2021. The competition could not be held in person owing to the Covid-19 situation. Each student had to appraise any randomized controlled trial (RCT) on a candidate drug or therapy for Covid-19. A total of 18 students volunteered to participate in the competition with topics including favipiravir, ivermectin, CD24Fc, doxycycline, azithromycin, dexamethasone, hydroxychloroquine, baricitinib, lopinavir–ritonavir, remdesivir, convalescent plasma therapy, low molecular weight heparin, Patanjali CORONIL, vitamin C and zinc, tocilizumab, inhaled budesonide, REGEN-COV and even a vaccine—ChAdOx1 nCoV-19. A professor from the Department of Neurology, AIIMS, New Delhi presided over the presentations to point out errors or missed points and to teach important concepts of evidence-based medicine (EBM). Each student was also assigned a ‘mentor’ who would be a more senior MBBS student having prior experience in research. The mentors were supposed to help the participants in searching the literature, understanding the methodology and finding resources to learn basic biostatistics. The overall schedule of the competition was flexible with 2–3 presentations held in the evenings.

Despite having no experience in reading medical literature, the participants tried to learn various concepts and interpret the studies. Initially, participants did experience problems in interpreting biases and presenting their appraisals. However, with due guidance from the presiding professor, they learned to interpret CONSORT diagrams, define the population, intervention, control, outcomes of a study, point out and classify biases and evaluate conflicts of interest.

Feedback from the participants was overwhelmingly positive. The following are excerpts of the feedback, which was collected through electronic messages:

This helped me gain some basic knowledge of statistics and terms used in clinical studies. This made me realize the whole process of RCTs and meta-analysis and how they ultimately culminate in clinical guidelines.

Now I can read and understand research articles. Earlier they were Latin and Greek for me.

It gave an idea—how to read research papers and interpret them. Instead of skimming through the conclusions, I can now understand the methodology and interpret p values, confidence intervals, etc.

A meta-analysis including 10 previous studies has shown that training of critical appraisal skills leads to an overall positive effect on knowledge of epidemiology/biostatistics, attitudes towards medical literature and reading behaviour.8 Further, of the 4 studies that assessed critical appraisal ability, results were negative in 2, inconclusive in 1 and positive in 1. Before concluding that the effects of training on critical appraisal ability are dubious, it is important to note that these studies were conducted in the USA, Canada and Mexico. In these countries, research experience is an important determinant in securing residency spots which may lead to a general awareness regarding research papers in most of the students. This may prevent formal training in critical appraisal from creating a major influence on the critical appraisal ability of these medical students. On the contrary, admissions to residency programmes in India are through entrance tests, and research experience is not taken into account. Overall, medical students’ research activities in India are in a poor state.9 Against such a background, formal training in critical appraisal can have a pronounced positive effect in India.

Further, instead of didactic teaching of critical appraisal, students should be tasked with appraising and presenting research papers. This form of problem-based, active learning facilitates an interesting learning environment and better academic performance in medical students.10 A study has shown that near-peer tutors were more effective and readily accepted in teaching critical appraisal.11 This is similar to the model used in this competition by the Scientific Society where senior medical students were ‘mentors’ to juniors who had to present the appraisals.

In summary, a dedicated space for critical appraisal in the MBBS curriculum is needed for facilitating the practice of EBM in India.

Conflicts of interest

None declared

References

  1. . What is critical appraisal. (2nd ed). UK: Hayward Medical Communications; . p. :1.
    [Google Scholar]
  2. , , . Barriers to evidence-based medicine practice in South Asia and possible solutions. Neurol Asia. 2008;13:87-94.
    [Google Scholar]
  3. . Covid-19: India's slow moving treatment guidelines are misleading and harming patients. BMJ. 2021;372:n278.
    [CrossRef] [PubMed] [Google Scholar]
  4. , , , , , , et al. Association of convalescent plasma treatment with clinical outcomes in patients with COVID-19: A systematic review and meta-analysis. JAMA. 2021;325:1185-95.
    [CrossRef] [PubMed] [Google Scholar]
  5. , , , , , . A systematic review of the effectiveness of critical appraisal skills training for clinicians. Med Educ. 2000;34:120-5.
    [CrossRef] [PubMed] [Google Scholar]
  6. . Undergraduate medical students' research in India. J Postgrad Med. 2008;54:176-9.
    [CrossRef] [PubMed] [Google Scholar]
  7. , , . Impact of problem-based, active learning on graduation rates for 10 generations of Dutch medical students. Med Educ. 2009;43:211-18.
    [CrossRef] [PubMed] [Google Scholar]
  8. , , , , . Evaluation of the role of near-peer teaching in critical appraisal skills learning: A randomized crossover trial. Int J Med Educ. 2019;10:9-15.
    [CrossRef] [PubMed] [Google Scholar]

Fulltext Views
1,142

PDF downloads
504
View/Download PDF
Download Citations
BibTeX
RIS
Show Sections