What is a Literature Search?
This is a systematic, organised search of the research papers published on a particular topic. A well-structured literature search is the most effective and efficient way to locate reliable evidence on a research topic.
When you have sourced your relevant journal articles to answer a clinical question, you require the ability to critically appraise them.
What is Critical Appraisal?
Critical appraisal of scientific literature is a necessary skill for healthcare professionals as part of their professional obligation and CPD commitment. This leads to progression of skills linked to a sound knowledge base, as they navigate along their specific career journey.
Ideally, an article will be able to undergo scrutiny using critical thinking skills to evaluate the findings as valid.
What is Reliability + Validity?
In the clinical setting, making evidence-based decisions requires methods that are accurate, reliable and valid. Accuracy is where the result of a measurement equates to the correct value that is precise.
Reliability is a measure of the repeatability of the activity.
Repeatability will be affected by;
- Inter repeatability which looks at the reliability of different therapists carrying out the same activity at different times
- Intra repeatability examines the reliability of the testing carried out by the same therapist at different times
When making statements, it's important that the statement is both reliable and valid and not an opinion.
The specific questions used to assess validity change slightly with different study designs and article types. Use the questions below as a quick reference to appraise any journal article.
The first 4 checklist questions should be answered “YES.” If any of the 4 questions are answered “NO” then you should return to your search and attempt to find an article that will meet these criteria.
Critical Appraisal Skills
- Does the article attempt to answer the same question as your clinical question?
- Is the article recently published (within 5 years) or is it seminal (i.e. an earlier article but which has strongly influenced later developments)?
- Is the journal peer-reviewed?
- Do the authors present a hypothesis?
- Is the study design valid for your question?
- Are both inclusion and exclusion criteria described?
- Is there an attempt to limit bias in the selection of participant groups?
- Are there methodological protocols (i.e. blinding) used to limit other possible bias?
- Do the research methods limit the influence of confounding variables?
- Are the outcome measures valid for the health condition you are researching?
- Is there a table that describes the subjects’ demographics?
- Are the baseline demographics between groups similar?
- Are the subjects generalizable to your patient?
- Are the statistical tests appropriate for the study design and clinical question?
- Are the results presented within the paper?
- Are the results statistically significant and how large is the difference between groups?
- Is there evidence of significance fishing (i.e. changing statistical tests to ensure significance)?
The Discussion / Conclusion
- Do the authors attempt to contextualise non-significant data in an attempt to portray significance? (i.e. talking about findings which had a trend towards significance as if they were significant).
- Do the authors acknowledge limitations in the article?
- Are there any conflicts of interests noted?
This is a starter pack to using critical thinking skills when appraising a scientific journal article. By answering the questions above, after you have read the article, you can then appraise it's merit and determine whether the results are valid.
This Bitesize Canine Resource Library was produced for you and is owned by K9HS Courses