Skip to Main Content

Research and Evidence-based Practice: Levels of Evidence and Study Designs

Evidence Pyramid

An evidence pyramid visually depicts the evidential strength of different research designs. The image below is one of several available renderings of an evidence pyramid. Studies with the highest internal validity, characterized by a high degree of quantitative analysis, review, analysis, and stringent scientific methodoloy, are at the top of the pyramid. Observational research and expert opinion reside at the bottom of the pyramid. 

Which Research Designs for Which Questions?

Different types of research studies are better suited to answer different categories of clinical questions. You might not always find the highest level of evidence (i.e., systematic review or meta-analysis) to answer your question.  When this happens, work your way down the Evidence Pyramid to the next highest level of evidence.

Therapy: Which treatment does more harm than good?

RCT > Cohort Study  >  Case Control > Case Series

Diagnosis: Which diagnostic test should I use?

Prospective, blind comparison to a gold standard, ie. A controlled trial that looks at patients with varying degrees of an illness and administers both diagnostic tests -- the test under investigation and the "gold standard" test -- to all of the patients in the study group.

Prognosis: What is the patient's likely clinical course over time?

Cohort Study > Case Control > Case Series

Etiology / Harm: What are the causes of this disease or condition?

RCT > Cohort Study > Case Control > Case Series

Prevention: How do we reduce the chance of disease by identifying and modifying risk factors?

RCT > Cohort Study > Case Control > Case Series

Cost: Is one intervention more cost-effective than another?

Economic Analysis

Quality of Life: What will be the patient's quality of life following an intervention?

Qualitative Study

Levels of Evidence

  Levels of Evidence
Level I Evidence from a systematic review or meta-analysis of all relevant RCTs (randomized controlled trial) or evidence-based clinical practice guidelines based on systematic reviews of RCTs or 3 or more RCTs of good quality that have similar results.
Level II Evidence obtained from at least one well designed RCT (eg large multi-site RCT).
Level III Evidence obtained from well-designed controlled trials without randomization (ie quasi-experimental).
Level IV Evidence from well-designed case-control or cohort studies.
Level V Evidence from systematic reviews of descriptive and qualitative studies (meta-synthesis).
Level VI Evidence from a single descriptive or qualitative study.
Level VII Evidence from the opinion of authorities and/or reports of expert committees.

Types of Study Designs

Systematic Review:  A summary of the clinical literature. A systematic review is a critical assessment and evaluation of all research studies that address a particular clinical issue. The researchers use an organized method of locating, assembling, and evaluating a body of literature on a particular topic using a set of specific criteria. A systematic review typically includes a description of the findings of the collection of research studies. Cochrane Reviews are the gold standard!  (AHRQ Glossary of Terms)

Meta-Analysis:  A work consisting of studies using a quantitative method of combining the results of independent studies (usually drawn from the published literature) and synthesizing summaries and conclusions which may be used to evaluate therapeutic effectiveness, plan new studies, etc. It is often an overview of clinical trials. It is usually called a meta-analysis by the author or sponsoring body and should be differentiated from reviews of literature. (PubMed)

Evidence Guideline:  Systematically developed statement to assist practitioner and patient decisions about appropriate health care for specific clinical circumstances (Institute of Medicine).  These have a rigorous development process.  An example is AHRQ Guidelines at guidelines.gov or Lippincott  Procedures.

Evidence Summary:  A summary of the evidence.

Randomized Controlled Trial:  A controlled clinical trial that randomly (by chance) assigns participants to two or more groups. There are various methods to randomize study participants to their groups. (AHRQ Glossary of Terms)

Controlled Clinical Trial:  A type of clinical trial comparing the effectiveness of one medication or treatment with the effectiveness of another medication or treatment. In many controlled trials, the other treatment is a placebo (inactive substance) and is considered the "control." (AHRQ Glossary of Terms)

Cohort Study:  A clinical research study in which people who presently have a certain condition or receive a particular treatment are followed over time and compared with another group of people who are not affected by the condition. (AHRQ Glossary of Terms)

Case Control Study:  The observational epidemiologic study of persons with the disease (or other outcome variable) of interest and a suitable control (comparison, reference) group of persons without the disease. The relationship of an attribute to the disease is examined by comparing the diseased and nondiseased with regard to how frequently the attribute is present or, if quantitative, the levels of the attribute, in each of the groups. (OCEBM Table of Evidence Glossary)

Case Series:  A group or series of case reports involving patients who were given similar treatment. Reports of case series usually contain detailed information about the individual patients. This includes demographic information (for example, age, gender, ethnic origin) and information on diagnosis, treatment, response to treatment, and follow-up after treatment. (OCEBM Table of Evidence Glossary)

Case Study:  An investigation of a single subject or a single unit, which could be a small number of individuals who seem to be representative of a larger group or very different from it. (Dictionary of Nursing Theory and Research, Fourth Edition)

Editorial:  Work consisting of a statement of the opinions, beliefs, and policy of the editor or publisher of a journal, usually on current matters of medical or scientific significance to the medical community or society at large. The editorials published by editors of journals representing the official organ of a society or organization are generally substantive. (PubMed)

Opinion:  A belief or conclusion held with confidence but not substantiated by positive knowledge or proof. (The Free Dictionary)

Animal Research:  A laboratory experiment using animals to study the development and progression of diseases. Animal studies also test how safe and effective new treatments are before they are tested in people.(NCI Dictionary of Cancer Terms)

In Vitro Research:  In the laboratory (outside the body). The opposite of in vivo (in the body). (NCI Dictionary of Cancer Terms)