Pragmatic clinical trial

A pragmatic clinical trial (PCT), sometimes called a practical clinical trial (PCT),^[1] is a clinical trial that focuses on correlation between treatments and outcomes in real-world health system practice rather than focusing on proving causative explanations for outcomes, which requires extensive deconfounding with inclusion and exclusion criteria so strict that they risk rendering the trial results irrelevant to much of real-world practice.^[2]^[3]

Examples

A typical example is that an anti-diabetic medication in the real world will often be used in people with (latent or apparent) diabetes-induced kidney problems, but if a study of its efficacy and safety excluded some subsets of people with kidney problems (to escape confounding), the study's results may not reflect well what will actually happen in broad practice. PCTs thus contrast with explanatory clinical trials,^[3] which focus more on causation through deconfounding. The pragmatic versus explanatory distinction is a spectrum or continuum rather than a dichotomy (each study can fall toward one end or the other),^[4] but the distinction is nonetheless important to evidence-based medicine (EBM) because physicians have found that treatment effects in explanatory clinical trials do not always translate to outcomes in typical practice. Decision-makers (including individual physicians deciding what to do next for a particular patient, developers of clinical guidelines, and health policy directors) hope to build a better evidence base to inform decisions by encouraging more PCTs to be conducted.^[1]

Distinction from other forms of trials

The distinction between pragmatic and explanatory trials is not the same as the distinction between randomized and nonrandomized trials. Any trial can be either randomized or nonrandomized and have any degree of pragmatic and explanatory power, depending on its study design, with randomization being preferable if practicably available. However, most randomized controlled trials (RCTs) to date have leaned toward the explanatory side of the pragmatic-explanatory spectrum, largely because of the value traditionally placed on proving causation by deconfounding as part of proving efficacy, but sometimes also because "attempts to minimize cost and maximize efficiency have led to smaller sample sizes".^[2] The movement toward supporting pragmatic randomized controlled trials (pRCTs) hopes to make sure that money spent on RCTs is well spent by providing information that actually matters to real-world outcomes,^[2] regardless of conclusively tying causation to particular variables. This is the pragmatic element of such designs. Thus pRCTs are important to comparative effectiveness research,^[2] and a distinction is often (although not always) made between efficacy and effectiveness, whereby efficacy implies causation provided by deconfounding other variables (we know with certainty that drug X treats disease Y by mechanism of action Z) but effectiveness implies correlation with outcomes regardless of presence of other variables (we know with certainty that people in a situation similar to X who take drug A tend to have slightly better outcomes than those who take drug B, and even if we think we may suspect why, the causation is not as important).^[5]

Explanation remains important, as does traditional efficacy research, because we still value knowledge of causation to advance our understanding of molecular biology and to maintain our ability to differentiate real efficacy from placebo effects. What has become apparent in the era of advanced health technology is that we also need to know about comparative effectiveness in real-world applications so that we can ensure the best use of our limited resources as we make countless instances of clinical decisions. And it is apparent that explanatory evidence, such as in vitro evidence and even in vivo evidence from clinical trials with tight exclusion criteria, often does not help enough, by itself, with that task.^[2]

Other types of pragmatic research

Pragmatism can be used as an epistemology when undertaking any type of research.^[6] Examples include systematic reviews, consensus methods such as Delphi^[7] and crowdsourcing^[8] in fields such as urban planning.^[9]

References

^ ^a ^b Tunis, SR; Stryer, DB; Clancy, CM (2003), "Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy", JAMA, 290 (12): 1624–1632, doi:10.1001/jama.290.12.1624, PMID 14506122.
^ ^a ^b ^c ^d ^e Mullins, CD; Whicher, D; Reese, ES; Tunis, S; et al. (2010), "Generating evidence for comparative effectiveness research using more pragmatic randomized controlled trials", Pharmacoeconomics, 28 (10): 969–976, doi:10.2165/11536160-000000000-00000, PMID 20831305, S2CID 33592391.
^ ^a ^b Schwartz, D; Lellouch, J; et al. (1967), "Explanatory and pragmatic attitudes in therapeutical trials", J Chronic Dis, 20 (8): 637–648, doi:10.1016/0021-9681(67)90041-0, PMID 4860352.
^ Thorpe, KE; et al. (2009), "A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers", J Clin Epidemiol, 62 (5): 464–475, doi:10.1016/j.jclinepi.2008.12.011, PMC 2679824, PMID 19348971.
^ Zimmer, Carl (20 November 2020). "2 Companies Say Their Vaccines Are 95% Effective. What Does That Mean? You might assume that 95 out of every 100 people vaccinated will be protected from Covid-19. But that's not how the math works". The New York Times. Retrieved 21 November 2020.
^ Yvonne Feilzer, Martina (2010-01-01). "Doing Mixed Methods Research Pragmatically: Implications for the Rediscovery of Pragmatism as a Research Paradigm". Journal of Mixed Methods Research. 4 (1): 6–16. doi:10.1177/1558689809349691. ISSN 1558-6898. S2CID 220267495.
^ Amos, Trevor (2008). "Pragmatic research design. An illustration of the use of the Delphi technique". Electronic Journal of Business Research Methods. 6 (2): 95–102.
^ Eklund, Lina; Stamm, Isabell; Liebermann, Wanda Katja (2019-10-01). "The crowd in crowdsourcing: Crowdsourcing as a pragmatic research method". First Monday. 4 (10). doi:10.5210/fm.v24i10.9206. ISSN 1396-0466. S2CID 204699798.
^ te Brömmelstroet, Marco (2017-10-01). "Towards a pragmatic research agenda for the PSS domain". Transportation Research Part A: Policy and Practice. 104: 77–83. doi:10.1016/j.tra.2016.05.011. ISSN 0965-8564. S2CID 156431540.