‘Worm Wars’: The Unravelling of the Randomised Control Trial Success Story

  • Samantha Vanderslott

Abstract

What counts as evidence in global health? What happens when evidence is contested? This article concentrates on the ‘Worm Wars’, a public academic debate in 2015 on the effectiveness of health interventions to treat populations with parasitic worms, to assess how health interventions are appraised by different disciplinary perspectives. I discuss what happens when a success story about randomised control trials (or RCTs) – often hailed as the ‘gold standard’ of evidence adjudication – is contested but left unresolved. Questioning the prominence of RCTs through the unravelling of this evidence success story offers insights into how these forms of measurement are utilised in practice, first in the medical field and then more widely in economic development and global health policy. I address what a gold standard is within a hierarchy of evidence, as well as the standards that are imbued into RCTs by different disciplinary researchers, and the evidence requirements for health interventions in determining the impact of deworming medication. With the Worm Wars, I show how important measurement standards have become in defining and advocating for global health problems and what this means for the production of evidence.

References

Abdelghafour, Nassima. 2017. “Randomized Controlled Experiments to End Poverty?” Anthropologie & Développement (46–47): 235–62.

https://doi.org/10.4000/anthropodev.611.

Adams, Vincanne, ed. 2016. Metrics: What Counts in Global Health. Durham: Duke University Press.

Aiken, Alexander M., Calum Davey, James R. Hargreaves, and Richard J. Hayes. 2015. “Re-Analysis of Health and Educational Impacts of a School-Based Deworming Programme in Western Kenya: A Pure Replication.” International Journal of Epidemiology 45(5): 1572–80.

https://doi.org/10.1093/ije/dyv127.

Allen, Tim, and Melissa Parker. 2016. “Deworming Delusions? Mass Drug Administration in East African Schools.” Journal of Biosocial Science 48(S1): S116–47.

https://doi.org/10.1017/s0021932016000171.

Anderson, Kathryn L., and Carol S. Burckhardt. 1999. “Conceptualization and Measurement of Quality of Life as an Outcome Variable for Health Care Intervention and Research.” Journal of Advanced Nursing 29(2): 298–306.

https://doi.org/10.1046/j.1365-2648.1999.00889.x.

Anderson, Roy M. 1986. “The Population Dynamics and Epidemiology of Intestinal Nematode Infections.” Transactions of The Royal Society of Tropical Medicine and Hygiene 80(5): 686–96.

https://doi.org/10.1016/0035-9203(86)90367-6.

Anderson, Roy M., and Robert M. May. 1982. “Population Dynamics of Human Helminth Infections: Control by Chemotherapy.” Nature 297(5867): 557–563.

https://doi.org/10.1038/297557a0.

Bédécarrats, Florent, Isabelle Guérin, and François Roubaud. 2020. Randomized Control Trials in the Field of Development: A Critical Perspective. Oxford: Oxford University Press.

Belluz, Julia. 2015. “Worm Wars: The Fight Tearing Apart the Global Health Community, Explained.” Vox. Accessed October 14, 2022. Last modified July 29, 2015.

https://www.vox.com/2015/7/24/9031909/worm-wars-explained.

Biruk, Cal. 2018. Cooking Data: Culture and Politics in an African Research World. Durham: Duke University Press.

⸻. 2021. “The Politics of Global Health.” PoLAR: Political and Legal Anthropology Review 44(2): e161–80.

https://doi.org/10.1111/plar.12431.

Bleakley, Hoyt. 2007. “Disease and Development: Evidence from Hookworm Eradication in the American South.” The Quarterly Journal of Economics 122(1): 73–117.

https://doi.org/10.1162/qjec.121.1.73.

Boseley, Sarah. 2015. “New Research Debunks Merits of Global Deworming Programmes.” The Guardian. July 23, 2015. Accessed December 10, 2015.

https://www.theguardian.com/society/2015/jul/23/research-global-deworming-programmes.

Bothwell, Laura E., Jeremy A. Greene, Scott H. Podolsky, and David S. Jones. 2016. “Assessing the Gold Standard—Lessons from the History of RCTs.” The New England Journal of Medicine 374(22): 2175–81.

https://doi.org/10.1056/nejmms1604593.

Brooker, Simon, Jeffrey Bethony, and Peter J. Hotez. 2004. “Human Hookworm Infection in the 21st Century.” Advances in Parasitology 58: 197-288.

https://doi.org/10.1016/S0065-308X(04)58004-1.

Brown, Annette N., and Benjamin D. K. Wood. 2018. “Replication Studies of Development Impact Evaluations.” The Journal of Development Studies 55(5): 917–25.

https://doi.org/10.1080/00220388.2018.1506582.

Brown, E. Richard. 1976. “Public Health in Imperialism: Early Rockefeller Programs at Home and Abroad.” American Journal of Public Health 66(9): 897–903.

https://doi.org/10.2105/AJPH.66.9.897.

Bundy, Donald A. P., Michael S. Wong, Lewis L. Lewis, and John Horton. 1990. “Control of Geohelminths by Delivery of Targeted Chemotherapy through Schools.” Transactions of The Royal Society of Tropical Medicine and Hygiene 84(1): 115–20.

https://doi.org/10.1016/0035-9203(90)90399-Y.

Cartwright, Nancy. 2007. “Are RCTs the Gold Standard?” BioSocieties 2(1): 11–20.

https://doi.org/10.1017/S1745855207005029.

Cassidy, Angela. 2015. “‘Big Science’ in the Field: Experimenting with Badgers and Bovine TB, 1995–2015.” History and Philosophy of the Life Sciences 37(3): 305–25.

https://doi.org/10.1007/s40656-015-0072-z.

⸻. 2019. Vermin, Victims and Disease: British Debates over Bovine Tuberculosis and Badgers. Cham: Springer International Publishing.

Cotton-Barratt, Conrad. 2012. “Neglected Tropical Diseases – Are They Cost-Effective to Treat?” Giving What We Can, blog post. October 11, 2012. Accessed May 26, 2019.

https://www.givingwhatwecan.org/post/2012/10/neglected-tropical-diseases-are-they-cost-effective-to-treat/.

Cueto, Marcos. 1995. “The Cycles of Eradication: The Rockefeller Foundation and Latin American Public Health, 1918–1940.” In International Health Organisations and Movements 1918–1939, edited by Paul Weindling, 222–43. Cambridge: Cambridge University Press.

Davey, Calum, Alexander M. Aiken, Richard J. Hayes, and James R. Hargreaves. 2015. “Re-Analysis of Health and Educational Impacts of a School-Based Deworming Programme in Western Kenya: A Statistical Replication of a Cluster Quasi-Randomized Stepped-Wedge Trial.” International Journal of Epidemiology 44(5): 1581–92.

https://doi.org/10.1093/ije/dyv128.

Deaton, Angus, and Nancy Cartwright. 2018. “Understanding and Misunderstanding Randomized Controlled Trials.” Social Science & Medicine 210: 2–21.

https://doi.org/10.1016/j.socscimed.2017.12.005.

Dickson, Rumona, Shally Awasthi, Colin Demellweek, and Paula R. Williamson. 2000. “Anthelmintic Drugs for Treating Worms in Children: Effects on Growth and Cognitive Performance.” Cochrane Database of Systematic Reviews (2). Modified April 18, 2007.

https://doi.org/10.1002/14651858.CD000371.

Donovan, Kevin P. 2018. “The Rise of the Randomistas: On the Experimental Turn in International Aid.” Economy and Society 47(1): 27–58.

https://doi.org/10.1080/03085147.2018.1432153.

Elman, Cheryl, Robert A. McGuire, and Barbara Wittman. 2014. “Extending Public Health: The Rockefeller Sanitary Commission and Hookworm in the American South.” American Journal of Public Health 104(1): 47–58.

https://doi.org/10.2105/AJPH.2013.301472.

Evans, David. 2015. “Worm Wars: The Anthology | Impact Evaluations.” The World Bank Blog: Development Impact. Modified January 4, 2016. Accessed November 10, 2015.

https://blogs.worldbank.org/impactevaluations/worm-wars-anthology.

Farley, John. 1995. “The International Health Division of the Rockefeller Foundation: The Russell Years, 1920–1934.” In International Health Organisations and Movements 1918–1939, edited by Paul Weindling, 203–21. Cambridge: Cambridge University Press.

Feasey, Nick, Mark Wansbrough-Jones, David C. W. Mabey, and Anthony W. Solomon. 2010. “Neglected Tropical Diseases.” British Medical Bulletin 93(1): 179–200.

https://doi.org/10.1093/bmb/ldp046.

Friedman, Samuel R., David C. Perlman, and Danielle C. Ompad. 2015. “The Flawed Reliance on Randomized Controlled Trials in Studies of HIV Behavioral Prevention Interventions for People Who Inject Drugs and Other Populations.” Substance Use & Misuse 50(8–9): 1117-24.

https://doi.org/10.3109/10826084.2015.1007677.

Goldacre, Ben. 2015. “Scientists Are Hoarding Data and It’s Ruining Medical Research.” BuzzFeed News. July 23, 2015. Accessed December 10, 2015.

https://www.buzzfeed.com/bengoldacre/deworming-trials.

Gorsky, Martin, and Christopher Sirrs. 2017. “World Health by Place: The Politics of International Health System Metrics, 1924–c. 2010.” Journal of Global History 12(3): 361–85.

https://doi.org/10.1017/S1740022817000134.

Greenberg, David H., and Philip K. Robins. 1986. “The Changing Role of Social Experiments in Policy Analysis.” Journal of Policy Analysis and Management 5(2): 340–362.

https://doi.org/10.1002/pam.4050050210.

Guyatt, Gordon H., Andrew D. Oxman, Holger J. Schünemann, Peter Tugwell et al. 2011. “GRADE Guidelines: A New Series of Articles in the Journal of Clinical Epidemiology.” Journal of Clinical Epidemiology 64(4): 380–2.

https://doi.org/10.1016/j.jclinepi.2010.09.011.

Hargreaves, James R., Alexander M. Aiken, Calum Davey, and Richard J. Hayes. 2015. “Authors’ Response to: Deworming Externalities and School Impacts in Kenya.” International Journal of Epidemiology 44(5): 1596–99.

https://doi.org/10.1093/ije/dyv130.

Hariton, Eduardo, and Joseph J. Locascio. 2018. “Randomised Controlled Trials—The Gold Standard for Effectiveness Research.” BJOG: An International Journal of Obstetrics and Gynaecology 125(13): 1716.

https://doi.org/10.1111/1471-0528.15199.

Hart, John D., Lyson Samikwa, Feston Sikina, Khumbo Kalua et al. 2020. “Effects of Biannual Azithromycin Mass Drug Administration on Malaria in Malawian Children: A Cluster-Randomized Trial.” The American Journal of Tropical Medicine and Hygiene 103(3): 1329–34.

https://doi.org/10.4269/ajtmh.19-0619.

Hill, Gerry B. 2000. “Archie Cochrane and His Legacy: An Internal Challenge to Physicians’ Autonomy?” Journal of Clinical Epidemiology 53(12): 1189–92.

https://doi.org/10.1016/s0895-4356(00)00253-5.

Hotez, Peter J., Miriam Alvarado, María-Gloria Basáñez, Ian Bolliger et al. 2014. “The Global Burden of Disease Study 2010: Interpretation and Implications for the Neglected Tropical Diseases.” PLoS Neglected Tropical Diseases 8(7): e2865.

https://doi.org/10.1371/journal.pntd.0002865.

Hotez, Peter J., and Jennifer R. Herricks. 2015. “Helminth Elimination in the Pursuit of Sustainable Development Goals: ‘A Worm Index; for Human Development.” PLoS Neglected Tropical Diseases 9(4): e0003618.

Ioannidis, John P. A. 2005. “Why Most Published Research Findings Are False.” PLoS Medicine 2(8): 2–8.

https://doi.org/10.1371/journal.pmed.0020124.

International Society for NTDs (ISNTD). n.d. “International Society for Neglected Tropical Diseases.” Accessed December 14, 2016.

http://www.isntd.org/#/isntd-conferences/4565830915.

Jones, David S., and Scott H. Podolsky. 2015. “The History and Fate of the Gold Standard.” The Lancet 385(9977): 1502–3.

https://doi.org/10.1016/S0140-6736(15)60742-5.

Kingori, Patricia. 2013. “Experiencing Everyday Ethics in Context: Frontline Data Collectors Perspectives and Practices of Bioethics.” Social Science & Medicine 98: 361–70.

https://doi.org/10.1016/j.socscimed.2013.10.013.

Klass, Perri. 2015. “War of the Worms.” The New Yorker. December 14, 2015.

https://www.newyorker.com/tech/annals-of-technology/war-of-the-worms.

Kremer, Michael, and Edward Miguel. 2015. “Understanding Deworming Impacts on Education.” University of California, Berkeley. Accessed December 10, 2015.

https://emiguel.econ.berkeley.edu/assets/miguel_research/63/Deworming-summary_Kremer-Miguel_2015-07-24-CLEAN.pdf.

Kvangraven, Ingrid Harvold. 2020. “Nobel Rebels in Disguise—Assessing the Rise and Rule of the Randomistas.” 32(3): 305–41.

https://doi.org/10.1080/09538259.2020.1810886.

Latour, Bruno. 1987. Science in Action: How to Follow Scientists and Engineers through Society. Harvard: Harvard University Press.

Littoz-Monnet, Annabelle, and Juanita Uribe. 2023. “Methods Regimes in Global Governance: The Politics of Evidence-Making in Global Health.” International Political Sociology 17(2): olad005.

https://doi.org/10.1093/ips/olad005.

Maldonado, Oscar Javier, and Tiago Moreira. 2019. “Metrics in Global Health: Situated Differences in the Valuation of Human Life.” Historical Social Research 44(2): 202–224.

https://doi.org/10.12759/hsr.44.2019.2.202-224.

Mason Dentinger, Rachel. 2018. “The Parasitological Pursuit: Crossing Species and Disciplinary Boundaries with Calvin W. Schwabe and the Echinococcus Tapeworm, 1956–1975.” In Animals and the Shaping of Modern Medicine: Medicine and Biomedical Sciences in Modern History. 161–91. Palgrave MacMillan, Cham.

McGillivray, Mark. 1991. “The Human Development Index: Yet Another Redundant Composite Development Indicator?” World Development 19(10): 1461–8.

https://doi.org/10.1016/0305-750X(91)90088-Y.

McMillen, Christian. 2021. “‘These Findings Confirm Conclusions Many Have Arrived at by Intuition or Common Sense’: Water, Quantification and Cost-Effectiveness at the World Bank, ca. 1960 to 1995.” Social History of Medicine 34(2): 351–74.

https://doi.org/10.1093/shm/hkaa006.

Miguel, Edward, and Michael Kremer. 2004. “Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities.” Econometrica 72(1): 159–217.

https://doi.org/10.1111/j.1468-0262.2004.00481.x.

Nobel Prize. 2019. “The Sveriges Riksbank Prize in Economic Sciences in Memory of Alfred Nobel 2019.” Press release, October 14, 2019. Accessed November 30, 2021.

https://www.nobelprize.org/prizes/economic-sciences/2019/press-release/.

Pearce, Warren, and Sujatha Raman. 2014. “The New Randomised Controlled Trials (RCT) Movement in Public Policy: Challenges of Epistemic Governance.” Policy Sciences 47: 387–402.

https://doi.org/10.1007/s11077-014-9208-3.

Pullan, Rachel L., Jennifer L. Smith, Rashmi Jasrasaria, and Simon J. Brooker. 2014. “Global Numbers of Infection and Disease Burden of Soil Transmitted Helminth Infections in 2010.” Parasites and Vectors 7(37).

https://doi.org/10.1186/1756-3305-7-37.

Reubi, David, Clare Herrick, and Tim Brown. 2016. “The Politics of Non-Communicable Diseases in the Global South.” Health & Place 39: 179–87.

https://doi.org/10.1016/j.healthplace.2015.09.001.

Registry for International Development Impact Evaluations (RIDIE). N.D. Website.

https://ridie.3ieimpact.org/.

Rosemann, Achim. 2019. “Alter-Standardizing Clinical Trials: The Gold Standard in the Crossfire.” Science as Culture 28(2): 125–48.

https://doi.org/10.1080/09505431.2019.1606190.

Sackett, D. L. 1997. “Evidence-Based Medicine.” Seminars in Perinatology 21(1): 3–5.

https://doi.org/10.1016/S0146-0005(97)80013-4.

Samii, Cyrus. 2020. “Reasons for Policy Experimentation That Have Nothing to Do with Selection Bias.” World Development 127: 104825.

https://doi.org/10.1016/j.worlddev.2019.104825.

Savioli, Lorenzo, Donald Bundy, and Andrew Tomkins. 1992. “Intestinal Parasitic Infections: A Soluble Public Health Problem.” Transactions of The Royal Society of Tropical Medicine and Hygiene 86(4): 353–4.

https://doi.org/10.1016/0035-9203(92)90215-X.

Shah, Hriday M., and Kevin C. Chung. 2009. “Archie Cochrane and His Vision for Evidence-Based Medicine.” Plastic and Reconstructive Surgery 124(3): 982–8.

https://doi.org/10.1097/PRS.0b013e3181b03928.

Shelton, James D. 2014. “Evidence-Based Public Health: Not Only Whether It Works, but How It Can Be Made to Work Practicably at Scale.” Global Health, Science and Practice 2(3): 253–8.

https://doi.org/10.9745/GHSP-D-14-00066.

Smillie, Wilson G. and Donald L. Augustine. 1926. “Hookworm Infestation: The Effect of Varying Intensities on The Physical Condition of School Children.” American Journal of Diseases of Children 31(2): 151–68.

https://doi.org/10.1001/archpedi.1926.04130020003001.

Stephenson, Lani S., Michael C. Latham, and Eric A. Ottesen. 2000. “Malnutrition and Parasitic Helminth Infections.” Parasitology 121(S1): S23–38.

https://doi.org/10.1017/S0031182000006491.

Stoll, Norman R. 1923. “Investigations on the Control of Hookworm Disease XV: An Effective Method of Counting Hookworm Eggs in Feces.” American Journal of Epidemiology 3(1): 59–70.

https://doi.org/10.1093/oxfordjournals.aje.a118916.

⸻. 1947. “This Wormy World.” The Journal of Parasitology 33(1): 1–18.

https://www.jstor.org/stable/3273613.

Taylor-Robinson, David C., Nicola Maayan, Sarah Donegan, Marty Chaplin et al. 2019. “Public Health Deworming Programmes for Soil-Transmitted Helminths in Children Living in Endemic Areas.” Cochrane Database of Systematic Reviews. September 11, 2019.

https://doi.org/10.1002/14651858.CD000371.pub7.

Taylor-Robinson, David C., Nicola Maayan, Karla Soares-Weiser, Sarah Donegan et al. 2015. “Deworming Drugs for Soil-Transmitted Intestinal Worms in Children: Effects on Nutritional Indicators, Haemoglobin and School Performance.” Cochrane Database of Systematic Review. July 23, 2015.

https://doi.org/10.1002/14651858.cd000371.pub6.

The Abdul Latif Jameel Poverty Action Lab. n.d. “About Us.” Accessed October 17, 2022.

https://www.povertyactionlab.org/about-us.

This Wormy World n.d. “Global Atlas of Helminth Infections.” LSHTM. No longer available.

http://www.thiswormyworld.org/.

Utzinger, Jürg, Robert Bergquist, Remigio Olveda, and Xiao-Nong Zhou. 2010. “Important Helminth Infections in Southeast Asia: Diversity, Potential for Control and Prospects for Elimination.” Advances in Parasitology 72: 1–30.

https://doi.org/10.1016/s0065-308x(10)72001-7.

Valier, Helen, and Carsten Timmermann. 2008. “Clinical Trials and the Reorganization of Medical Research in Post-Second World War Britain.” Medical History 52(4): 493–510.

https://doi.org/10.1017/S0025727300002994.

Vanderslott, Samantha. Josephine. 2017. Neglect in policy problems: the case of “neglected tropical diseases.” Doctoral dissertation, University College London (UCL).

Venturini, Tommaso, and Anders Kristian Munk. 2021. Controversy Mapping: A Field Guide. Cambridge: Polity.

Wahlberg, Ayo, and Linsey McGoey. 2007. “An Elusive Evidence Base: The Construction and Governance of Randomized Controlled Trials.” BioSocieties 2(1): 1–10.

https://doi.org/10.1017/S1745855207005017.

Wahlberg, Ayo, and Nikolas Rose. 2015. “The Governmentalization of Living: Calculating Global Health.” Economy and Society 44(1): 60–90.

https://doi.org/10.1080/03085147.2014.983830.

Waite, J. H. and I. L. Neilson. 1919. “A Study of the Effects of Hookworm Infection upon the Mental Development of North Queensland School Children.” Medical Journal of Australia 1(1): 1–8.

https://doi.org/10.5694/j.1326-5377.1919.tb29570.x.

Wessely, Simon. 2007. “A Defence of the Randomized Controlled Trial in Mental Health.” BioSocieties 2(1): 115–27.

https://doi.org/10.1017/S1745855207005091.

World Health Organization. 2005. “Strategic And Technical Meeting On Intensified Control of Neglected Tropical Diseases: A Renewed Effort to Combat Entrenched Communicable Diseases of the Poor.” Report Of An International Workshop, Berlin, April 18–20, 2005.

https://iris.who.int/handle/10665/69297.

Williamson, John. 2009. “A Short History of the Washington Consensus.” Law and Business Review of the Americas 15(1): 7–23.

https://scholar.smu.edu/lbra/vol15/iss1/3.

Zhou, Xiao-Nong, Robert Berguist, Remigio Olveda, and Jürg Utzinger. 2010. “Important Helminth Infections in Southeast Asia: Diversity and Potential for Control and Prospects for Elimination.” Advances in Parasitology 72:1–30.

https://doi.org/10.1016/S0065-308X(10)72001-7.

Published
01 Dec 2024
Section
Thematic Collection: Standards & their Containers