Tracing the Displacement of Data Work in AI: A Political Economy of “Human-in-the-Loop”
Abstract
In this study, we trace the evolution of a data work team in an artificial intelligence (AI) startup in India. By bringing attention to data work, which is the indispensable work of preparing annotated datasets for training AI systems, conducted within a formal organisational set up, we underline: 1. how organisational approaches adopted to balance investor and client preferences shape work arrangements and spatial division of the data workers; 2. how relations between the data team and the ‘core’ technical team serve to invisibilise human labour in the production of AI; and 3. how increasing codification of data work leads to devaluation of data work within the organisation and deskilling of young data workers at large, making them vulnerable in choosing a meaningful career path of their choice. In tracing this trajectory of displacement of data workers employed in a formal sector, we show that the prevalent characterisation of data work as being invisible or precarious is not inherent to AI nor inevitable in its labour processes. Rather, it is produced through the specific embedding of AI production within the political economy of startup capitalism. Through this, we seek to recentre the discourse on AI and future-of-work away from deterministic projections of AI’s impact on work and towards the specific labour processes of AI and its implications for the skills and career trajectories of a young and growing workforce in the Global South.
References
Akst, Daniel. 2013. “Automation Anxiety.” The Wilson Quarterly 37(3).
https://www.jstor.org/stable/wilsonq.37.3.06.
Aneesh, Aneesh. 2001. “Skill Saturation: Rationalization and Post-Industrial Work.” Theory and Society 30(3): 363–96.
https://www.jstor.org/stable/657966.
Autor, David H., Frank Levy, and Richard J. Murnane. 2003. “The Skill Content of Recent Technological Change: An Empirical Exploration.” The Quarterly Journal of Economics 118(4): 1279–1333.
https://doi.org/10.1162/003355303322552801.
Baum, Tom. 2008. “The Social Construction of Skills: A Hospitality Sector Perspective.” European Journal of Vocational Training 44(2): 74–88. Accessed June 13, 2024.
https://www.cedefop.europa.eu/files/etv/Upload/Information_resources/Bookshop/503/44_en_Baum.pdf.
Bilić, Paško. 2016. “Search Algorithms, Hidden Labour and Information Control.” Big Data & Society 3(1): 1–9.
https://doi.org/10.1177/2053951716652159.
Braverman, Harry. 1974. Labor and Monopoly Capital: The Degradation of Work in the Twentieth Century. New York: NYU Press.
https://www.jstor.org/stable/j.ctt9qfrkf.
Carswell, Grace, and Geert De Neve. 2024. “Training for Employment or Skilling up from Employment? Jobs and Skills Acquisition in the Tiruppur Textile Region, India.” Third World Quarterly 45(4): 715-733.
https://doi.org/10.1080/01436597.2022.2156855.
Chandhiramowuli, Srravya, and Bidisha Chaudhuri. 2023. “Match Made by Humans: A Critical Enquiry into Human-Machine Configurations in Data Labelling.” In Proceedings of the 56th Hawaii International Conference on System Sciences, 2007–2016.
https://hdl.handle.net/10125/102882.
Charmaz, Kathy. 2017. “The Power of Constructivist Grounded Theory for Critical Inquiry.” Qualitative Inquiry 23(1): 34–45.
https://doi.org/10.1177/1077800416657105.
Chernoff, Michael. [2010] 2013. “Social Displacement in a Renovating Neighborhood’s Commercial District: Atlanta.” In The Gentrification Debates: A Reader, edited by Japonica Brown-Saracino 295. New York: Routledge.
Cockburn, Cynthia. [1985] 1999. “‘Caught in the Wheels: The High Cost of Being a Female Cog in the Male Machinery of Technology’ and ‘The Material of Male Power.’” In The Social Shaping of Technology, edited by Donald Mackenzie and Judy Wajcman. Open University Press.
Cole, Matthew, Hugo Radice, and Charles Umney. 2021. “The Political Economy of Datafication and Work: A New Digital Taylorism?” Socialist Register 57: 78-99.
Crain, Marion, Winifred Poster, and Miriam Cherry, eds. 2016. Invisible Labor: Hidden Work in the Contemporary World. Berkeley: University of California Press.
https://socialistregister.com/index.php/srv/article/view/34948/26740.
Dugal, Ira. 2023. “Where Are the Jobs? India's World-beating Growth Falls Short.” Reuters, May 31, 2023. Accessed June 20, 2024.
Silkin, Lewis. 2021. “Deskilling: What Are the Historical, Societal and Legal Implications? — Future of Work Hub.” Futureofworkhub blog. April 28, 2021. Accessed June 15, 2024.
Ekbia, Hamid, and Bonnie Nardi. 2014. “Heteromation and Its (Dis)Contents: The Invisible Division of Labor between Humans and Machines.” First Monday 19(6).
https://doi.org/10.5210/fm.v19i6.5331.
⸻. 2017. Heteromation, and Other Stories of Computing and Capitalism. Cambridge, MA: MIT Press.
https://doi.org/10.7551/mitpress/10767.001.0001.
Graham, Mark, Isis Hjorth, and Vili Lehdonvirta. 2017. “Digital Labour and Development: Impacts of Global Digital Labour Platforms and the Gig Economy on Worker Livelihoods.” Transfer: European Review of Labour and Research 23(2): 135–62.
https://doi.org/10.1177/1024258916687250.
Gray, Mary L., and Siddharth Suri. 2019. Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass. Eamon Dolan Books.
Gupta, Hemangini. 2019. “Testing the Future: Gender and Technocapitalism in Start-up India.” Feminist Review 123(1): 74–88.
https://doi.org/10.1177/0141778919879740.
Hicks, Mar. 2017. Programmed Inequality: How Britain Discarded Women Technologists and Lost Its Edge in Computing. Cambridge, MA: MIT Press.
Hube, Christoph, Besnik Fetahu, and Ujwal Gadiraju. 2019. “Understanding and Mitigating Worker Biases in the Crowdsourced Collection of Subjective Judgments.” In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 407, 1–12.
https://doi.org/10.1145/3290605.3300637.
Ilavarasan, P. Vigneswara. 2008. “Software Work in India: A Labour Process View.” In In an Outpost of the Global Economy: Work and Workers in India’s Information Technology Industry, edited by Carol Upadhya and A. R. Vasavi, 162–89. New Delhi: Routledge.
Irani, Lilly C. 2015a. “The Cultural Work of Microwork.” New Media & Society 17(5): 720–39.
https://doi.org/10.1177/146144483511926.
⸻. 2015b. “Justice for ‘Data Janitors.’” Public Books Blog. January 15, 2015. Accessed June 15, 2024.
https://www.publicbooks.org/justice-for-data-janitors/.
Irani, Lilly C., and M. Six Silberman. 2013. “Turkopticon: Interrupting Worker Invisibility in Amazon Mechanical Turk.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 611–20. Paris, France: ACM.
https://doi.org/10.1145/2470654.2470742.
Janah, Leila. 2017. Give Work: Reversing Poverty One Job at a Time. New York, Penguin Random House Publishing.
Joshi, Sonam. 2019. “How Artificial Intelligence Is Creating Jobs in India, Not Just Stealing Them.” The Times of India, September 9, 2019. Accessed June 15, 2024.
Mehrotra, Karishma. 2022. “Human Touch.” Fifty-Two blog. July 23, 2022.
https://fiftytwo.in/story/human-touch/.
Miceli, Milagros, Martin Schuessler, and Tianling Yang. 2020. “Between Subjectivity and Imposition: Power Dynamics in Data Annotation for Computer Vision.” Proceedings of the ACM on Human-Computer Interaction, CSCW 4(2): 115, 1-25.
https://doi.org/10.1145/3415186.
Miceli, Milagros, and Julian Posada. 2022. “The Data-Production Dispositif.” Proceedings of the ACM on Human-Computer Interaction 6(2): 460, 1-37.
https://doi.org/10.1145/3555561.
Munn, Luke. 2022. Automation Is a Myth. Redwood City, CA: Stanford University Press.
Murali, Anand. 2019. “How India’s Data Labellers Are Powering the Global AI Race.” FactorDaily, March 21, 2019. Accessed June 14, 2024.
https://archive.factordaily.com/indian-data-labellers-powering-the-global-ai-race/.
Murgia, Madhumita. 2019. “AI’s New Workforce: The Data-Labelling Industry Spreads Globally.” Financial Times Blog. August 8, 2019. Accessed June 14, 2024.
Murphy, Michelle. 2017. The Economization of Life. Durham, NC: Duke University Press.
Natarajan, Sarayu, Suha Mohamed, Kushang Mishra, and Alex Taylor. 2021. “Just and Equitable Data Labelling: Towards a Responsible AI Supply Chain.” Report. Aapti Institute. February 25, 2021. Accessed June 14, 2024.
https://aapti.in/blog/just-and-equitable-data-labelling/.
Newlands, Gemma. 2021. “Lifting the Curtain: Strategic Visibility of Human Labour in AI-as-a-Service.” Big Data & Society 8(1):1–14.
https://doi.org/10.1177/20539517211016026.
Pietrobelli, Carlo, and Roberta Rabellotti. 2011. “Global Value Chains Meet Innovation Systems: Are there Learning Opportunities for Developing Countries?” World Development 39(7): 1261–69.
https://doi.org/10.1016/j.worlddev.2010.05.013.
Posada, Julian. 2021. “Why AI Needs Ethics from Below.” AI Now Institute Website, Guest Post in the entry “Labor” of the “New AI Lexicon.” September 23, 2021. Accessed June 14, 2024.
https://ainowinstitute.org/publication/a-new-ai-lexicon-labor.
⸻. 2022. “Embedded Reproduction in Platform Data Work.” Information, Communication & Society 25(6): 816–834.
https://doi.org/10.1080/1369118X.2022.2049849.
Poster, Winifred R. 2016. “The Virtual Receptionist with a Human Touch: Opposing Pressures of Digital Automation and Outsourcing in Interactive Services.” In Invisible Labor: Hidden Work in the Contemporary World, edited by Marion Crain, Winifred Poster, and Miriam Cherry,87–112. Berkeley: University of California Press.
https://doi.org/10.1525/9780520961630-007.
Raval, Noopur. 2021. “Interrupting Invisibility in a Global World.” ACM Interactions 28(4): 27–31.
https://doi.org/10.1145/3469257.
Rigby, Mike, and Enric Sanchis. 2006. “The Concept of Skill and Its Social Construction.” European Journal of Vocational Training 37: 22–33. Accessed June 15, 2024.
https://www.cedefop.europa.eu/files/etv/Upload/Information_resources/Bookshop/430/37_en_rigby.pdf.
Roberts, Sarah T. 2016. “Commercial Content Moderation: Digital Laborers’ Dirty Work.” In The Intersectional Internet: Race, Sex, Class, and Culture Online, edited by Safyia Umoja Noble and Brendesha M. Tynes, 147–159.
Sambasivan, Nithya, Shivani Kapania, Hannah Highfill, Diana Akrong, et al. 2021. “‘Everyone Wants to Do the Model Work, Not the Data Work’: Data Cascades in High-Stakes AI.” In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems 39: 1–15.
https://doi.org/10.1145/3411764.3445518.
Sanyal, Kalyan, and Rajesh Bhattacharyya. 2009. “Beyond the Factory: Globalisation, Informalisation of Production and the New Locations of Labour.” Economic and Political Weekly 44(22): 35–44.
https://www.jstor.org/stable/40279056.
Shestakofsky, Benjamin. 2017. “Working Algorithms: Software Automation and the Future of Work.” Work and Occupations 44(4): 376-423.
https://doi.org/10.1177/0730888417726119.
⸻. 2020. “Stepping Back to Move Forward: Centering Capital in Discussions of Technology and the Future of Work.” Communication and the Public 5(3–4): 129–33.
https://doi.org/10.1177/2057047320959854.
Tubaro, Paola, Antonio A. Casilli, and Marion Coville. 2020. “The Trainer, The Verifier, The Imitator: Three Ways in Which Human Platform Workers Support Artificial Intelligence.” Big Data & Society 7(1).
https://doi.org/10.1177/2053951720919776.
Upadhya, Carol. [2011] 2020. “Software and the ‘New’ Middle Class in the ‘New India.’” In Elite and Everyman: The Cultural Politics of the Indian Middle Classes, edited by Amita Baviskar and Raka Ray, 167–92. New Delhi: Routledge.
Upadhya, Carol, and Aninhalli Rame Vasavi, eds. 2008. In an Outpost of the Global Economy: Work and Workers in India’s Information Technology Industry. New Delhi: Routledge India.
Wang, Ding, Shantanu Prabhat, and Nithya Sambasivan. 2022. “Whose AI Dream? In Search of the Aspiration in Data Annotation.” In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems 582: 1–16.
https://doi.org/10.1145/3491102.3502121.
Warhurst, Chris, Chris Tilly, and Mary Gatta. 2017. “A New Social Construction of Skill.” In The Oxford Handbook of Skills and Training, edited by John Buchanan, David Finegold, Ken Mayhew, and Chris Warhurst, 72–91.
Copyright (c) 2024 BIDISHA CHAUDHURI
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
