Policy Significance Statement

The Exploring practices of “data-driven innovation” in the European public sector collection includes articles that examine different practical dimensions of data-driven innovation projects. The collection helps to understand what types of innovation practices exist in Europe’s public sector, what distinguishes these practices, how these different practices can be studied, and what their political, moral, economic, and organizational implications are. The collection raises questions about what it means for data-driven innovation practices to succeed or fail, according to whom. It also proposes perspectives for policymakers on how to study what could be required to support data innovation practices adequately, including through symbolic investments (e.g., in ethics and norms) and material investments (e.g., in infrastructure).

2. Overview of papers

For this collection, we accepted contributions informed by a practice-based understanding of data policies that were open to different conceptual and methodological approaches of what constitutes a practice and how to study it conceptually and methodologically. Thereby, we wanted to reflect the varieties of practice-theoretical approaches conducted around the public sector. The scholars represented in this collection belong to disciplines such as information sciences, sociology, media studies, STS, and empirical philosophy.

Gangneux and Joss explore in their article “Crisis as driver of digital transformation? Scottish local governments’ response to COVID-19” how the COVID-19 pandemic has led to an intensification of public sector data use and sharing between Scottish local authorities. Using surveys, focus group discussions, and interviews, the paper discusses how authorities exchanged health-related data and integrated datasets related to public services. The authors suggest that the surveyed local governments predominantly worked with, and exchanged public sector data, while third-sector data were seen as useful by many respondents but rarely used, thus highlighting a discrepancy between perceived importance and practical use. The article also suggests that Scottish local authorities were quick to adapt their data integration and sharing approaches to deliver information on the COVID-19 pandemic, while also highlighting the need for sustained investments to grow teams and infrastructure.

Liva et al. (Reference Liva, Micheli, Schade, Kotsev, Gori and Codagnone2023) ask in their article “City data ecosystems between theory and practice: A qualitative exploratory study in seven European cities” what currently prevents the establishment of data ecosystems, examining the experiences and obstacles to data sharing within seven municipal administrations in Europe. Relying on expert interviews with policy officers, technology specialists, or heads of unit of digital or smart city departments, the study explored the roles and perspectives of actors engaged in a data sharing ecosystem, the incentives to share data, data governance models, and technologies for data sharing. Its findings suggest that across all surveyed cities, private sector organizations play a limited role in data sharing, that technological perspectives of the data ecosystems capture the attention of cities’ representatives more than the socio-technological ones, and the predominance of centralized digital infrastructure.

Chignard and Glatron consider, through 10 years of experience in the French city Rennes, how data collaborations are organized at a local scale. Their article “Data collaborations at a local scale: Lessons learnt in Rennes (2010–2021)” elaborates on trustworthy data governance at municipal level, using cases from the culture and energy sectors. They pay particular attention to the relationships between the different actors that are involved in data sharing and use, and underline three main messages. First, they advocate for a holistic approach to data governance, especially at the local level, due to the power dynamics between different sectoral data governance approaches that interact are highly intertwined. Second, Chignard and Glatron call for public authorities to act in their role as infrastructure providers and potential data intermediaries—while at the same time being cautious of potential conflicts of interest, and suggesting the creation of a new non-for-profit data intermediary at the local level. Third, the authors underline the required (long) process of building trust between the many actors that are involved in the data exchange and its valorization. They stress the need for strategic alignments and regulatory frameworks that enable in-depth experimentation and accept failures.

Thuermer et al. (Reference Thuermer, Walker, Simperl and Carr2024) explore how quadruple helix collaborations between SMEs, municipal authorities, and citizens may utilize citizen data toward the benefit of citizens in order to accomplish more just outcomes through data innovation activities. In their article “When data meets citizens: an investigation of citizen engagement in data-driven innovation programmes,” the authors develop a comparative case study of two air quality data collaborations in the United Kingdom and Belgium, how these envisioned the role of citizens as active participants and beneficiaries, and how the data were ultimately put to use. The study finds differences in how the collaborations accomplished benefits for citizens, which varied by how project stakeholders envisioned the roles and needs of citizens, how they designed and prioritized actions to accomplish these benefits, and funding priorities shaping engagement with citizens. The concrete realization of citizen engagement led to promissory future value and the improvement of processes within partner organizations, raising questions around the just distribution of such value. As a response, the authors argue for “data justice plans” as a way of informing citizen engagement in the funding and project development processes.

How the material and infrastructural dimensions matter for public data practices demonstrates the contribution by Gray. In his article “What do data portals do? Tracing the politics of online devices for making data public,” Gray explores novel digital methods for a study of the materiality and performance of data practices. Building on the notion of digital infrastructures as devices (Ruppert et al., Reference Ruppert, Law and Savage2013), his piece contributes three methods for empirically studying data portals as technopolitical devices, including interface analysis, software analysis, and metadata analysis. Each method provides an empirical entry point into how data portals become dynamic, heterogeneous, and contested sites of public sector datafication. These methodological approaches to data portals are intended to contribute to critically assessing how participation around public sector datafication is invited and organized with portals, and how participation may be rethought and recomposed.

Van Maanen discusses why a study of practices is always political. In his commentary “Studying open government data: Acknowledging practices and politics,” he reviews the recent turn toward practice-oriented studies of open government data initiatives, and explores what an emphasis on their practical and political dimensions might mean. Proposing a praxeographic approach (Mol, Reference Mol2002) to open government data practices, he argues that any seemingly stable phenomena such as databases should be seen as the results or products, rather than as starting points, of interactions that include discursive elements, material objectifications, and activities. Van Maanen argues that scholars should attend to how open government data policies present solutions to what kind of problems, and provide detailed empirical analysis of how different actors practically accomplish open data to address particular problems.

Wieringa explores what a praxeographic approach can teach us about how different actors realize algorithmic accountability in practice. In their research article “‘Hey SyRI, tell me about algorithmic accountability’: Lessons from a landmark case,” the authors ask how algorithmic accountability succeeds or falls short through different practices. Taking the Dutch System Risk Indication (SyRI) as an empirical case, the author argues that different fora enact different, and somewhat incompatible types of accountability, by asking different kinds of medium-specific questions about SyRI from different perspectives with varying power relations. Wieringa argues that the current way of enacting accountability in practice hinges predominantly on an ex ante responsiveness of political fora such as parliament and court, making mitigation of harms as they occur very difficult to mitigate for other actors. According to Wieringa, strengthening ex ante political accountability fora could help alleviate these shortcomings.

Kersing, van Zoonen, Putters, and Oldenhof’s article contributes to studies on the impact of data-driven tools on frontline bureaucrats with an exploration of how daily work practices, role identities, and norms of frontline bureaucrats change in situ when working with new data tools. Their article “The changing roles of frontline bureaucrats in the digital welfare state: The case of a data dashboard in Rotterdam’s Work and Income department” offers an empirical study about the impact of a data dashboard in the Work and Income Department of the municipality of Rotterdam. Through a mix of interviews, on-site observations, and document analysis, the authors describe a contested shift of role identities among frontline bureaucrats from a client coach toward a caseload manager. In the absence of established practical norms, the authors identify that the dashboard implementation is contested on the basis of data quality, service delivery quality, and what the dashboard’s data representations mean.

How practitioners involved in data innovation programs could develop good judgment of and sensitivity to ethical issues was explored in the contribution by Lähteenoja and Karhu. Their commentary “The virtuous smart city: Bridging the gap between ethical principles and practices of data-driven innovation” asked what a virtue-based approach could contribute to translate abstract normative principles into the daily work of practitioners who engage in and with data-driven innovation processes. Using a dialogic case-study approach, the authors explore in two cases of data-driven innovation in the city of Helsinki, Finland, and how such an approach could foster ethical sensitivity in practical situations of dealing with data-intense technologies. The authors argue that such an approach to sensitizing practitioners may be helpful for those cases of data-driven innovation in which novel and unknown contexts are explored in practice.

3. Analysis

By comparing the different concerns of the contributions, we can discern the following thematic clusters: the making of ethical and normative values in practice; organizational collaborations with and around data; and methodological innovations of studying data practices.

A practice-based perspective on data innovation initiatives suggests that the analytical value of data is often acknowledged as promissory future use, but it can be unclear in the existing situations studied. This finding applies to private company data shared with public institutions, to citizen-generated data for air pollution monitoring, as well as to data tools adopted in welfare departments. Several authors suggested that in order to understand value creation, the making of norms, ethics, and accountability must be understood in practice. Contributions approached these topics focusing on different units of analysis, including the moral improvisation work of frontline workers who must develop new roles in interaction with a dashboard (Kersing et al., Reference Kersing, van Zoonen, Putters and Oldenhof2022), the practical activities of public institutions and media to reconstruct the origins and effects of algorithmic harms (Wieringa, Reference Wieringa2023), a method for developing reflexive practices for data scientists (Lähteenoja and Karhu, Reference Lähteenoja and Karhu2023), or public–private collaborations that use citizen-generated data to address public issues (Thuermer et al., Reference Thuermer, Walker, Simperl and Carr2024). For instance, Thuermer et al. highlight a lack of institutional rules, such as professional norms or funding requirements, that would align data practices with the actual needs of citizens. In the absence of such rules, data innovation programs may create value for some other actors, such as the innovators themselves, while off-loading costs of ethical decision-making to frontline civil servants. Other authors (Lähteenoja and Karhu, Reference Lähteenoja and Karhu2023) emphasize the critical capacities of data and AI practitioners and methods for translating values into data-intense technologies. This perspective considers the role of data scientists as moral actors and develops reflexive methods that can foster their ethical sensitivity in practical situations of dealing with data in novel and unknown contexts. The contributions attest to the importance of studying the making of different values in practice—such as through ethical decision-making, the establishment of shared frames for action (i.e., norms), or accountability fora—and the effects and challenges different practices of realizing values bring about. Collectively, the contributions stress that existing data practices realize certain kinds of values. For instance, Kersing et al. show how the absence of formalized norms requires frontline staff to improvise moral decisions in practice. Taking a different example, Wieringa’s study of how algorithmic accountability is done in practice shows how different ways of practicing accountability create different kinds of accountability and different normative values associated with them. Based on these findings, we can extend the call by van Maanen to politicize the morality of data practices and call for a study of how data practices involve practices of valuation (Dussauge et al., Reference Dussauge, Helgesson, Lee, Dussauge, Helgesson and Lee2015). This may broaden our perspective on what kinds of norms and ethics are currently highlighted in the field and which ones are neglected.

Another set of contributions was interested in organizational collaborations with and around data. The pieces dedicated to this topic shared an interest in values actors associated with different kinds of data, organizational, technological, and legal arrangements to access, distribute, and reuse data, as well as the sustainability and justice of these efforts over time. It is noteworthy that these studies consider practices by reconstructing these arrangements through interviews, rather than employing on-site observations of how policymakers, designers, technologists, public servants, or other groups are involved in these activities. Regarding the value of accessing, distributing, and reusing data, the articles suggest a general tendency of public sector bodies to find data from within the public sector more valuable than from the private sector data. The study by Gangneux and Joss suggests that data originating from organizations outside of the public sector are perceived as less relevant due to the practical needs of public sector bodies. The studies confirm the argument made by Datta Burton et al. (Reference Datta Burton, Kieslich, Paul, Samuel and Prainsack2022) that the valuation of different data is relative to the practice in which data is used. Liva et al., for instance, suggest that while senior public sector officials suggest that private data may hold promissory value in the future, their usefulness is not clear in the current situation. Thuermer et al. suggest a similar finding for quadruple helix collaborations involving citizens on a municipal level in citizen science activities. Their study argues that municipal and private actors involved in soliciting air quality data envisioned benefits for citizens to accrue as a downstream effect. Value for citizens remained unfulfilled and without a clear pathway for realizing it, because these benefits were not integrated into the project architecture. These studies also considered the infrastructural setup of collaborating around data, mostly by surveying existing information infrastructure. This approach is less grounded in micro-perspectives of people’s practical activities, or how the materiality of infrastructure affects practices, but rather in mapping what we might call the “infrastructural situatedness” (Gerlitz et al., Reference Gerlitz, Helmond, Nieborg and van der Vlist2019) of data sharing infrastructure—that is, the relations and connections of data infrastructures to other technologies. Importantly, several of our contributions thematized the (lack of) sustainability of data infrastructures. The studies suggest that this may be related to a lack of investments to sustain the practices of staff to work with data infrastructure (Gangneux and Joss, Reference Gangneux and Joss2022), but it is also reflected in a lack of investments in norms and the adoption of technologies (Kersing et al., Reference Kersing, van Zoonen, Putters and Oldenhof2022).

A third insight concerns how practices of data innovation can be researched, bringing new methodological opportunities and challenges. It is noteworthy that several pieces in our collection, particularly those concerned with data sharing arrangements, took a rather conventional approach to qualitative research, such as surveys, expert interviews, or focus groups. While these are suitable for the reconstruction of people’s experiences, rationalizations, and explanations of everyday life phenomena, they may be less suited for observing (inter-)actions unfolding in process (as on-site observations would, for instance, do), and they rely on the ability of interviewees to verbalize areas of interest. The choice of methods may be related to how scholars conceptualize practices. If we consider the idea that practices are activities of accomplishing social order that include speech acts, material artifacts, and routine activities, we broaden the idea of a data practice. Some studies favored certain aspects of practices, including infrastructures, actor relations, and broad-term descriptions of activities (e.g., Liva et al., Reference Liva, Micheli, Schade, Kotsev, Gori and Codagnone2023), while bracketing policy promises from “actual practice.” However, following van Maanen’s commentary, we may argue that rather than separating discourse from practice, discourse is an important practice in its own right that frames goals and organizes activities that can stabilize the practice over time and give it durability. Some of our contributions offer promising avenues to reconstruct data innovation practices, for instance, by employing the ethnographic strategy of “scavenging” material (Wieringa, Reference Wieringa2023) to assemble a variety of empirical sources that account for the different symbolic and material aspects constitutive of data innovation practices. Another promising route is by employing novel digital methods approaches that shed light on the material aspects of data infrastructure, how they envision and enact particular kinds of good social relations, and how these material aspects can be repurposed to study data practices (Gray, Reference Gray2023). As Gray argues, the material traces of digital infrastructures and changes to these infrastructures may offer empirical insights into how conventions and imaginations of public value and public life are materialized and may enable or constrain certain actions with data and among actors.

4. Moving forward

These insights confirm that a practice-based approach adds value to the debate about data-driven innovation. However, what are possible future areas of study to advance the understanding of data policies and their translation into data innovation initiatives?

To start with, there is an opportunity to invite more social scientific and humanities contributions and to draw from their efforts to cross-pollinate between practice theories and topics such as infrastructure development and its effects on users. Such topics are longstanding concerns in STS and recently also emerging in fields like media and communication studies, as well as (critical) data studies (Leonelli, Reference Leonelli, Leonelli and Tempini2020). The different disciplinary contributions in this collection attest to the fruitfulness of practice perspectives on data and policy, both to inform future policy interventions and to better conceptualize what kinds of practices assemble and stabilize data policies and innovation initiatives.

We furthermore suggest that future studies could expand concepts and methods for studying data practices. While future works may usefully adopt micro-sociological research methods to reconstruct the daily activities of frontline staff, we note that the study of “larger” phenomena beyond micro-sociological settings, such as “data ecosystems” or “algorithmic systems” does not have to rely on micro-sociological concepts and methods (Nicolini, Reference Nicolini, Hui, Schatzki and Shove2016, see also Gray, Reference Gray2023; Wieringa, Reference Wieringa2023). A practice-oriented study of these phenomena—for instance, how data ecosystems are done in practice—could take inspiration from recent studies of media practices that take patterns of media consumption as an entry point into the infrastructural constraints that matter for practical action (Magaudda and Piccioni, Reference Magaudda and Piccioni2019; Dencik, Reference Dencik2020). Another promising approach could include the ethnographic method of following actors and data around as they circulate through organizational settings (Garnett et al., Reference Garnett, Ruckenstein, Venturini, Ziewitz, Van Geenen, Lämmerhirt, Burkhardt, Van Geenen, Gerlitz, Hind, Kaerlein, Lämmerhirt and Volmar2022). Rather than applying actor mappings or relying on the reconstructions of senior staff members in public institutions, such a perspective explores how people’s interactions with specific elements of data infrastructure—a database, a dashboard, a dataset—can help explore their dependencies from infrastructures, but also other constraints, such as norms regulating actions.

How data become valuable (or not) when it is circulated across settings is another intensely debated topic (Hoeyer, Reference Hoeyer2019; Leonelli, Reference Leonelli2019; Leonelli, Reference Leonelli, Leonelli and Tempini2020) that practice-theoretical studies could explore further. Past studies have argued that the value of data circulation and reuse is realized through expectations of future value (Datta Burton et al. Reference Datta Burton, Kieslich, Paul, Samuel and Prainsack2022), professional recognition (Gonzalez-Betancor and Dorta-Gonzalez, Reference Dorta-Gonzalez, Gonzalez-Betancor and Dorta-Gonzalez2021), as well as epistemic and material constraints (Tempini, Reference Tempini, Leonelli and Tempini2020). The studies in our collection suggest that the perceived value of data is an influencing factor for whether data is acquired and used, highlighting the importance of its practical usefulness for public sector bodies. Future studies could further systematize the practices through which data become meaningful and actionable when it circulates across organizations, and explore how specific material and symbolic constraints may influence its circulability.

Another opportunity for future investigations may consider what types of investment could formalize different kinds of data practices, and explore the effects of these investments. The studies in our collection suggest that data innovation initiatives and policies may be informed by certain kinds of investment while also lacking particular symbolic investments (such as efforts to routinize and train frontline staff for new dashboards), as well as material investments (when innovation initiatives are not supported by enough staff or budgets). The studies suggest that a lack of investments in normative formalization may lead to contestation among frontline workers over what roles they should adopt (a type of “investment” done by frontline workers themselves). Future studies could explore the establishment of normative guidelines and material resources (staff size, material infrastructure, budgets) that could structure different kinds of data practices. These studies could approach investments in a broad sense, including beyond monetary resources also the formulation of codes of conduct, opportunities for ethical reflection at work, and other symbolic and material forms (Thévenot, Reference Thévenot1984).