Hostname: page-component-cd9895bd7-8ctnn Total loading time: 0 Render date: 2024-12-23T07:18:31.808Z Has data issue: false hasContentIssue false

AIEDAM thematic collection: a perspective on data-enabled design – design meet data science

Published online by Cambridge University Press:  21 February 2023

Jacky Bourgeois*
Affiliation:
Delft University of Technology, Delft, The Netherlands
Maaike Kleinsmann
Affiliation:
Delft University of Technology, Delft, The Netherlands
*
Author for correspondence: Jacky Bourgeois, E-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Type
Guest Editors’ Notes
Copyright
Copyright © The Author(s), 2023. Published by Cambridge University Press

This special issue shows a thematic collection of papers representing far-reaching collaborations between data sciences and design research that led to the emerging field of data-enabled design. This emerging field is promising since the prevalent adoption of Artificial Intelligence (AI) will allow designers to get continuous and systematic insights into and an understanding of the system they design for. This is because AI-based systems generate data that could (continuously) be incorporated into the design process.

However, incorporating the data from AI-based systems requires changes in the design process as well as in the mindset of design researchers and data scientists. This is because there is a misalignment between thick and small data from traditional user-centered design methods and big and thin from data sciences (Bornakke and Due, Reference Bornakke and Due2018).

In this special issue, we aim to bring these two worlds together, which represents a journey that started almost a decade ago from two different perspectives.

From a technology perspective, Bourgeois et al. leveraged the Internet of Things to understand householders’ behavior better (Reference Bourgeois, van der Linden, Kortuem, Price and Rimmer2014a, Reference Bourgeois, van der Linden, Kortuem, Price and Rimmer2014b). It led to an iterative prototyping process for developing home energy solutions. It quickly became evident that the abundance of sensor data only provides the “what”. The participatory analysis of these data with householders completed the picture, revealing critical information that iteratively shaped the proposed solutions. However, the design involved in this analysis remained limited. Close collaboration with design researchers and practitioners would have facilitated the data shaping and storytelling, important steps to extract valuable insights throughout the interactions with householders. In this process, the combination of technical and design perspectives is essential to effectively and responsibly engage people whose behavior is captured in the data and shape data into forms that trigger reflection.

From a design perspective, Kleinsmann et al. showed that data-enabled design could support the design process by adding community-level data to the design process (see, e.g., Jung et al., Reference Jung, Kleinsmann and Snelders2022). Through their “Quantified Heart” study, they explored how self-monitoring of blood pressure and other data points (e.g., health-related experiences) of a group of lead users from the Quantified Self community could be a source of new insights and ideas for new health ecosystems (Pannunzio et al., Reference Pannunzio, Kleinsmann, Duarte and Snelders2020). They found that this new type of user data could support designers in finding the ecosystem boundaries, defining the system and propositions, and getting insights into possible (technical) challenges for users. Although Kleinsmann and her colleagues incorporated new types of data that were generated from the design process into the design process, the way they analyzed and discussed the data with participants is still closely related to traditional user-centered design methods such as co-reflection (Tomico et al., Reference Tomico, Frens and Overbeeke2009).

Design and data science have become a flourishing meeting point today. Van Kollenburg and Bogers explored how sensor data, combined with contextualized insights from interviews, can be used as a design material for remote design interventions and translated their findings into a framework for data-enabled design (Reference van Kollenburg and Bogers2019; Bogers et al., Reference Bogers, Frens, Van Kollenburg, Deckers and Hummels2016). Giaccardi et al. explored how the perspective of things can introduce new ways for humans and non-humans to collaborate and generate design insights (Reference Giaccardi, Cila, Speed and Caldwell2016; Chang et al., Reference Chang, Giaccardi, Chen and Liang2017). King et al., coming from a data-driven design perspective (originally evolving around big and thin data), argue for data-aware design. Describing a mindset for designers to validate design decisions by looking beyond “clicks” and “conversion rates” opens for a combination with thick data (Reference King, Churchill and Tan2017). Gorkovenko et al. sketch and explore possibilities for future design practices (Reference Gorkovenko, Burnett, Thorp, Richards and Murray-Rust2020) and ethnographic processes around sensor data, observations, and probing questions (Reference Gorkovenko, Burnett, Thorp, Richards and Murray-Rust2019). These highlights show eagerness from the design field to leverage data science, although remaining in the scientific discourse.

Design researchers and data scientists actively joined forces at the Faculty of Industrial Design Engineering of the Delft University of Technology. An example we like to mention here is the Master thesis project of Hosana Morales (Reference Morales2020). Morales did a project in pediatric cardiology in close collaboration with cardiologists for the Sofia Children's Hospital in Rotterdam, The Netherlands. Children with congenital heart disease luckily survive childhood as a result of improved medical care. However, they often develop secondary cardiovascular problems due to their sedentary behaviors. This project aims to support children with congenital heart disease to do more physical activity through remote care. We also include the parents in the solution because one of the main reasons for the lack of physical activity is the parents’ overprotective attitude. So, we aim to design a system for both the children and the caregivers. The first step of the design process was to develop a patient and parent journey. The input for this journey was community-level data that we derived from social platforms worldwide on which parents of children who suffer from early heart defects wrote their experiences. We developed a new method to analyze these stories using multiple machine learning techniques. In this way, AI technologies supported our design process and made it possible to use community-level data. The result was a patient journey that we generated with relatively little resources, through which we could quantify certain events which we could not have done without using AI technologies. Especially, these quantifications of symptoms and experiences formed a rich additional input for the design process. Clinicians, parents, and children recognized this automated patient journey. It formed the input for a co-creation session and a design phase that followed. This all led to the design of a concept called “Bo” that you can see in Figure 1. Bo consists of a chatbot for parents, a wearable for the kids, and a dashboard for clinicians.

Fig. 1. A smart product service system to support parents and children with a congenital heart disease to be more physically active in a safe manner called “Bo” (Morales, Reference Morales2020).

In this thematic collection, we elaborate further on this far-reaching collaboration between design research and data science by bringing together a set of six papers across this meeting point, from design to data science. This attempt to consolidate this emerging field highlights recent developments and directions in a single venue. This is a collection to trigger our readers’ thoughts. What is in there for designers and data scientists? What are the roles of data in design processes in which designers and data scientists work together? What are the touching points between the two fields? How to educate future designers to use data as new material and how to teach data scientists about the design process?

The boundary between a prototype and a product that is put in the real world is disappearing because software-based products are continuously prototyped, released, and redesigned based on user data enabled through the Internet. The growing place of Internet of Things’ technologies brings opportunities for continuous changes and modification of the digital materiality to physical products. This disappearing boundary also removes the partition between the design and implementation process, leading to a continuous development and implementation cycle. Lee and colleagues highlight this never-ending design process that is enabled by these digital technologies. They present a model to support the integration of data in the design process by dealing effectively with the multiple paces and purposes that come with the digital and material artifacts.

Meyer and colleagues shed light on potentials and challenges, including the non-obvious value of data and frictions around data sharing. They also stress the limited value of product data for “completely new products”. Besides these challenges, they show how data can be a powerful means to improve manufacturing processes and product planning for product improvement since data can provide deep insights into the product's actual use.

Noortman and colleagues further highlight the potential of data as participatory and co-design material. Their Data-Enabled Design (DED) methods reflect the iterative process and aim for new products focusing on data interaction. They further develop this method toward a scalable approach. Through this process, they iteratively shrink the emphasis on design research, the lower loop of the DED model, towards the upper loop, involving more automation and closer to self-sustaining. By doing this, they stress the need and opportunity for a continuous transition. Throughout this design process, data lose its primary role of metric and assessment to become an inspiration material. Darzentas and colleagues illustrate this inspiration potential by sharing experience on museum experience co-design. Through a generator of Kitchen layout, Pejic and colleague branches to generative design to support designers with functional and inspirational inputs.

Finally, Machine Learning is today's natural habitat for data, and the role of designers is still being shaped further. Sun and colleagues demonstrate that designing these algorithms is a fundamentally iterative and data-driven process. The inML kit aims at supporting designers in playing a critical role in the design of these algorithms through prototyping and literacy.

We do not doubt that this small thematic collection merely scratches the surface of designing with data and the data-enabled design processes that come with it. This is a modest contribution to an emerging yet scattered field. One that empowers design with appropriate data tools and methods. One that transforms designers with new roles and responsibilities.

More specifically, we identify four major action points to realize the potential of data and AI as design material.

  • Cross-pollination of methods – It is essential to dissect the methods of the respective fields to identify potential strengths without colonizing design them. Concrete examples are data donation, crowdsourcing, or citizen science, each offering opportunities for human-centered design such as scalability or collaboration. Yet, these methods aim at insights which are often misaligned with the human-centered approach. What are the tools to mediate designerly interactions with data? How can designers engage participants in active collaboration to develop the insights they need through these scalable data collection methods?

  • Transdisciplinary collaborations throughout the product lifetime – The development of a transdisciplinary community with a common language of data-enabled design methods is essential to facilitate the use of data and AI throughout the design process. It enables to educate designers and data scientists with the appropriate literacy and collaboration mindset. How do designers inject their data collection points to generate the insights and evidence they need for the subsequent design iterations? How to integrate these technologies into the creative phases of the design process?

  • Empower designers and data scientists to take responsibility – While collaborating, designers must remain independent in their ability to iteratively prototype and test their design solutions. What are the appropriate tools to empower designers to experience, shape, and design with data and AI? How to nurture a responsible use of these technologies to foresee risks, minimize biases, and deal with personal, intimate behavioral data?

  • Shape human-agent relations . AI technologies have transformed the nature of technological artifacts from being passive and reactive to active, life-like, forever learning, and adapting. The way these new technologies shape societal transitions is strongly influenced by the relationships and partnerships between humans and artificial agents. We see data-enabled design methods as powerful means to shape these new relations in an iterative and human-centered manner.

Jacky Bourgeois is an Assistant Professor and Director of the Data-Centric Design Lab with the Department of Sustainable Design Engineering (SDE) of the Faculty of Industrial Design Engineering (IDE) of the Delft University of Technology. With a background in computer science, Jacky investigated the design of ubiquitous technologies to support domestic energy practices of “energy farmers”, that is, households that generate their own energy from solar panels. He combined exploratory interviews, participatory data analysis, and in-home interventions to get a deep understanding of this context. He investigated case studies focusing on Energy Demand-Shifting in the context of domestic solar electricity generation around the laundry and the electric mobility routines. His objective was to understand the connection between consumption and local generation and design support for emerging energy practices. This process led him to appreciate data generated from the Internet and the Internet of Things as key resources in the design of end-user products and services. However, designers often lack the necessary data literacy to use this resource effectively and ethically as part of their design process. Jacky dedicates his research and teaching effort to addressing this challenge.

Prof. Dr. ir. Maaike Kleinsmann (1976) is a full professor of Design for Digital Transformation in the Department of Design, Organisation and Strategy at the Faculty of Industrial Design Engineering at Delft University of Technology in Delft, The Netherlands. From Spring 2022 onwards, she will become the department head of the Design, Organisation and Strategy. She is also a board member of the National eHealth Living Lab (NeLL), scientific lead of Healthy Start (Convergence Flagship), scientific board member of the Delft Health Initiative, co-director of the International Special Interest Group of Health Systems Design (Design Society), and director of CardioLab (Delft Design Lab). She investigates how novel co-creative and data-driven design approaches can support ecosystems (consisting of public and private companies and users) with the digital transformation of healthcare in such a way that it is centered around human values, intentions, wishes, and behaviors. She particularly focuses on the transformation from hospital care towards care at home with the use of Smart Remote Patient Management systems. Kleinsmann was awarded with several NWO research grants. Maaike's work is published in leading design journals, such as Design Studies, International Journal of Design, CoDesign, and the Journal of Engineering Design. Besides her academic work, she advises companies on design driven innovation and transdisciplinary design.

References

Bogers, S, Frens, J, Van Kollenburg, J, Deckers, E and Hummels, C (2016) Connected baby bottle: a design case study towards a framework for data-enabled design. In DIS 2016 - Proceedings of the 2016 ACM Conference on Designing Interactive Systems: Fuse. New York, NY, USA: Association for Computing Machinery, Inc. pp. 301–311. doi:10.1145/2901790.2901855CrossRefGoogle Scholar
Bornakke, T and Due, BL (2018) Big–thick blending: a method for mixing analytical insights from big and thick data sources. Big Data and Society 5, 116. doi:10.1177/2053951718765026CrossRefGoogle Scholar
Bourgeois, J, van der Linden, J, Kortuem, G, Price, BA and Rimmer, C (2014a) Conversations with my washing machine: an in-the-wild study of demand shifting with self-generated energy. In UbiComp '14: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. New York, NY, USA: Association for Computing Machinery, pp. 459470. https://dl.acm.org/doi/10.1145/2632048.2632106CrossRefGoogle Scholar
Bourgeois, J, van der Linden, J, Kortuem, G, Price, BA and Rimmer, C (2014b) Using participatory data analysis to understand social constraints and opportunities of electricity demand-shifting. In Proceedings of the 2014 conference ICT for Sustainability. Atlantis Press, pp. 392–401. https://doi.org/10.2991/ict4s-14.2014.49CrossRefGoogle Scholar
Chang, WW, Giaccardi, E, Chen, LL and Liang, RH (2017) “Interview with things”: a first-thing perspective to understand the scooter's everyday socio-material network in Taiwan. DIS 2017 – Proceedings of the 2017 ACM Conference on Designing Interactive Systems, Vol. 1, pp. 1001–1012. doi:10.1145/3064663.3064717CrossRefGoogle Scholar
Giaccardi, E, Cila, N, Speed, C and Caldwell, M (2016) Thing ethnography: doing design research with non-humans. In DIS 2016 – Proceedings of the 2016 ACM Conference on Designing Interactive Systems: fuse. New York, NY, USA: Association for Computing Machinery, pp. 377–387. doi:10.1145/2901790.2901905CrossRefGoogle Scholar
Gorkovenko, K, Burnett, DJ, Thorp, J, Richards, D and Murray-Rust, D (2019) Supporting real-time contextual inquiry through sensor data supporting real-time contextual inquiry through sensor data. In Ethnographic Praxis in Industry Conference Proceedings. Edinburgh, UK, pp. 1–29.Google Scholar
Gorkovenko, K, Burnett, DJ, Thorp, JK, Richards, D and Murray-Rust, D (2020) Exploring the future of data-driven product design. In Conference on Human Factors in Computing Systems – Proceedings. New York, NY, USA: Association for Computing Machinery, pp. 1–14. doi:10.1145/3313831.3376560CrossRefGoogle Scholar
Jung, J, Kleinsmann, M and Snelders, D (2022) A vision for design in the era of collective computing. Journal of Engineering Design 33, 305342.CrossRefGoogle Scholar
King, R, Churchill, EF and Tan, C (2017) Designing with data: Improving the user experience with A/B testing. O'Reilly Media, Inc.Google Scholar
Morales, H (2020) Bo: An intelligent network agent to promote physical activity in children with congenital heart defects. Master Thesis. http://resolver.tudelft.nl/uuid:fd895415-c353-41d5-8430-f0a67fd40ad4Google Scholar
Pannunzio, V, Kleinsmann, M, Duarte, C and Snelders, D (2020) Finding the land, planting first seeds; lead user research in early stage design for intelligent ecosystems. In Proceedings of the Design Society: DESIGN Conference, Vol. 1. Cambridge University Press, pp. 2099–2108.CrossRefGoogle Scholar
Tomico, O, Frens, JW and Overbeeke, CJ (2009) Co-reflection: user involvement for highly dynamic design processes. In CHI'09 Extended Abstracts on Human Factors in Computing Systems, pp. 2695–2698.CrossRefGoogle Scholar
van Kollenburg, J and Bogers, S (2019) Data-enabled design : a situated design approach that uses data as creative material when designing.Google Scholar
Figure 0

Fig. 1. A smart product service system to support parents and children with a congenital heart disease to be more physically active in a safe manner called “Bo” (Morales, 2020).