Hostname: page-component-586b7cd67f-r5fsc Total loading time: 0 Render date: 2024-11-22T01:03:25.309Z Has data issue: false hasContentIssue false

A human-centered approach for sharing patient experiences through digital storytelling: a research through design study

Published online by Cambridge University Press:  25 October 2024

Sana Behnam-asl*
Affiliation:
College of Design, North Carolina State University, Raleigh, NC, USA
Kelly Umstead
Affiliation:
College of Design, North Carolina State University, Raleigh, NC, USA
Raunak Mahtani
Affiliation:
College of Design, North Carolina State University, Raleigh, NC, USA
Kristin P. Tully
Affiliation:
Department of Obstetrics and Gynecology, School of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
Carolina Gill
Affiliation:
College of Design, North Carolina State University, Raleigh, NC, USA
*
Corresponding author Sana Behnam-asl [email protected]
Rights & Permissions [Opens in a new window]

Abstract

This article outlines a human-centered approach to developing digital patient stories, for sharing their experiences in health care, while preserving patient and others’ privacy. Employing a research-through-design approach, the study proposes a design solution using visualization and digital storytelling to document patients’ and families’ experiences and emotions, as well as their interactions with healthcare professionals in the postnatal unit. By transforming selected observational data into animated stories, this approach has the potential to elicit empathy, stimulate stakeholder engagement, and serve as a practical training tool for clinicians. This work was conducted as part of a broader study that aims to contribute to the existing knowledge base by advancing our understanding of stakeholder needs in birthing facilities and through postpartum discharge. This study primarily focuses on strategies for the development of digital stories and summarizes the factors that contributed to the production of digital stories within the context of sensitive data. It may serve as a valuable resource for students, researchers and practitioners interested in utilizing digital stories to encourage discussions, education and ultimately to enhance systems of health care for respect, equity and support.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press

1. Introduction

Designers are playing an increasingly active role in the healthcare sector, leveraging design-based research, visualization and prototyping methods to reimagine systems of care (Partridge Reference Partridge2017; Tsekleves & Cooper Reference Tsekleves and Cooper2017; Mahtani et al. Reference Mahtani, Gill, Umstead, Behnam Asl and Tully2022; Lamé et al. Reference Lamé, Crowe, Komashie and Royston2023). This trend has been accompanied by the recognition and adoption of human-centered design (HCD) within the healthcare industry (Bazzano et al. Reference Bazzano, Martin, Hicks, Faughnan and Murphy2017; Göttgens & Oertelt-Prigione Reference Göttgens and Oertelt-Prigione2021; Melles, Albayrak, & Goossens Reference Melles, Albayrak and Goossens2021), which places the human at the center of the research and development process of interventions, using techniques such as visualization, communication between researchers and stakeholders, empathy and simulation to better understand and address the needs of all stakeholders (Bazzano et al. Reference Bazzano, Martin, Hicks, Faughnan and Murphy2017; Bjerkan et al., Reference Bjerkan, Hedlund and Hellesø2015; Giacomin Reference Giacomin2014; Gill et al. Reference Gill, Umstead, Behnam Asl and Mahtani2023; Hridi et al. Reference Hridi, Khan, Jadhav, Saedi, Nanda, Serrao and Watson2022; Saedi & Rice Reference Saedi and Rice2020; Saedi & Rice Reference Saedi, Einifar and Barati2021).

HCD is a systematic approach to innovative problem solving that requires meaningful engagement of stakeholders, collaboration, team effort and the integration of multidisciplinary skills and perspectives for refining solutions and designs through iterative feedback and user testing (Harte et al. Reference Harte, Glynn, Broderick, Rodriguez-Molinero, Baker, McGuiness, O’Sullivan, Diaz, Quinlan and ÓLaighin2014, Reference Harte, Glynn, Rodríguez-Molinero, Baker, Scharf, Quinlan and ÓLaighin2017; Li et al. Reference Li, Kramer, Gordon and Agogino2018; ISO 2019).

In health care, a human-centered perspective is crucial for understanding the unique needs, behaviors, expectations and lived experiences of target users and key stakeholders when assessing clinical strengths and gaps and co-developing health interventions (Barello et al. Reference Barello, Triberti, Graffigna, Libreri, Serino, Hibbard and Riva2016; Fleisher et al. Reference Fleisher, Bass, Shwarz, Washington, Nicholson, Alhajji, Geynisman, Maurer, Greener and Kenny2020). Maternal and postnatal health is a multifaceted and complex area (Arzamani et al. Reference Arzamani, Soraya, Hadi, Nooraeen and Saeidi2022), where HCD can be particularly effective by addressing existing disparities and promoting equitable access to care. The United States faces significant maternal and postnatal health problems due to factors such as racial biases, fragmented care and limited patient-focused support or education on maternity-related complications and health (CDC 2021; Petersen et al. Reference Petersen, Davis, Goodman, Cox, Syverson, Seed, Shapiro-Mendoza, Callaghan and Barfield2019b; Howell Reference Howell2018). Prompt recognition of maternal warning signs and risk appropriate responses in structurally competent healthcare systems could prevent two-thirds of maternal deaths (CDC 2019; Petersen et al. Reference Petersen, Davis, Goodman, Cox, Mayes, Johnston, Syverson, Seed, Shapiro-Mendoza, Callaghan and Barfield2019a; Howell Reference Howell2018). By prioritizing human-centered views, health interventions can be developed that are tailored to the unique requirements of the target stakeholders, leading to increased adoption, engagement and ultimately, improved health outcomes (Bazzano et al. Reference Bazzano, Martin, Hicks, Faughnan and Murphy2017; ISO 2019). This partnership is particularly important for addressing the maternal mortality and morbidity crises and improving maternity care-related outcomes (Jaynes, Brathwaite, & Tully Reference Jaynes, Brathwaite and Tully2022).

This study was one part of a multiphase, mixed methods study. The project aimed at generating new knowledge to inform improvements in maternal and postpartum healthcare systems. The investigators included designers, clinicians, researchers and engineers collaborating across three large research universities. The design research team was composed of two senior industrial design faculty members and two industrial design PhD students. The primary goal of this aspect of the research was to generate new knowledge to advance the understanding of stakeholder needs on the postnatal unit. The research partners included physicians and experts from fields such as, pediatrics, medical anthropology, clinical research, health equity, midwifery, nursing, maternal health, research management, health informatics, public health, epistemology, patient education, science communications, clinical implementation and infant health. In this article, we will refer to the design team as “design researchers’‘, collaborators and partners as “research partners” and the entire team as the “research team”. This work led to the generation of novel ways to conduct research and apply their skills, tools and methods for impact.

The research partners employed a multi-method approach to collect observational data, including partnership with new families and their healthcare team members to document their experiences on a postnatal unit. The video and audio recordings provided direct accounts of the participants’ emotional, behavioral and interactional dynamics during their postnatal stay and hospital discharge, recording moments of supportive and compassionate care as well as challenging situations that arose among patients, their families and healthcare professionals. The data offered unique insights into experiences that would have otherwise been difficult to convey, document and analyze.

Although such research data could potentially be directly used for clinician training and education, this type of data includes many issues that make this application inappropriate (Iedema et al. Reference Iedema, Forsyth, Georgiou, Braithwaite and Westbrook2006a, Reference Iedema, Long, Forsyth and Lee2006b; Asan & Montague Reference Asan and Montague2014). Naturalistic recordings contain extensive personal identifying information and the length of the videos, even for interactions that take place over minutes of time, would be too long for teaching and training purposes.

The data were initially collected to identify patterns of behavior, context and interactions in the postnatal unit. The richness of this dataset subsequently provided opportunities for design to effectively convey these important findings.

1.1. Aims

Using a human-centered perspective and a research-through-design (RtD) approach, this study proposed a design solution that leveraged visualization and digital storytelling to share selected experiences and emotions of patients and families in the postnatal unit while preserving the privacy of all participants (Seshadri et al. Reference Seshadri, Joslyn, Hynes and Reid2019). Transforming parts of the recordings into animated stories had the potential to evoke empathy, encourage stakeholder engagement and serve as a practical training tool for clinicians (Sitter, Beausoleil, & McGowan Reference Sitter, Beausoleil and McGowan2020; Lambert & Brooke Reference Lambert and Brooke2018). The research process utilized in this study was documented to inform frameworks for digital story development in the context of health care. In particular, contributing factors to the production of digital stories within the context of sensitive data were summarized. Certain sections were condensed to create concise digital narratives (typically lasting between 2 and 3 minutes), each focusing on a key issue. The primary emphasis of this article lies in the creation and evolution of the digital stories, rather than their subsequent implementation. This article can serve as a resource for students, researchers and practitioners interested in exploring the development of digital stories as a means of encouraging and provoking discussions on complex health-related topics to enhance care.

1.2. Naturalistic videos and digital storytelling

Naturalistic video refers to recording the real-time actions and verbalizations of individuals in their environment through unobtrusive video recording, with the purpose of systematically coding, analyzing and disseminating their experiences (Pink Reference Pink2007). Naturalistic videos have been used to observe complex social and health-related settings, including maternity care, to address patient safety and clinical efficiency (e.g., Iedema et al. Reference Iedema, Long, Forsyth and Lee2006b; Tully & Ball Reference Tully and Ball2012; Asl et al. Reference Asl, Naeini, Ensaniat, Khorshidian, Alipour and Asl2014). The use of video and audio data from clinical encounters can offer insights into the nuanced dynamics of these interactions, as well as the expressed emotions and reactions of patients and their companions. This information can be used to identify areas of improvement in patient care and provide positive examples of interactions between healthcare professionals and patients (e.g., Bensing, Verheul, & Van Dulmen Reference Bensing, Verheul and Van Dulmen2008; Tully & Ball Reference Tully and Ball2012). However, the possibility of using these videos as educational material for training healthcare professionals presents specific challenges due to the sensitive and confidential nature of the information. Obtaining consent from participants to share the videos outside of the study team may substantially limit enrollment and affect participation, while also introducing ethical management complexities (Everri et al. Reference Everri, Heitmayer, Yamin-Slotkus and Lahlou2020). Additionally, traditional formats for sharing qualitative data, such as accounts of interactions and representative quotes, may not fully convey the emotional and contextual information present in the videos (Evans et al. Reference Evans, Harrington, Patchen, Andrews, Gaminian, Ellis and Napolitano2019).

Digital storytelling offers an opportunity to appropriately and meaningfully share behaviors, contexts, nonverbal cues and environmental factors from observational data, providing important insight into the structure, content and emotions of clinical encounters. Digital storytelling has emerged as an art-based powerful method of conveying personal experiences in an engaging and compelling way (Lambert & Brooke Reference Lambert and Brooke2018). It involves the creation of brief narratives, typically lasting between 3 and 5 minutes, using a combination of images, video, audio and text (Gubrium Reference Gubrium2009; Stenhouse et al. Reference Stenhouse, Tait, Hardy and Sumner2013; Matthews & Sunderland Reference Matthews and Sunderland2017).

This method has been extensively employed in health care, education, advocacy and knowledge transfer (Sitter et al. Reference Sitter, Beausoleil and McGowan2020). Moreover, the approach has undergone significant development, incorporating various lengths, processes and technological formats. These lessons learned inform current tools for fostering engagement, persuasion, participatory visual research and behavior change (Boydell et al. Reference Boydell, Volpe, Cox, Katz, Dow, Brunger, Parsons, Belliveau, Gladstone, Zlotnik-Shaul and Cook2012; Scott et al. Reference Scott, Brett-MacLean, Archibald and Hartling2013). Focusing on the healthcare sector, digital storytelling has proven to be an effective tool for sharing culturally relevant and respectful information and messages. It provides an accessible way to engage patients in research and disseminate experiential knowledge to a larger audience (Gray, Young, & Blomfield Reference Gray, Young and Blomfield2015; Lal, Donnelly, & Shin Reference Lal, Donnelly and Shin2015; Hardy Reference Hardy2016; Moreau et al. Reference Moreau, Eady, Sikora and Horsley2018). Healthcare practitioners, educators, advocates and researchers have successfully partnered with community members to create powerful digital stories that serve as a participatory visual research method, and their effectiveness has been widely recognized and documented in literature (Cueva et al. Reference Cueva, Kuhnley, Revels, Schoenberg, Lanier and Dignan2016; Gubrium et al. Reference Gubrium, Fiddian-Green, Lowe, DiFulvio and Del Toro-Mejías2016; de Jager et al. Reference De Jager, Fogarty, Tewson, Lenette and Boydell2017).

In the context of maternity care, digital stories and narrative-based videos have been found to promote various behavioral changes and enhance well-being, including managing stress and weight, increasing awareness, encouraging physical activity, adopting healthy lifestyles and improving communication practices (Evans et al. Reference Evans, Harrington, Patchen, Andrews, Gaminian, Ellis and Napolitano2019; Haith-Cooper et al. Reference Haith-Cooper, Stacey, Bailey and Broadhead-Croft2020; Parsons et al. Reference Parsons, Newby, French, Bailey and Inglis2021; Farao Reference Farao2023). Additionally, studies have shown that digital storytelling can be a powerful tool for enhancing empathy and understanding among healthcare professionals, particularly in areas such as neonatal care and midwifery. For example, Charon (Reference Charon2004) emphasizes the concept of “narrative competence” as a valuable skill for medical practitioners, highlighting the significance of being responsive toward emotional needs of others in medical context.

Moreover, arts-based digital storytelling based on parents’ experiences in neonatal care has been found to enhance empathy in nursing students (Petty Reference Petty2023). Similarly, Thompson, Lamont-Robinson, & Younie (Reference Thompson, Lamont-Robinson and Younie2010) advocate for the inclusion of artistic creativity within the medical curriculum, suggesting that fostering creativity is essential for developing well-rounded and emotionally intelligent medical practitioners. In addition to enhancing understanding, digital storytelling has the potential to improve communication skills, ethical practice and cultural competence among healthcare professionals. By accessing personal narratives and experiences, healthcare professionals can gain valuable insights into the emotional and contextual aspects of patient care (Petty, Jarvis, & Thomas Reference Petty, Jarvis and Thomas2020), which may lead to more compassionate and effective healthcare delivery.

Similarly, Kalra et al. (Reference Kalra, Subramaniam, Longkumer, Siju, Jose, Srivastava, Lin, Handu, Murugesan, Lloyd and Madriz2022) implemented a quality improvement program in Bihar, India, to enhance intrapartum care in public health facilities. Nurses participated in simulation sessions complemented by a digital interactive comic series featuring a simulation facilitation superhero called “Super Divya,” aimed at reinforcing key concepts and strengthening the simulation educator’s facilitation skills. The study involved 205 simulation educators who received comic modules, with pre-post surveys conducted with each module. The results showed significant improvements in the knowledge of simulation educators regarding concepts important for successfully conducting simulation training.

Digital storytelling has the potential to significantly enhance medical education and healthcare delivery by providing an engaging, empathetic and culturally sensitive approach to learning and practice. By integrating digital storytelling into medical curricula and professional development programs, healthcare professionals can enhance their skills, improve patient outcomes and contribute to a more compassionate and patient-centered healthcare system (Petty et al. Reference Petty, Jarvis and Thomas2020; Kalra et al. Reference Kalra, Subramaniam, Longkumer, Siju, Jose, Srivastava, Lin, Handu, Murugesan, Lloyd and Madriz2022; Noya, Oguro, & Horiuchi Reference Noya, Oguro and Horiuchi2022; Petty Reference Petty2023).

However, despite its potential as an educational and health promotion tool in the context of maternal health care, the use of digital storytelling in this context is underexplored. Therefore, this study aims to illuminate the role of digital storytelling in generating knowledge and provoking discussion around maternal health care, while exploring its potential for promoting collaboration and improving systems of care.

1.3. Research approach

This study employed a Research through Design approach (Stappers & Giaccardi Reference Stappers and Giaccardi2014), which involved combining the processes of designing and conducting user research using prototypes and iterative engagement of stakeholders. Knowledge was gathered through the creation of design concepts and prototypes and evaluation of these prototypes with the research partners.

Research through design

RtD is an approach that employs design and design thinking as key elements in generating new knowledge and addressing research questions (Koskinen et al. Reference Koskinen, Zimmerman, Binder, Redstrom and Wensveen2013). This research approach draws upon principles and practices from various design fields, including product design, architecture, interaction design and graphic design, among others. RtD involves creating and testing design artifacts or interventions in real-world contexts as a means of exploring research problems and generating new insights (Stolterman & Wiberg Reference Stolterman and Wiberg2010). The focus of RtD is not only on the final design product, but also on the design process itself and the knowledge gained through it. RtD primarily focuses on exploring and understanding design problems and opportunities through the process of designing and creating artifacts, such as prototypes or concepts. The prototypes and concepts helped to identify questions that were not apparent previously. In RtD, the approach can start with varying steps depending on the specific goals of the research and the preferences of the researchers or designers involved. However, generally speaking, RtD typically begins with a design problem or opportunity rather than with predefined research questions (Zimmerman, Forlizzi, & Evenson Reference Zimmerman, Forlizzi and Evenson2007). RtD is particularly relevant in contexts where traditional research methods may not be adequate or where new solutions to complex problems are needed (Stappers & Giaccardi Reference Stappers and Giaccardi2014). Given the potential of RtD, researchers can utilize this approach for addressing complex problems and finding patterns about different aspects of the phenomenon using appropriate RtD framework (Stolterman & Wiberg Reference Stolterman and Wiberg2010). RtD has three practices or frameworks: lab, field (participatory design and user-centered design) and showroom (critical design).

The lab framework is based on conducting research in a specific environment with users and allows designers to ideate, explore and test ideas. The field framework focuses on the context and is conducted with users within the practice environment. Through this intentional approach, researchers can focus on determining what people do in real life rather than what they say they do. The showroom framework follows a critical design approach and involves an iterative process of defining and redefining the problem space and generating forms and artifacts that provoke people’s imaginations and reactions. Through this approach, design or research goes beyond creating solutions for a single problem and initiates new thoughts and perspectives. All of these frameworks share similar core values of design research and RtD (Koskinen et al. Reference Koskinen, Zimmerman, Binder, Redstrom and Wensveen2013; Olson and Kellogg Reference Olson and Kellogg2014; Zimmerman, Stolterman, & Forlizzi Reference Zimmerman, Stolterman and Forlizzi2010). Hence, the research question can inform the appropriate framework of the RtD to address the specific objectives (Stappers & Giaccardi Reference Stappers and Giaccardi2014).

Characteristics and assumptions

The concept of “research through design” was introduced by Christopher Frayling in 1993, in which he described three ways research can be related to design: “research into design”, “research for design” and “research through design” (Frayling Reference Frayling1993). To better understand the distinction between these terms, this article provides an overview of their goals and boundaries. “Research into design” focuses on studying the human activity of design, such as documenting and studying the objects, phenomena and history of design (Olson & Kellogg Reference Olson and Kellogg2014; Stappers & Giaccardi Reference Stappers and Giaccardi2014). “Research for design” is the process of conducting research as part of design practice, gathering and applying relevant scientific and technological information to guide and develop design practice (Stappers & Giaccardi Reference Stappers and Giaccardi2014). “Research through design” is a research approach focused on creating new things to improve the world, relying on an empathic understanding of stakeholders, synthesis of behavioral theory and current and near-current technology to envision a desired future (Zimmerman et al. Reference Zimmerman, Stolterman and Forlizzi2010).

In the context of research, RtD is based on the characteristics of design and its reflective and cyclical processes. It acknowledges the potential of designerly ways of knowing and tacit knowledge in addressing complex research questions and wicked problems related to social justice, sustainability and ethics. Through a rigorous process of defining and redefining the research question, RtD aims to generate new knowledge and create a shared understanding of an imagined future. The RtD process differs from a typical design process in its emphasis on generating new knowledge and insights through the act of designing itself. Unlike a traditional design process, which may prioritize the development of a specific product or solution, RtD is more exploratory and iterative in nature, with a focus on understanding the underlying design problems and opportunities. This differs from other approaches like usability testing, where the questions are already known, and researchers use the design process to seek answers. Making and critiquing artifacts is an essential aspect of the RtD process, drawing on principles of design and designerly ways of knowing (Cross Reference Cross1982; Olson & Kellogg Reference Olson and Kellogg2014). Furthermore, robust documentation of the processes and explorations with artifacts are other significant characteristics of this approach that can help researchers move beyond designing products and broaden their perspectives about new strategies to shape the desired future and develop knowledge (Zimmerman et al. Reference Zimmerman, Forlizzi and Evenson2007; Bardzell et al. Reference Bardzell, Bardzell, Dalsgaard, Gross and Halskov2016). For instance, Zimmerman & Forlizzi (Reference Zimmerman and Forlizzi2014) shared their research endeavors that focused on developing new methods of interaction with objects by combining various aspects of experimental psychology and design practice. They also developed a new approach to the design of work automation that advocated for democracy and worker protection. In this way, RtD can initiate reflective discussions about altering the current reality toward the desired reality.

Zimmerman & Forlizzi (Reference Zimmerman and Forlizzi2014) propose a five-step approach to conducting an RtD research project. The first step is to “Select,” which involves choosing a research problem or a design opportunity, selecting a target population, context and material to work with. The selection process is iterative and requires trying different options until the team reaches consensus. Important considerations in selecting a problem space include whether it is a complex issue that can benefit from design thinking, if it has multiple agendas from various stakeholders, and if the research problem is suitable for investigation using RtD. The team should also consider their skills and the desires and concerns of stakeholders when selecting a problem space. The five steps in this approach include “Select,” “Design,” “Evaluate,” “Reflect and Disseminate,” and “Repeat.” Each step is defined in Table 1.

Table 1. Five steps of RtD

RtD in the context of healthcare systems

The complexity of healthcare problems is a prime example of the value of applying a reflective and iterative process of evaluation and problem reframing, which are critical characteristics of RtD. RtD researchers can use their tacit knowledge to define and reinterpret complex problems through empathic understanding of stakeholders, leading to addressing problems related to cultural competence, health inequities and other aspects of quality care. In addition, RtD offers opportunities to ideate and develop human-centered technologies that can improve the quality of life and experience of stakeholders. Prototyping and iterative development processes can actively engage stakeholders in the knowledge creation process and pave the way for finding patterns in complex problem spaces. Through RtD, researchers can bridge the gap between healthcare practices and emerging technologies and develop interventions that can enable stakeholders to achieve their preferred future.

2. Methods

2.1. Study design

To develop digital stories to encourage discourse among maternity healthcare professionals, this study used an RtD approach. This process includes a combination of field and showroom practices, consisting of the following four phases: selection, design, evaluation and reflection. The reflection phase is detailed in the discussion section of this article.

RtD phase 1: selection

In the selection phase, the design researchers aimed to focus the subject matter and determine a medium for design implementation. Improving the quality of postnatal care is recognized as a multifaceted problem owing to the structural complexity and presence of multiple agendas, driven by distinct stakeholders, such as patients, their families and various healthcare professionals. Given the intricacies of maternal health issues and the known inequities in this context, including health disparities, racial biases, fragmented care and limited support, pursuing maternal and postnatal health through HCD is an important and relevant topic.

Prior to this RtD study, the research partners conducted multi-method data collection after review by the UNC Chapel Hill Biomedical Institutional Review Board (#19-1900). The observational filming of this study was a partnership with 15 postpartum patients, their companions and their healthcare team members at an academic medical center in the southeastern United States. Over 460 hours of video and audio data were collected on the postnatal unit from two cameras placed in the participants’ hospital rooms, for an average filming duration of 31 hours and a range of 10–76 hours. The research team used a behavioral taxonomy to code specific behaviors and content, and they created detailed vignettes to provide time-based accounts of events, participants, situations and structures in alignment with Cueva et al. (Reference Cueva, Kuhnley, Revels, Schoenberg and Dignan2015). These vignettes included memos recorded by the research team to identify and reflect on important points in the study of behaviors, perceptions and expressions of the research participants.

The content of these videos and the experiences of the patients and their companions were so compelling, that the design researchers and research partners recognized an opportunity to expand results beyond the quantification of behaviors and qualitative accounts. Therefore, it was decided to use a combination of field and showroom RtD practices to create digital stories based on the data to share selected experiences of postpartum patients and their companions. These digital stories depicting actual events were intended to promote discussions among healthcare team members and professionals, with the ultimate aim of enhancing systems of care.

RtD phase 2: design

Through collaborative prioritization of observed scenarios, we developed digital stories which conveyed the emotional atmosphere and empathic aspects of selected postnatal experiences. In total, the research team created 12 digital stories between January 2021 and March 2023. The initial efforts regarding this process have been previously described (Asl et al. Reference Asl, Gill, Umstead, Mahtani and Tully2022), and subsequently, more digital stories were developed as the project progressed.

Design of digital stories.

The research partners and design researchers sought to establish a collaborative and multidisciplinary approach to create digital stories that accurately portrayed the observed events. To achieve this, clinicians and other research partners reviewed observational files and vignettes to identify priority interactions, which were then used to create iterations of digital stories to stimulate discourse among healthcare professionals. The design researchers followed a process that included establishing the digital story scope, designing the style and technical considerations.

Establishing the digital story scope.

To select the salient interactions and experiences, the design researchers collaborated with research partners to identify appropriate examples and priority areas. A key consideration in establishing the scope was focused on exploring how storytelling and digital stories could facilitate conversations among healthcare professionals for reflection of system strengths and opportunities for improvement. Another key consideration centered on identifying specific dimensions of the patient interactions, experiences and settings that could draw attention to particular issues. To structure this process, the design researchers created a worksheet that allowed the research partners to choose and summarize sections of the video and note examples worth pursuing as digital stories (Table 2). Using the worksheets and referring to the videos and vignettes, the design researchers and research partners defined a specific objective for each potential digital story.

Table 2. Digital story prompts

The design researchers used the information collected from the digital story development worksheets to develop scripts for the animations. The scripts were written to ensure that digital stories were no more than 2–3 minutes, facilitating targeted and effective conversations for education. They focused on key points and events while eliminating any distractions. This process was iterative and conducted in partnership with the research partners due to the complexity of framing the context and finding the appropriate balance regarding details to include in the digital stories. This also allowed for reducing bias and ensuring the credibility and accuracy of the information. Research partners streamlined the stories while maintaining the emotion of the experience. For example, not every part of conversations from the selected scenarios was included as it could have been too long or confusing to the viewers out of context. Additionally, storyboarding based on the key ideas of the script was used throughout the process to determine the essential assets and characters for the story (Figure 1).

Figure 1. Storyboarding the key ideas of the script to identify essential assets and characters for the digital story.

The research team also aimed to reduce tangential content to enable the viewers to focus on a certain topic, with preservation of verbatim wording to the extent possible. Additionally, a narrator was included to present an overview of the setting and context at the beginning of each story. The narrator also concluded each video by presenting questions for reflection that invite the audience to engage around the experiences depicted in the digital stories.

Visual design.

The visual style of the digital stories was influenced by the observed environment and patient-participants. The initial plan was to comprehensively depict the environment by including various real-world assets and elements from the research observations (Figure 2). However, a simpler and more minimalistic approach was ultimately chosen to focus the viewer’s attention on the characters and their interactions (Figure 3). This approach aimed to avoid distracting the audience with irrelevant information, enabling them to focus on the digital stories’ primary objective of conveying events, interactions, emotions and the message of the story. Therefore, the digital stories were designed by incorporating only the key assets and environmental elements that could influence the storyline (i.e., hospital furniture and equipment). It was also important for the characters to reflect the race and ethnicity of study participants, including skin tones and body shapes. Simultaneously, it was important to protect participant confidentiality and exclude any potentially identifiable information.

Figure 2. Exploration of various environmental styles and color palettes with different levels of detail.

Figure 3. Left image (deidentified screen shot from a video file). Right image (minimalistic visualization of the video for the digital story).

Technical considerations.

The development of digital stories is reliant on appropriate tools and technologies. High-quality digital stories can be time-consuming and require software licenses, which can pose constraints, particularly when designers have limited experience in animation. The design researchers leading the digital stories had basic familiarity with the required techniques involved creating digital stories. Thus, two primary considerations were taken into account when selecting software for the project: the ease of use and the possibility of collaboration of the design researchers and potential future members who would be engaged in developing the digital stories. Several potential software options were compared before selecting Vyond, an online animation software (Vyond 2023). This software allowed for collaborative work and had a short learning curve, avoiding the need to learn complex editing features. The incorporation of features such as a library of visual assets and flexible character settings facilitated efficient production of digital stories, and also ensured scalability of the project in the long run. These features enabled transfer of information to future research partners or members that were interested in assisting with the design and development of the digital stories.

Vyond provided a variety of built-in visual styles, such as preset actions and expressions, and flexible settings for character design, such as skin tone, hair and body shape. These settings were beneficial in assigning the ethnic, cultural and physical features of the participants (Figure 4). Moreover, this platform facilitated the creation of a library of visual assets that reduced subsequent production time significantly because of shared common assets. Although Vyond was determined to be a suitable software for the development of digital stories, it was not without limitations. One limitation was the inability to create realistic characters. Additionally, the software had limited facial expressions and movements available in the character design library. These limitations required the team to employ creative solutions, explore alternative approaches to replicate certain emotional experiences, and it precluded animation of close-up, nuanced character positioning and movements.

Figure 4. Ensuring visual styles of characters matched the ethnic, cultural and physical features of participants.

Regarding animation voice similarities with study participants, research partners who shared the same race and ethnicity as the characters contributed to the voice-over recordings. These IRB-approved team members reviewed the original data before recording the scripts, paying attention to the emotional context, tone and feeling of the conversations.

RtD phase 3: evaluate

The evaluation phase of this study involves two primary processes: iterative feedback from the research partners and a participatory feedback session with the majority of the involved members of the research team including design researchers, partners and other subject matter experts.

Iterative feedback from the research partners.

In this study, the design researchers collaborated with research partners who were experts on maternity care. Regular weekly meetings were held to iteratively evaluate and revise the digital stories in terms of priority events, storyline, storyboard, visual style, scope, message, use cases and voice-overs. This collaborative process was crucial in refining the digital stories and maintaining validity, which were intended to serve as standalone artifacts for generating discussion.

Thorough documentation was a critical component in employing the RtD approach for developing the digital stories. This involved recording feedback, challenges and discussions, as well as documenting the steps taken to develop the digital stories. The rigorous documentation process ensured that all essential information was captured and could be accessed throughout the project’s duration. This promoted transparency and accountability in the development process and also facilitated the generation of knowledge regarding best practices for developing digital stories in the healthcare context.

Participatory feedback session with research partners.

A participatory workshop was conducted on September 23, 2022 with a group of 18 research partners and graduate students from diverse backgrounds and expertise. The session included two activities to assess and collect feedback on the video itself and to generate ideas for use cases or applications of the digital stories. The session was facilitated by the design researchers.

Activity 1: video review.

The first activity focused on feedback about the content, language and visual style of the animated stories developed to date. To this end, four digital stories were presented, each illustrated a different healthcare topic: maternal pain, lactation, companion support and baby’s care. Subsequently, the individuals were provided with an open-ended questionnaire that elicited written reflections on the videos and on the potential application of these digital stories in health care (Table 3). The questions also prompted research partners to share their opinions on the strengths and weaknesses of the digital stories in terms of their format, including visual and auditory elements. Each person completed the questionnaire individually and then were encouraged to share their impressions with the larger group. Throughout the discussion, facilitators were responsible for documenting the feedback and insights shared.

Table 3. Prompts used in the participatory feedback session

Activity 2: alternative scenarios and role playing.

The second activity was designed to draw upon the diverse expertise of the research partners to develop alternative scenarios that could effectively address the gaps illustrated in the video stories. The activity was also designed to encourage the individuals to generate ideas about potential applications of digital stories in healthcare education. To this end, a role-playing exercise was implemented. The group was divided into four subgroups, each was assigned one of the digital stories. Two key questions were presented to guide their scenario development: “What was happening here?” and “How might the system of care be improved?”

2.2. Analysis

Responses were analyzed inductively in accordance with guidelines of qualitative content analysis (Creswell & Poth Reference Creswell and Poth2016). The responses of team members and notes taken by facilitators during both activities were transcribed into a digital table. The information was coded and grouped together to identify emerging themes and patterns. This process of analysis allowed for a more in-depth examination of the feedback and insights shared during the session and helped to identify key areas of focus for future development. All discussions were documented by the facilitators.

3. Results

3.1. Result of RtD phase 3: evaluation

Activity 1 results

The feedback gathered on the review of the video was grouped into two categories: Usage of digital stories for training and education and reactions and recommendations on the content and format.

Usage of digital stories for training and education

The research partners who participated in the workshop strongly agreed that digital stories have the potential to be effective tools for educational purposes, such as developing training modules and promoting discussions on respectful interactions, care coordination and quality of care. Some of the comments gathered:

(i) Digital stories can demonstrate the importance of protecting and promoting birthing parents’ autonomy and for the companions to be included in the education and interactions.

(ii) Digital stories can inform policies such as staffing levels and other systemic issues. One individual remarked:

“This is great! One thing it makes me consider is whether this video (digital story) and ones like it could be developed with a focus on healthcare administration and leadership. I think sometimes challenges are primarily considered based on how providers or care teams can improve, but I think this kind of tool could be valuable for advocating for adequate staffing.”

(iii) Digital stories could empower healthcare professionals and students by building empathy and enabling them to comprehend and reflect on the perspective, emotions and experiences of patients and their families, including instances when healthcare professionals are not present in the room. For instance, one individual stated that

“This (digital story) is a great way of empowering healthcare team members and students to think about what might be going on when they leave the room. I think this would be great for students across healthcare.”

(iv) The use of digital stories is a valuable approach that has the potential to enhance healthcare education and foster greater empathy among healthcare professionals by highlighting the gaps and emphasizing areas for improvement.

(v) Digital stories could be made available through online open-access platforms or incorporated into existing interprofessional curriculums to maximize their reach and impact. One individual shared,

“We all want to provide good care but sometimes don’t realize how we are acting until someone brings it up, or we have it in a video recording (digital story).”

(vi) The use of digital stories can extend beyond their current scope to shed light on how patients’ and healthcare team members’ experiences, implicit biases and backgrounds can influence the quality of care throughout the hospital system. For example, one participant mentioned,

“These videos would encourage providers to reflect on their own treatment of patients’ pain and how race and other factors (ex: substance use history) might influence that treatment.” Another individual stated, “Digital stories highlight the discrepancies with Black parents and the small (but big) encounters and injustices the families face. This should be shown widely.”

(vii) Digital stories have the potential to be utilized in patient education and facilitation guides, aiding the discharge process and providing information on available resources.

Reactions and recommendations on the content and format.

Throughout the workshop, the research partners identified strengths in content and format. They appreciated the structure where the introduction provided context for the experiences of the characters in the stories, as well as the use of summary takeaways, reflections and questions to encourage discussion. They noted that the digital stories effectively demonstrated intersecting and compounding issues, and that the verbatim wording used was powerful.

Other positive attributes that were recognized included the voice, noting that they effectively conveyed realistic feelings and emotions. They praised the use of visual details, such as pain visualization, clock showing the time, facial expressions and gestures, which complemented the narrative and supported the main message of the story. The combination of the voice-overs with the visual elements of the digital stories helped to create a more immersive and engaging experience for the audience.

In terms of areas for improvement, one issue raised was the need to reinforce parts of the stories by providing further descriptions of technical terms, such as bilirubin or specifics about medical procedures. Additionally, it was suggested that providing closure and bullet points at the end of the videos to show opportunities for improvement based on each scenario could be a useful approach. Other suggestions included focusing on the healthcare system competency, showing comparisons of experiences, examples of effective and ineffective interactions or potential solutions to some of the challenges identified in the stories.

Activity 2 results

The second activity identified potential use cases of these stories in health care. The feedback gathered during this activity was grouped into three categories: envisioning ideal/desired future, addressing upstream contributors and creating questions and prompts for discussion.

Envisioning ideal/desired future

One of the groups developed an alternative scenario to an interaction shared through a digital story. The group envisioned the desired future or ideal interactions that could have prevented the challenges and negative consequences presented and developed a role-play script. This role-playing was an enjoyable experience and modeled more positive patient experiences. The activity prompted discussion about the challenges faced by healthcare professionals in providing quality care. The group members shared their experiences and provided creative approaches to address the existing gaps in the system.

Addressing upstream contributors

Two of the groups focused on considering potential upstream contributors of the incidents presented in the digital stories. For example, one of the groups mentioned that patients feeling that their voices are consistently not heard or being taken seriously by healthcare professionals can be the underlying reason for some of these experiences. In response, some team members suggested that asking patients about their priorities with open-ended questions can be a valuable approach to facilitating equitable and quality care. This type of interaction can demonstrate that patients’ voices and needs are heard and valued.

The group also discussed additional topics to improve communication between patients and healthcare team members, such as the physical positioning of clinicians in relation to patients and family members. One individual stressed the significance of healthcare professionals sitting while communicating with patients. This small gesture can significantly impact the patients’ perceptions of power dynamics by being at the same eye level and being focused with attention. It was suggested that incidents presented in the digital stories could potentially be prevented through more transparency with information on topics such as pain management, both prenatally and postnatally. Adopting a more proactive approach may contribute to more timely and meaningful shared decision-making. Steps to make information more accessible and comprehensible instead of relying on assumptions may minimize the likelihood of conflicts or misunderstandings, especially with sensitive topics like opiate medication use.

Questions and prompts for discussion

One of the groups created their own set of questions that would facilitate developing alternative scenarios for these stories, such as “what is the problem in the digital story,” “why is it important for health,” “what can the healthcare team do,” and “how might the individuals depicted cope.” They suggested that the videos can also include links or QR codes to documents for best practices. Another area that was discussed by this group was the concept of patient-family encouragement from their healthcare team members, as part of active support.

3.2. Results summary

Based on documentation gathered during the design and findings of the evaluation phases, a summary of the stages for developing a digital story to share healthcare experiences was created. Table 4 provides a chronological summary and description of these stages.

Table 4. Summary and description of stages for developing a digital story

4. Reflection and discussion

The collaborative RtD production process was a human-centered approach for sharing patient experiences through digital storytelling. During the RtD process, feedback from research partners and content experts, as well as rigorous documentation of the steps, challenges and opportunities, were used to create a conceptual framework for the animations. This framework was developed to guide the development of digital stories in healthcare settings, with the goal of provoking discussion and generating knowledge while preserving patients’ and other research participants’ privacy. The framework was designed and tested iteratively based on knowledge generated from developing 12 digital stories from naturalistic videos (Postnatal Patient Safety Learning Lab 2023). It outlines the steps required for creating each digital story, from writing a goal statement to finalizing the videos with audio. The framework includes the research team’s perspective on the minimum number of iterations required for each step, for developing a meaningful digital story. Also, supporting information and considerations for each step highlight critical aspects of each stage.

The development of Table 4 was based on a starting point of having access to IRB-approved study video and audio data. However, in healthcare settings, original data are often collected using other methods, as the sole source or through mixed-methods. Therefore, the expanded framework includes considerations for the development of digital stories using various sources of data, including interviews, shadowing, observation and workshops or focus groups. Table 5 presents inputs and activities through the stages of digital story development.

Table 5. Expanded framework for digital storytelling using various sources of data

Although Table 5 is presented here in a stepwise approach, the collaborative process is iterative. Additionally, flexibility and the ability to adjust the framework components according to the specific objectives are crucial. Depending on the project’s goals and implementation plan, the digital stories can be utilized as standalone artifacts or incorporated into a multi-level intervention. Although these 2D digital stories were created using currently available technologies, it is important to consider that the healthcare industry has shown an increasing interest in the use of emerging technologies such as virtual reality, augmented reality and mixed reality (Saedi and Rice Reference Saedi and Rice2020; Saedi, Einifar, & Barati Reference Saedi, Einifar and Barati2021; Panda et al. Reference Panda, Kim, Behnam-Asl and Sener2021). This opens up the potential for creative approaches to immersive digital storytelling that can move beyond didactic education toward immersive and active engagement.

4.1. Strengths and limitations

Although the digital stories and the proposed/conceptual framework were tailored for the maternity healthcare and maternity care context, the insights are transferable to other settings involving multifaceted and sensitive health-related subject matter. Furthermore, the framework developed through the RtD approach employed in this study offers practical guidance to researchers and practitioners on how to create compelling digital stories. The resulting deliverables are promising for prompting discussions, training purposes and enhancing patient-focused healthcare systems.

Our experience developing digital stories were based on recorded observations, which represent only one type of healthcare data. As with all observational research, participant behavior may have been influenced by their participation. However, the Hawthorne effect was likely minimal over the extended period of time and because of the participants. Moreover, the video and audio data were collected from one hospital in the southeast of the United States during the COVID-19 pandemic, which means the examples may not be generalizable to all birthing facilities or contexts. Additionally, the prioritization of digital stories was led by the research partners. The issues most salient and modifiable may differ by audience. Partnering with more clinicians, patient representatives and community-based health equity leaders would strengthen the process and deliverables.

4.2. Future work

The feedback received from research partners involved in this study indicates that digital storytelling can be a powerful tool for generating discussion around systems of health care. Sharing patients and families’ lived experiences through animating, with emotions and their words is a promising approach for building more shared understanding (Mojtahedzadeh et al. Reference Mojtahedzadeh, Mohammadi, Emami and Zarei2021). There is also an opportunity to elevate the stories of healthcare professionals, so the structural contributors to their practices and the emotions they feel, including moral injury, can be shared. Moreover, comparing digital stories with narratives featuring real-life characters to observe how emotional responses are elicited and how problems are framed differently could be a valuable area for future research. Although the considerations and requirements for creating stories with real-life characters may differ, this exploration can open up a promising avenue for comparison and exploration of various forms of storytelling within the context of sensitive health data.

Future research can evaluate the impact of digital stories in interprofessional education and clinical quality improvement. Additionally, stakeholder feedback on the digital stories would inform the extent to which the current animations are culturally relevant and accurately depict the experiences of patients and families. Assessing how research participants feel that their experiences can be leveraged to improve systems of care is important. Research results like the digital stories we have created offer nuanced insight into patient-family and healthcare team interactions, which can inform both immediate healthcare practice change and system reform. Additionally, by testing the proposed framework with various tools and platforms for digital storytelling and using diverse data sources such as interviews, focus groups and workshops, the knowledge gathered through this study can be transferred to a broader range of healthcare-related areas.

5. Conclusion

This study articulated the use of HCD and digital storytelling to share the experiences of patients and their families in the postnatal unit. This article provides an overview of the rationale, approach and impact of digital storytelling for provoking discussion and creative problem solving among healthcare professionals in the context of maternity care. This work employed an RtD method. We started with observational data and used a design approach to translate observational data into animated stories. This intentional approach had the potential to meaningfully engage stakeholders, to increase empathy and inspire action.

Furthermore, a key strength of this study was the interdisciplinary team composed of designers, clinicians and researchers. The partnership allowed for the development of new research approaches and the application of their respective skills, tools and methods for transdisciplinary collaboration. Through the human-centered perspective, the team generated new knowledge on the use of creative media and artifacts, such as digital stories, to convert sensitive and rich health-related data into prompts for ideation and problem solving.

The research through design study outlines a human-centered approach for digital storytelling to promote discussions, education and enhance healthcare systems, thereby fostering respect, equity and support for maternal care.

Acknowledgments

This research was supported by the Agency for Healthcare Research and Quality (AHRQ), Department of Health and Human Services (HHS). The funding organization was not involved in (a) the data collection, analysis and interpretation or (b) the preparation of the manuscript and has no right to approve or disapprove publication of the finished manuscript. The authors are solely responsible for this document’s contents, findings and conclusions, which do not necessarily represent the views of AHRQ. Readers should not interpret any statement in this report as an official position of AHRQ or HHS. The authors thank Marina Pearsall and Fernanda Ochoa Toro for participant recruitment, data collection and data management. The authors are grateful to the participants for their time and willingness to share their experience.

Financial support

This research was supported by Agency for Healthcare Research and Quality R18HS027260, Department of Health and Human Services.

References

Arzamani, N., Soraya, S., Hadi, F., Nooraeen, S. & Saeidi, M. 2022 The COVID-19 pandemic and mental health in pregnant women: A review article. Frontiers in Psychiatry 13, 949239.CrossRefGoogle ScholarPubMed
Asan, O. & Montague, E. 2014 Using video-based observation research methods in primary care health encounters to evaluate complex interactions. Informatics in Primary Care 21 (4), 161.Google ScholarPubMed
Asl, B., Gill, C., Umstead, K., Mahtani, R. & Tully, K. 2022 A collaborative approach to digital storytelling in healthcare settings. In DS 117: Proceedings of the 24th International Conference on Engineering and Product Design Education (E&PDE 2022), London South Bank University in London, UK, 8th–9th September 2022.Google Scholar
Asl, S. B., Naeini, H. S., Ensaniat, L. S., Khorshidian, R., Alipour, S. & Asl, S. B. 2014 Injury prevention among construction workers: A case study on Iranian steel bar bending workers. International Journal of Industrial and Manufacturing Engineering 8 (8), 467470.Google Scholar
Bardzell, J., Bardzell, S., Dalsgaard, P., Gross, S. & Halskov, K. 2016, June. Documenting the research through design process. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems, pp. 96107. ACM.CrossRefGoogle Scholar
Barello, S., Triberti, S., Graffigna, G., Libreri, C., Serino, S., Hibbard, J. & Riva, G. 2016 eHealth for patient engagement: A systematic review. Frontiers in Psychology 6, 141094.CrossRefGoogle ScholarPubMed
Bazzano, A. N., Martin, J., Hicks, E., Faughnan, M. & Murphy, L. 2017 Human-centred design in global health: A scoping review of applications and contexts. PLoS One 12 (11), e0186744.CrossRefGoogle ScholarPubMed
Bensing, J. M., Verheul, W. & Van Dulmen, A. M. 2008 Patient anxiety in the medical encounter: A study of verbal and nonverbal communication in general practice. Health Education 108 (5), 373383.CrossRefGoogle Scholar
Bjerkan, J., Hedlund, M. & Hellesø, R. 2015 Patients’ contribution to the development of a web-based plan for integrated care–a participatory design study. Informatics for Health and Social Care 40 (2), 167184.CrossRefGoogle Scholar
Boydell, K. M., Volpe, T., Cox, S., Katz, A., Dow, R., Brunger, F., Parsons, J., Belliveau, G., Gladstone, B., Zlotnik-Shaul, R. & Cook, S. 2012 Ethical challenges in arts-based health research. The International Journal of the Creative Arts in Interdisciplinary Practice 11 (1), 117.Google Scholar
CDC, Centers for Disease Control and Prevention. 2019 Racial and Ethnic Disparities Continue in Pregnancy-Related Deaths. National Center for Health Statistics. Retrieved July 24, 2022, from https://www.cdc.gov/media/releases/2019/p0905-racial-ethnic-disparities-pregnancy-deaths.html.Google Scholar
CDC, Centers for Disease Control and Prevention. 2021 Maternal mortality rates in the United States, 2021. National Center for Health Statistics. Retrieved December 14, 2022, from https://www.cdc.gov/nchs/data/hestat/maternal-mortality/2021/maternal-mortality-rates-2021.htm.Google Scholar
Charon, R. 2004 Narrative and medicine. New England Journal of Medicine 350 (9), 862864.CrossRefGoogle ScholarPubMed
Creswell, J. W. & Poth, C. N. 2016 Qualitative Inquiry and Research Design: Choosing among Five Approaches. Sage Publications.Google Scholar
Cross, N. 1982 Designerly ways of knowing. Design Studies 3 (4), 221227.CrossRefGoogle Scholar
Cueva, M., Kuhnley, R., Revels, L., Schoenberg, N. E. & Dignan, M. 2015 Digital storytelling: A tool for health promotion and cancer awareness in rural Alaskan communities. International Journal of Circumpolar Health 74 (1), 28781.CrossRefGoogle ScholarPubMed
Cueva, M., Kuhnley, R., Revels, L., Schoenberg, N. E., Lanier, A. & Dignan, M. 2016 Engaging elements of cancer-related digital stories in Alaska. Journal of Cancer Education 31, 500505.CrossRefGoogle ScholarPubMed
De Jager, A., Fogarty, A., Tewson, A., Lenette, C. & Boydell, K. M. 2017 Digital storytelling in research: A systematic review. The Qualitative Report 22 (10), 25482582.Google Scholar
Evans, W. D., Harrington, C., Patchen, L., Andrews, V., Gaminian, A., Ellis, L. P. & Napolitano, M. A. 2019 Design of a novel digital intervention to promote healthy weight management among postpartum African American women. Contemporary Clinical Trials Communications 16, 100460.CrossRefGoogle ScholarPubMed
Everri, M., Heitmayer, M., Yamin-Slotkus, P. & Lahlou, S. 2020 Ethical challenges of using video for qualitative research and ethnography. In Challenges and Solutions in Ethnographic Research, p. 68. Routledge.Google Scholar
Farao, J., 2023, April. Digital storytelling for the support of maternal and child-wellbeing through community-based co-design. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, pp. 15.CrossRefGoogle Scholar
Fleisher, L., Bass, S. B., Shwarz, M., Washington, A., Nicholson, A., Alhajji, M., Geynisman, D. M., Maurer, L., Greener, J. & Kenny, C. 2020 Using theory and user‐centered design in digital health: The development of the mychoice communication tool to prepare patients and improve informed decision making regarding clinical trial participation. Psycho-Oncology 29 (1), 114122.CrossRefGoogle ScholarPubMed
Frayling, C. 1993 Research in art and design. Royal College of Art research papers 1, 15.Google Scholar
Giacomin, J. 2014 What is human centred design? The Design Journal 17 (4), 606623.CrossRefGoogle Scholar
Gill, C., Umstead, K., Behnam Asl, S. & Mahtani, R. 2023 Data visualisation as a tool for public engagement and empathy building. In DS 123: Proceedings of the International Conference on Engineering and Product Design Education (E&PDE 2023).CrossRefGoogle Scholar
Göttgens, I. & Oertelt-Prigione, S. 2021 The application of human-centered design approaches in health research and innovation: A narrative review of current practices. JMIR mHealth and uHealth 9 (12), e28102.CrossRefGoogle ScholarPubMed
Gray, B., Young, A. & Blomfield, T. 2015 Altered lives: Assessing the effectiveness of digital storytelling as a form of communication design. Continuum 29 (4), 635649.CrossRefGoogle Scholar
Gubrium, A. 2009 Digital storytelling: An emergent method for health promotion research and practice. Health Promotion Practice 10 (2), 186191.CrossRefGoogle ScholarPubMed
Gubrium, A. C., Fiddian-Green, A., Lowe, S., DiFulvio, G. & Del Toro-Mejías, L. 2016 Measuring down: Evaluating digital storytelling as a process for narrative health promotion. Qualitative Health Research 26 (13), 17871801.CrossRefGoogle ScholarPubMed
Haith-Cooper, M., Stacey, T., Bailey, F. & Broadhead-Croft, S. 2020 The co-development and feasibility-testing of an innovative digital animation intervention (DAISI) to reduce the risk of maternal sepsis in the postnatal period. Maternal and Child Health Journal 24, 837844.CrossRefGoogle ScholarPubMed
Hardy, V., 2016. Telling tales: The development and impact of digital stories and digital storytelling in healthcare (Doctoral Dissertation). Manchester Metropolitan University.Google Scholar
Harte, R., Glynn, L., Rodríguez-Molinero, A., Baker, P. M., Scharf, T., Quinlan, L. R. & ÓLaighin, G. 2017 A human-centered design methodology to enhance the usability, human factors, and user experience of connected health systems: A three-phase methodology. JMIR Human Factors 4 (1), e5443.CrossRefGoogle ScholarPubMed
Harte, R. P., Glynn, L. G., Broderick, B. J., Rodriguez-Molinero, A., Baker, P. M., McGuiness, B., O’Sullivan, L., Diaz, M., Quinlan, L. R. & ÓLaighin, G. 2014 Human centred design considerations for connected health devices for the older adult. Journal of personalized medicine 4 (2), 245281.CrossRefGoogle ScholarPubMed
Howell, E. A. 2018 Reducing disparities in severe maternal morbidity and mortality. Clinical Obstetrics and Gynecology 61 (2), 387399.CrossRefGoogle ScholarPubMed
Hridi, A.P., Khan, K.L., Jadhav, A.R., Saedi, H., Nanda, S., Serrao, L. & Watson, B., 2022, November. Exhibiting evidence in remote courtrooms: Design and usability study. In Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social Computing, pp. 102105.CrossRefGoogle Scholar
Iedema, R., Forsyth, R., Georgiou, A., Braithwaite, J. & Westbrook, J. 2006a Video research in health. Qualitative Research Journal 6 (2), 1530.CrossRefGoogle Scholar
Iedema, R., Long, D., Forsyth, R. & Lee, B. B. 2006b Visibilising clinical work: Video ethnography in the contemporary hospital. Health Sociology Review 15 (2), 156168.CrossRefGoogle Scholar
International Organization for Standardization. 2019 ISO 9241-210:2010 Ergonomics of human-system interaction - Part 210: Human-centred design for interactive systems. https://www.iso.org/standard/52075.html (accessed 28 April 2023).Google Scholar
Jaynes, S., Brathwaite, D. & Tully, K. P. 2022 Systematic review of the effect of technology-mediated education intervention on maternal outcomes in the first year after birth. Journal of Obstetric, Gynecologic & Neonatal Nursing 51 (3), 278289.CrossRefGoogle ScholarPubMed
Kalra, A., Subramaniam, N., Longkumer, O., Siju, M., Jose, L. S., Srivastava, R., Lin, S., Handu, S., Murugesan, S., Lloyd, M. & Madriz, S. 2022 Super Divya, an interactive digital storytelling instructional comic series to sustain facilitation skills of labor and delivery nurse mentors in Bihar, India—A pilot study. International Journal of Environmental Research and Public Health 19 (5), 2675.CrossRefGoogle ScholarPubMed
Koskinen, I., Zimmerman, J., Binder, T., Redstrom, J. & Wensveen, S. 2013 Design research through practice: From the lab, field, and showroom. IEEE Transactions on Professional Communication 56 (3), 262263.CrossRefGoogle Scholar
Lal, S., Donnelly, C. & Shin, J. 2015 Digital storytelling: An innovative tool for practice, education, and research. Occupational Therapy in Health Care 29 (1), 5462.CrossRefGoogle ScholarPubMed
Lambert, J. & Brooke, H. 2018 Digital Storytelling: Capturing Lives, Creating Community. Routledge.CrossRefGoogle Scholar
Lamé, G., Crowe, S., Komashie, A. & Royston, G. 2023 Joining forces: The value of design partnering with operational research to improve healthcare delivery. Design Science 9, e4.CrossRefGoogle Scholar
Li, N., Kramer, J., Gordon, P. & Agogino, A. 2018 Co-author network analysis of human-centered design for development. Design Science 4, e10.CrossRefGoogle Scholar
Mahtani, R., Gill, C., Umstead, K., Behnam Asl, S. and Tully, K., 2022 Online participatory tools in classroom and research settings. In DS 117: Proceedings of the 24th International Conference on Engineering and Product Design Education (E&PDE 2022), London South Bank University in London, UK, 8th–9th September 2022.CrossRefGoogle Scholar
Matthews, N. & Sunderland, N. 2017 Digital Storytelling in Health and Social Policy: Listening to Marginalised Voices. Routledge.CrossRefGoogle Scholar
Melles, M., Albayrak, A. & Goossens, R. 2021 Innovating health care: Key characteristics of human-centered design. International Journal for Quality in Health Care 33(Supplement_1), 3744.CrossRefGoogle ScholarPubMed
Mojtahedzadeh, R., Mohammadi, A., Emami, A. H. & Zarei, A. 2021 How digital storytelling applied in health profession education: A systematized review. Journal of Advances in Medical Education & Professionalism 9 (2), 63.Google ScholarPubMed
Moreau, K. A., Eady, K., Sikora, L. & Horsley, T. 2018 Digital storytelling in health professions education: A systematic review. BMC Medical Education 18, 19.CrossRefGoogle ScholarPubMed
Noya, A., Oguro, M. & Horiuchi, S. 2022 Professional learning using storytelling videos of childbirth experiences: A qualitative pilot study of student midwives’ perceptions in Myanmar. Japan Journal of Nursing Science 19 (2), e12456.CrossRefGoogle ScholarPubMed
Olson, J. S., & Kellogg, W. A. (Eds.). (2014). Ways of Knowing in HCI (Vol. 2). New York: Springer.CrossRefGoogle Scholar
Panda, P., Kim, B., Behnam-Asl, S. & Sener, E., 2021, December. Immersive analytics: A user-centered perspective. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology, pp. 13. ACM.Google Scholar
Park, E., Forhan, M. & Jones, C. A. 2021 The use of digital storytelling of patients’ stories as an approach to translating knowledge: A scoping review. Research Involvement and Engagement 7 (1), 58.CrossRefGoogle ScholarPubMed
Parsons, J. E., Newby, K. V., French, D. P., Bailey, E. & Inglis, N. 2021 The development of a digital intervention to increase influenza vaccination amongst pregnant women. Digital Health 7, 20552076211012128.CrossRefGoogle ScholarPubMed
Partridge, R. 2017 Understanding the roles of the designer in health care: A practice-based study into supporting adolescents with long-term conditions. The Design Journal 20 (4), 523532.CrossRefGoogle Scholar
Petersen, E. E., Davis, N. L., Goodman, D., Cox, S., Mayes, N., Johnston, E., Syverson, C., Seed, K., Shapiro-Mendoza, C. K., Callaghan, W. M. & Barfield, W. 2019a Vital signs: Pregnancy-related deaths, United States, 2011–2015, and strategies for prevention, 13 states, 2013–2017. Morbidity and Mortality Weekly Report 68 (18), 423.Google ScholarPubMed
Petersen, E. E., Davis, N. L., Goodman, D., Cox, S., Syverson, C., Seed, K., Shapiro-Mendoza, C., Callaghan, W. M. & Barfield, W. 2019b Racial/ethnic disparities in pregnancy-related deaths—United States, 2007–2016. Morbidity and Mortality Weekly Report 68 (35), 762.CrossRefGoogle ScholarPubMed
Petty, J. 2023 Using arts-based digital storytelling in neonatal care to enhance nursing students’ empathy. Nursing Children and Young People 35 (4), 1318.Google Scholar
Petty, J., Jarvis, J. & Thomas, R. 2020 Exploring the impact of digital stories on empathic learning in neonatal nurse education. Nurse Education in Practice 48, 102853.CrossRefGoogle ScholarPubMed
Pink, S. 2007 Doing Visual Ethnography. Sage.CrossRefGoogle Scholar
Postnatal Patient Safety Learning Lab (PSLL). 2023 Our work. Available at https://www.postnatalsafety.com/our-work.html (accessed 28 April 2023).Google Scholar
Saedi, H., Einifar, A. R. & Barati, N. 2021 The impact of micro interaction with natural Green elements through virtual reality on attention restoration (in a high-rise residential Building’s lobby). Journal of Architecture and Urban Planning 13 (30), 521.Google Scholar
Saedi, H. & Rice, A. 2020 Minor change for major impact: How can minor changes in the daily urban environment impact an aspect of psycho-physiological health? Prometheus 4, 98101.Google Scholar
Saedi, H. & Rice, A. 2022 The importance of both: Competing factors that impact attention level restoration and mental health. In Research Record, pp. 135149.Google Scholar
Scott, S. D., Brett-MacLean, P., Archibald, M. & Hartling, L. 2013 Protocol for a systematic review of the use of narrative storytelling and visual-arts-based approaches as knowledge translation tools in healthcare. Systematic Reviews 2, 17.CrossRefGoogle ScholarPubMed
Seshadri, P., Joslyn, C. H., Hynes, M. M. & Reid, T. 2019 Compassionate design: Considerations that impact the users’ dignity, empowerment and sense of security. Design Science 5, e21.CrossRefGoogle Scholar
Sitter, K. C., Beausoleil, N. & McGowan, E. 2020 Digital storytelling and validity criteria. International Journal of Qualitative Methods 19, 1609406920910656.CrossRefGoogle Scholar
Stappers, P. & Giaccardi, E. 2014 Research through design. In The Encyclopedia of Human-Computer Interaction.Google Scholar
Stenhouse, R., Tait, J., Hardy, P. & Sumner, T. 2013 Dangling conversations: Reflections on the process of creating digital stories during a workshop with people with early‐stage dementia. Journal of Psychiatric and Mental Health Nursing 20 (2), 134141.CrossRefGoogle ScholarPubMed
Stolterman, E. & Wiberg, M. 2010 Concept-driven interaction design research. Human–Computer Interaction 25 (2), 95118.CrossRefGoogle Scholar
Thompson, T., Lamont-Robinson, C. & Younie, L. 2010 ‘Compulsory creativity’: Rationales, recipes, and results in the placement of mandatory creative Endeavour in a medical undergraduate curriculum. Medical Education Online 15 (1), 5394.CrossRefGoogle Scholar
Tsekleves, E. & Cooper, R. 2017 Emerging trends and the way forward in design in healthcare: An expert’s perspective. Design Journal 20 (sup1), S2258S2272.CrossRefGoogle Scholar
Tully, K. P. & Ball, H. L. 2012 Postnatal unit bassinet types when rooming-in after cesarean birth: Implications for breastfeeding and infant safety. Journal of Human Lactation 28 (4), 495505.CrossRefGoogle ScholarPubMed
Zimmerman, J. and Forlizzi, J., 2014. Research through design in HCI. In Ways of Knowing in HCI, pp. 167189. Springer New York.CrossRefGoogle Scholar
Zimmerman, J., Forlizzi, J. and Evenson, S., 2007, April. Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 493502.CrossRefGoogle Scholar
Zimmerman, J., Stolterman, E. & Forlizzi, J., 2010, August. An analysis and critique of research through design: Towards a formalization of a research approach. In Proceedings of the 8th ACM Conference on Designing Interactive Systems, pp. 310319. ACM.CrossRefGoogle Scholar
Figure 0

Table 1. Five steps of RtD

Figure 1

Table 2. Digital story prompts

Figure 2

Figure 1. Storyboarding the key ideas of the script to identify essential assets and characters for the digital story.

Figure 3

Figure 2. Exploration of various environmental styles and color palettes with different levels of detail.

Figure 4

Figure 3. Left image (deidentified screen shot from a video file). Right image (minimalistic visualization of the video for the digital story).

Figure 5

Figure 4. Ensuring visual styles of characters matched the ethnic, cultural and physical features of participants.

Figure 6

Table 3. Prompts used in the participatory feedback session

Figure 7

Table 4. Summary and description of stages for developing a digital story

Figure 8

Table 5. Expanded framework for digital storytelling using various sources of data