Hostname: page-component-cd9895bd7-hc48f Total loading time: 0 Render date: 2024-12-23T23:31:00.443Z Has data issue: false hasContentIssue false

Gaps and opportunities for measuring equity with the Translational Science Benefits Model: Recommendations from the Center for American Indian and Alaska Native Diabetes Translation Research

Published online by Cambridge University Press:  24 October 2024

Amy G. Huebschmann*
Affiliation:
Division of General Internal Medicine, University of Colorado School of Medicine, Center for American Indian and Alaska Native Diabetes Translation Research (CAIANDTR), Ludeman Family Center for Women’s Health Research, Adult and Child Center for Outcomes Research and Delivery Science, University of Colorado Anschutz Medical Campus, Aurora, CO, USA
Angela G. Brega
Affiliation:
Centers for American Indian and Alaska Native Health, Colorado School of Public Health, University of Colorado Anschutz Medical Campus, Aurora, CO, USA
Sarah A. Stotz
Affiliation:
Department of Food Science and Human Nutrition, Colorado State University, Fort Collins, CO, USA
Aliassa L. Shane
Affiliation:
Southcentral Foundation, CAIANDTR Alaska Satellite Center, Anchorage, AK, USA
Roxanna King
Affiliation:
Southcentral Foundation, CAIANDTR Alaska Satellite Center, Anchorage, AK, USA
Valarie Blue Bird Jernigan
Affiliation:
Center for Indigenous Health Research and Policy, Oklahoma State University Center for Health Sciences, CAIANDTR Central Plains Satellite Center, Tulsa, OK, USA
Kaylee R. Clyma
Affiliation:
Center for Indigenous Health Research and Policy, Oklahoma State University Center for Health Sciences, CAIANDTR Central Plains Satellite Center, Tulsa, OK, USA
R. Turner Goins
Affiliation:
CAIANDTR Southeast Satellite Center, College of Health and Human Sciences, Western Carolina University, Cullowhee, NC, USA
Gary L. Ferguson
Affiliation:
Institute for Research and Education to Advance Community Health (IREACH), Elson S Floyd College of Medicine, Washington State University, CAIANDTR Pacific Northwest Satellite Center, Pullman, WA, USA
Tassy Parker
Affiliation:
Department of Family and Community Medicine and Colleges of Population Health and Nursing, Public Health Institute for Indigenous Knowledge and Development, Center for Native American Health, Associate Vice President for American Indian Health Research & Education, CAIANDTR Southwest Satellite Center, Albuquerque, NM, USA
Nathania Tsosie
Affiliation:
Department of Family and Community Medicine, University of New Mexico Health Sciences, Center for Native American Health, University of New Mexico School of Medicine, CAIANDTR Southwest Satellite Center, Albuquerque, NM, USA
Sara J. Mumby
Affiliation:
Centers for American Indian and Alaska Native Health, Colorado School of Public Health, University of Colorado Anschutz Medical Campus, Aurora, CO, USA
Spero M. Manson
Affiliation:
Centers for American Indian and Alaska Native Health, Colorado School of Public Health, University of Colorado Anschutz Medical Campus, Aurora, CO, USA
Meredith P. Fort
Affiliation:
Department of Health Systems, Management and Policy, Centers for American Indian and Alaska Native Health, Colorado School of Public Health, University of Colorado Anschutz Medical Campus, Aurora, CO, USA
*
Corresponding author: A. G. Huebschmann; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Translational research needs to show value through impact on measures that matter to the public, including health and societal benefits. To this end, the Translational Science Benefits Model (TSBM) identified four categories of impact: Clinical, Community, Economic, and Policy. However, TSBM offers limited guidance on how these areas of impact relate to equity. Central to the structure of our Center for American Indian and Alaska Native Diabetes Translation Research are seven regional, independent Satellite Centers dedicated to community-engaged research. Drawing on our collective experience, we provide empirical evidence about how TSBM applies to equity-focused research that centers community partnerships and recognizes Indigenous knowledge. For this special issue – “Advancing Understanding and Use of Impact Measures in Implementation Science” – our objective is to describe and critically evaluate gaps in the fit of TSBM as an evaluation approach with sensitivity to health equity issues. Accordingly, we suggest refinements to the original TSBM Logic model to add: 1) community representation as an indicator of providing community partners “a seat at the table” across the research life cycle to generate solutions (innovations) that influence equity and to prioritize what to evaluate, and 2) assessments of the representativeness of the measured outcomes and benefits.

Type
Special Communication
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of Association for Clinical and Translational Science

Introduction

The Center for American Indian and Alaska Native Diabetes Translation Research (CAIANDTR) is one of seven Centers for Diabetes Translation Research (CDTR) funded by the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) [1]. Our mission is to improve and expand translational research focused on preventing and treating diabetes in American Indian and Alaska Native (AI/AN) communities. To accomplish this mission, the CAIANDTR leverages partnerships with seven independent, regional Satellite Centers across the country, a collaborative structure that is unique among the NIDDK CDTRs (Appendix Figure). These Satellite Centers use community-based participatory research (CBPR) approaches to identify priorities with their local AI/AN community partners, to disseminate CAIANDTR resources related to diabetes prevention and treatment, and to develop community-engaged strategies to address the disproportionately high prevalence of diabetes in AI/AN populations (13.6% vs. 6.9% for non-Hispanic Whites) [2]. As identified in the Appendix Figure, the Satellite Centers are led by researchers of AI/AN heritage with Indigenous health research expertise and strong partnerships with their local AI/AN communities.

The CAIANDTR includes the following major activities:

  1. 1. Training and consultation for affiliated diabetes translation researchers;

  2. 2. Engagement with nonacademic partners seeking to pursue diabetes translation research for AI/ANs (e.g., Tribal Epidemiology Centers);

  3. 3. Educational programing for affiliated researchers as well as our diverse national network of health care, community, and policy partners;

  4. 4. Funding and training for investigators committed to pursuing a career consistent with the mission of the CAIANDTR.

Given the need to justify investments in research to Congress and other agencies, there has been increasing attention on how to report the health and societal impact of research projects [Reference Dembe, Lynch, Gugiu and Jackson3,Reference Luke, Sarli and Suiter4]. Beginning in FY2022-2023, to better demonstrate health and societal impact of the CDTRs, NIDDK recommended a new reporting tool – the CDTR Impact Framework. The CDTR Research Impact Framework is based on the Translation Science Benefits Model (TSBM) [Reference Luke, Sarli and Suiter4,Reference Schmittdiel, Herman, Thornton, Pragnell and Haire-Joshu5], and both frameworks encourage investigators to report on outcomes of impact beyond academic metrics of journal publications and grant funding (see Figure 1).

Figure 1. Comparison of Translational Science Benefits Model and CDTR Research Impact Framework. Abbreviations: CDTR = Centers for Diabetes Translation Research; TSBM = Translational Science Benefits Model [Reference Luke, Sarli and Suiter4]. The elements of the CDTR Research Impact Framework were developed from TSBM [Reference Schmittdiel, Herman, Thornton, Pragnell and Haire-Joshu5].

Both the TSBM and CDTR Research Impact Framework include four categories of impact in terms of Translational Health and Societal Benefits: a) Clinical, b) Community, c) Economic, and d) Policy. Specific examples in the “Clinical” category include new clinical benefits, such as medications/devices, or increased adoption/implementation of existing clinical benefits (see Figure 1). “Community” examples include new community health services or health behavior resources. In the “Economic” category, benefits include financial savings or revenue. “Policy” examples include advisory activities to support the development or implementation of policies to improve health/healthy behaviors at the local, regional, or national level. Of note, TSBM recommends reporting on actual benefits to date as well as potential benefits that may logically accrue but could not be measured during the life of a research effort.

The creators of TSBM articulated a TSBM Logic Model (Figure 2) to further define the elements in each stage of the model, depicting three categories proximally (to the left) of the Translational Health and Societal Benefits categories of impact. These three categories are Resources (first column), Scientific Activities (second column), and Scientific Outputs & Outcomes (third column). The logic depicted is that, moving from left to right, one leverages Resources and Scientific activities to generate Scientific Outputs & Outcomes that should facilitate progress toward Translational Benefits.

Figure 2. Proposed novel elements to measure within TSBM related to representation and representativeness. Abbreviations: TSBM = Translational Science Benefits Model; CDTR = Centers for Diabetes Translation Research; figure adapted from TSBM by Luke et al., 2018 [Reference Luke, Sarli and Suiter4], CDTR Research Impact Framework by Schmittdiel et al., 2024 [Reference Schmittdiel, Herman, Thornton, Pragnell and Haire-Joshu5], with influences from Trinkley et al., 2023 [Reference Trinkley, McNeal, Fort, Green, Huebschmann, Brownson, Colditz and Proctor29]. See tables 1 and 2 for descriptions of the novel elements proposed.

Table 1. Proposed novel additions or revisions to the Translational Science Benefits Model (TSBM) Logic Model from the CDTR Research Impact Framework [Reference Schmittdiel, Herman, Thornton, Pragnell and Haire-Joshu5]

Table 2. Proposed novel addition or revisions to the Translational Science Benefits Model (TSBM) Logic Model to promote health equity

As with any new approach for reporting research benefits, retrofitting TSBM to describe the impact of our ongoing CAIANDTR efforts poses both opportunities and challenges. We have encountered a challenge in that the importance and impact of our community-engaged research relationships that we have nurtured over decades with partner agencies and tribal organizations are not emphasized enough within the TSBM Logic Model. Furthermore, our partners’ priority outcomes for addressing health equity are not always well-aligned with TSBM. For example, TSBM does not have an explicit measure of community representation across the research life cycle.

The CDTR Research Impact Framework has already proposed thoughtful amendments to the TSBM Logic Model as shown in Figure 2 and Table 1; these specifically include the following: A) collaborations as a Translational Science Outcome (in addition to being listed as a resource in the original TSBM Logic Model), B) capacity-building of the next generation of scientists as a stand-alone element related to the existing “influence on other scientists” element, and two types of collaborative partnerships within the Translational Health and Societal Benefits categories: C) clinical operations and research partnerships, and D) macro-level partnerships. Our objective in this manuscript is to use the experience of the CAIANDTR to describe and critically evaluate gaps in the fit of TSBM as an evaluation approach sensitive to health equity issues and to propose several new elements to the TSBM Logic Model (Figure 2 and Table 2). As described by other leaders in the implementation science field [Reference Brownson, Kumanyika, Kreuter and Haire-Joshu6,Reference Fort, Manson and Glasgow7], limited attention to health equity [Reference Jones8,Reference Wallerstein and Duran9] is a concern for many implementation science frameworks, not just TSBM. Thus, both TSBM and its derivative CDTR Research Impact Framework could benefit from updates to add further emphasis on key elements that contribute to health equity, such as centering community representation using CBPR methods [Reference Jones8,Reference Wallerstein and Duran9] across the research life cycle and assessing the representativeness of outcomes [Reference Fort, Manson and Glasgow7,Reference Glasgow, Huebschmann and Brownson10]. Our hope is that these proposed amendments to enhance the measurement of representation, representativeness, and other key elements that contribute to health equity in the TSBM Logic Model will be additive to the important existing TSBM measures articulated to date.

Drawing on others’ definitions of community engagement [Reference Goodman, Ackermann, Bowen and Thompson11], community-engaged research principles necessary to promote health equity [12,Reference LaBrier, Andersen and Heidbreder13], and the 4 R’s of Respect, Reciprocity, Relevance, and Responsibility [Reference Kirkness, Barnhardt, Hayoe and Pan14,Reference Teare, Mease, Madampage, King and King15] in the partnership-development process, we define community representation as an indicator of providing community partners with “a seat at the table” across the research life cycle to help generate solutions (innovations) that influence equity and to prioritize what to evaluate. As further articulated in Table 2, under element 3a, this includes 1) authentic engagement of community members throughout the research project life cycle – including participation on research teams, when possible, to 2) build trust and 3) share cultural perspectives, priorities, needs, and resources with other implementation partners, in order to ensure meaningful benefits to all involved. Drawing on established health equity and implementation science research methods [Reference Fort, Manson and Glasgow7,Reference Sadare, Williams and Simon16,Reference Olyaeemanesh, Takian and Mostafavi17], we define representativeness as: an assessment of how equally the benefits and impact of a solution (innovation) are distributed – determining who benefits, who does not, and who should – among populations, communities, and implementing organizations.

We will first outline how the CAIANDTR’s efforts in the current funding cycle (August 2021 to January 2024) mapped onto the TSBM and CDTR Research Impact Framework to show positive existing alignments and potential gaps. Next, to address the identified gaps, we propose novel elements to measure in TSBM and the CDTR Research Impact Framework to sharpen the focus on health equity. To illustrate the impetus for these proposed revisions, we describe the impact of research and programs conducted within the CAIANDTR’s regional Satellite Centers with attention to the novel revisions proposed. We conclude with future considerations to enhance the application of these frameworks.

Methods

Overarching contributions of the CAIANDTR captured by TSBM outcomes in the CDTR research impact framework

To consider the potential gaps between the TSBM and CDTR Research Impact Framework and the activities of the CAIANDTR, we followed a community-engaged critical appraisal approach in our established CAIANDTR community of practice. CAIANDTR leaders held a series of three discussions in monthly meetings of the CAIANDTR Outreach, Engagement, and Dissemination Committee, which includes representation from all seven Satellite Centers, and three discussions in the monthly CAIANDTR Steering Committee meetings. We took notes from each of these meetings that informed our initial recommendations. We also had two additional discussions with the CAIANDTR Outreach, Engagement and Dissemination Committee to iteratively discuss and revise our proposed recommendations for changes based on reviewer critiques of the initial manuscript. These discussions compared the priority activities and outcomes of the Satellite Centers to these frameworks and considered any gaps and areas of misalignment. Between these meetings, CAIANDTR Steering Committee coauthors iteratively proposed revisions to augment the measures of impact in the TSBM Logic Model to incorporate equity principles and iteratively developed a visual representation of the CAIANDTR Steering Committee’s connections with the Satellite Centers and their communities as a model of important elements of community representation and impact in our work. We also co-developed case examples and vignettes from multiple Satellite Centers to highlight outcomes according to our proposed revisions to the TSBM Logic Model (Figure 2). In the Results section, we report the findings of these critical appraisal discussions and the proposed revisions to the TSBM Logic Model.

Results

Assessment of potential gaps in TSBM and the CDTR research impact framework with regards to health equity

Using the TSBM Logic Model with amendments from the CDTR Research Impact Framework (Figure 2), impact of the CAIANDTR in the current funding cycle is most notable in the Scientific Outputs & Outcomes of: 1) contributions to capacity-building of the next generation of scientists and clinicians, 2) facilitation of new collaborations, and 3) important research publications and presentations related to diabetes among AI/AN peoples [Reference Fort, Reid and Russell18Reference Manson and Buchwald21]. In addition, Satellite Centers led CBPR activities that generated impact within the Community, Clinical, Economic, and Policy categories of impact, examples of which are shown in Table 3. However, there are notable gaps in TSBM and the CDTR Research Impact Framework as applied to the CAIANDTR – we were unable to find suitable areas of impact to document two overarching constructs: 1) Representation and 2) Representativeness, as defined above.

Table 3. CAIANDTR examples of representation and community priority outcomes to promote equity in addition to classic translational science benefit outcomes

Note: AI/AN (American Indian/Alaska Native); SNAP-Ed (Supplemental Nutrition Assistance Program Education); ANHC (Alaska Native Health Campus – Jointly Managed by and Inclusive of Southcentral Foundation and Alaska Native Tribal Health Consortium); T2D (type 2 diabetes); WCIE (What Can I Eat? Diabetes Nutrition Education for AI/AN Adults with Type 2 Diabetes).

Recommended revisions to TSBM

To promote greater attention to health equity, the CAIANDTR proposes several adaptations to TSBM that are shown visually within the TSBM Logic Model (Figure 2) and itemized in Table 2 – these generally seek to promote community representation across the research life cycle and to ensure the assessment of representativeness of outcomes. These proposed novel elements are in line with recent publications promoting the need to center communities’ priorities, assets, and needs to further the measurement of representativeness as part of health equity impact assessments in research [12,Reference Sadare, Williams and Simon16,Reference Olyaeemanesh, Takian and Mostafavi17,Reference Haire-Joshu and Hill-Briggs22,Reference Redvers, Reid and Carroll23]. Related to representation, the first research priority of the NIDDK report entitled “Pathways to Health for All” is to “strengthen community engagement through partnership, power sharing, and capacity building to improve research” [12]. In terms of representativeness, health equity impact assessments highlight the need to evaluate for heterogeneity of effects among subpopulations [Reference Sadare, Williams and Simon16,Reference Olyaeemanesh, Takian and Mostafavi17]. In the original TSBM logic model, the engagement process with partners and information gathered from partners were characterized as “Resources,” or were designated as “collaborations” as part of the Scientific Activities (Figure 2). The CDTR Research Impact Framework also characterized community partnerships as “collaborations” within Scientific Outputs & Outcomes (A in Table 1) and as “macro-level partnerships” in the Community category of Translational Benefits (D in Table 1). We propose to more holistically consider ways to assess these relationships beyond these siloed categories and propose novel elements to assess representation that span these categories and the research life cycle, in line with CBPR and Participatory Implementation Science recommendations (Table 2) [Reference Fort, Manson and Glasgow7,Reference Wallerstein and Duran9,Reference Ramanadhan, Alemán and Bradley24]. For simplicity, we articulate Community Representation in the “Scientific Activities” column (item 3a in Table 2, with reference to other key aspects of representation as items 1a, 1b, 2a, and 3b), and we depict measurements of Representation (e.g., measurements of engagement and sustained or novel collaborations) as item 5a to measure engagement (“Scientific Outputs & Outcomes”) and item 6a to measure sustained/novel collaborations in the “Translational Health and Societal Benefits.” We find these novel proposed elements to more clearly recognize the critical role of community members in jointly guiding the focus and priority of the research from the very beginning and characterize community partnerships as giving rise to our CAIANDTR research, rather than growing out of it. This includes leveraging Indigenous ways of knowing and values as they pertain to health [Reference Redvers, Reid and Carroll23,Reference Kimmerer25], by promoting representation of community voices to elevate community and traditional ways of knowing and overcome structural racism. Some examples of these newly proposed elements are: 1) including community members (e.g., AI/AN tribal members/leaders) as investigators and implementing staff; and 2) community-led prioritization of topics and guidance on the planning, implementation, and sustainment of innovations that draw on existing community health-enhancing solutions and/or new interventions. An example of efficient community representation in AI/AN communities includes leveraging existing AI/AN community advisory boards across the research life cycle to prioritize measuring what matters to the community. Examples of priority outcomes that are culturally relevant to multiple socio-ecological levels in the CAIANDTR work conducted across our Satellite Centers are the individual, family, community, and land and place measures in the Conceptual Framework of Potential Health Effects of Indigenous Food Sovereignty Initiatives) [Reference Jernigan, Nguyen and Maudrie26] and elements of the social context and social determinants of health (SDOH) [27,28].

In addition, we highlight ways to assess representativeness in the TSBM Logic Model, such as the use of a Health Equity Impact Assessment that includes evaluation of representative program reach/availability to different subpopulations (e.g., race/ethnicity, sex/gender). Specifically, we propose to measure the representativeness of community partner-prioritized outcomes as Scientific Outputs & Outcomes (5c in Table 2) and/or Translational Health and Societal Benefits (6b in Table 2) [Reference Fort, Manson and Glasgow7,Reference Glasgow, Huebschmann and Brownson10], ensuring the benefits are equitably distributed across subpopulations – for example, this would encourage efforts to promote equitable adoption by clinical/community sites and reach to participants, not just absolute adoption or reach.

In the following paragraphs, we turn to examples from the CAIANDTR of the Resources and Representation of invested partners, as well as examples of how the impacts on the Community (Health and Well-Being), Clinical, Economic, and Policy categories might be strengthened.

Examples of community and clinical impacts of CAIANDTR – representation and representativeness

The CAIANDTR adopts a community strengths-based perspective and makes purposeful efforts to center our work through community representation and to assess the representativeness of our outcomes [Reference Wallerstein and Duran9,Reference Redvers, Reid and Carroll23]. The highly interconnected CAIANDTR structure encourages the Satellite Centers to share Indigenous and community knowledge with each other and other investigators. While the knowledge itself may be considered as part of “Human Resources” and “Knowledge Resources” in the TSBM Logic Model, it is only through active Community Representation (3a in Table 2) that the communal sharing may yield Translational Science Outcomes of “influence on other scientists” and Health and Societal Benefits in the “Community” category in terms of “community health services” and “health behavior and education resources” (Figure 1). Going further, a richer understanding of the impact of resource-sharing within the CAIANDTR may be identified with our newly recommended assessments (see Table 2) of “Community Capacity” (5b), “Representativeness” (5a and 6c) and “Impact on Unmet Social Needs” (7a). All Satellite Center efforts incorporate community representation and these include food/nutrition security efforts to increase access to healthful food through multi-level approaches, novel ways to deliver peer nutrition education for people with diabetes, local health assessments during community events, and cultural tailoring of evidence-based palliative care interventions (Table 3). In terms of representativeness, the CAIANDTR Enrichment Program webinars have reached a wide audience of clinical and community health agencies outside of typical academic networks (e.g., Indian Health Service and tribal providers, administrators, AI/AN community members).

To depict how the CAIANDTR infrastructure fits with the Community Representation elements of Figure 2, we co-designed a visual representation of the dynamic interplay across the CAIANDTR as a forest (Figure 3). In the figure, each Satellite Center is represented as a tree that nurtures the AI/AN peoples in its region, as well as other Satellite Centers and the CAIANDTR hub’s Mother Tree [Reference Kimmerer25,Reference Wohlleben30] – this reciprocity improves the health of each Satellite Center’s community and the totality of the network through the dynamic sharing of resources and grassroots solutions from local AI/AN community networks with one another. The CAIANDTR network communicates through various mechanisms, including but not limited to conventional publications; clear and efficient community-facing infographics; newsletters and webinars that spotlight local champions and their successes for diabetes prevention/treatment; and regional strategic planning.

Figure 3. Visual model of the CAIANDTR. Each of our 7 Satellite Centers connects with their respective communities, the CAIANDTR hub, and each other. We model these multi-directional partnerships as the sharing of nutrients in a participatory and reciprocal process within the interconnected root systems of a forest ecosystem. We also model the diversity and regional connectedness of each Satellite Center visually in terms of the biodiversity of trees/plants that are local to each region (e.g., Birch, chestnut, Cottonwood, piňon trees) and their interwoven root systems locally. Depicting the fruit/produce in each region in woven baskets that are traditionally used to prepare and store produce for Indigenous peoples is a tangible illustration of the outcomes of impact according to the CDTR Research Impact Framework. The local produce depicted includes: cloudberries and spruce tips (Alaska), nettles and huckleberries (Pacific Northwest), green and red chiles (Southwest), peaches (Rocky mountain), corn (Central plains), wild rice (Northcentral), and elderberries (Southeast).

Economic and policy impacts

The TSBM Logic Model allows for consideration of the “financial and societal costs of illness” related to the social drivers of health but does not explicitly highlight these elements. In terms of Economic impact, multiple Satellite Centers have worked to address healthy eating and food sovereignty by aligning tribal agricultural policies with health goals. Policy impacts have included local, tribal, and national advocacy efforts to simultaneously address healthy food production, access, and preferences to strengthen food sovereignty. This work highlights successful efforts to obtain healthy policies to advance health, including promoting food sovereignty and improving access to healthful foods in our example (see Table 3).

Case vignettes

Two case vignette details follow for selected examples from Table 3, in order to provide additional context.

Vignette 1 - “What Can I Eat?” Diabetes Nutrition Education for AI/AN Adults with Type 2 Diabetes (AI/AN WCIE)

Summary: AI/AN WCIE is a diabetes nutrition education curriculum for AI/AN adults living with type 2 diabetes (T2D) [31]. The curriculum includes Indigenous strengths and values-based approaches to diabetes nutrition education focused on traditional foods, traditional ways of knowing (e.g., storytelling), arts-based learning activities, and mindful food-related decision-making.

Efforts to support representation and to address SDOH: WCIE was developed by researchers in partnership with AI/AN people for AI/AN people – this includes approaches to program development, pilot evaluation, and subsequent evaluation of an added healthy food security resource. In addition, AI/AN WCIE evaluators prioritized developing a community advisory board of paid Native advisors as well as a liaison to inform AI/AN WCIE implementation and evaluation. Culturally, AI/AN WCIE includes arts-based learning activities, traditional food focus, traditional-focused mindful nutrition choice activities, storytelling and peer-to-peer interaction, and opportunities for community advocacy to promote nutrition health beyond focusing only on individuals living with T2D [Reference Stotz, Brega, Henderson, Lockhart and Moore32Reference Stotz, Moore and McNulty34].

Future opportunities: Future steps include enhancing support from the Indian Health Service Division of Diabetes Treatment and Prevention to scale up AI/AN WCIE. Specifically, to enhance representativeness by increasing the number of AI/AN communities that have the capacity to deliver WCIE, we seek to establish support to include AI/AN WCIE as an accredited diabetes self-management education and care resource and to expand AI/AN WCIE curriculum training for community educators. Project leadership has participated in many national opportunities to speak about the program and to provide demonstrations of AI/AN WCIE to increase awareness and use of the curriculum, including a successful WCIE training in Oklahoma (August 2023) with 19 nutrition educators.

Vignette 2 – The Center for Indigenous Innovation and Health Equity (CIIHE) Initiative

Summary: The CIIHE was established in 2021 by the Office of Minority Health as a community-academic partnership between Oklahoma State University Center for Health Sciences and national communities of practice – including AI/AN, Native Hawaiian, and Pacific Islander populations [Reference Jernigan, Demientieff and Maunakea35]. The CIIHE initiative developed a food sovereignty conceptual framework for health and adapted this framework to guide food sovereignty initiatives within the diverse partnering communities with a goal of strengthening Indigenous food systems and practices to promote health and well-being [Reference Jernigan, Nguyen and Maudrie26].

Efforts to support representation and to address SDOH: In terms of representation, the CIIHE network of community and academic partners developed the framework over the course of two years – Indigenous voices guided every stage of the process [Reference Jernigan, Nguyen and Maudrie26]. The process of developing the framework included compiling a comprehensive list of food sovereignty activities from CIIHE communities using Indigenous data collection methods, a review of the scientific literature to identify the influence of food sovereignty activities on health, including SDOH, and a talking circle with the CIIHE community partners to triangulate findings with Indigenous community guidance. In terms of representativeness, as intended, the CIIHE has been applied with several AI/AN community partners to date; the representativeness of Benefits described in Table 3 included transmission of traditional Indigenous food practices that will impact those currently involved, as well as future generations [Reference Jernigan, Demientieff and Maunakea35].

Future opportunities: Future steps include obtaining additional data on the relationship between health and Indigenous food sovereignty initiatives to build capacity to scale out these programs to more communities. There is interest in understanding further how engaging in food sovereignty practices improves health, in part, as a way to reconnect or support community learning about Indigenous identity and heritage.

Discussion

Lessons learned and future directions

Based on empirical data and examples of centering community through the CAIANDTR Satellite Centers, we proposed novel additions or revised elements to the TSBM Logic Model. These novel recommendations emphasize the importance of participatory processes that ensure community representation across the research life cycle, in order to promote representativeness of research impact in terms of TSBM outcomes and benefits. We specifically described some examples of the types of impact observed in the Satellite Centers’ work in the Community (Health and Well-being), Economic, and Policy categories of Health and Societal Impact. These participatory processes of community representation across the research life cycle that may be assessed longitudinally using measures of engagement [Reference Goodman, Ackermann, Bowen and Thompson11] are important leading indicators of equity because they ensure community solutions, perspectives, and resources are prioritized for implementation. We also highlighted the importance of measuring representativeness as part of the TSBM Logic Model, which may be done as part of a Health Equity Impact Assessment [Reference Sadare, Williams and Simon16,Reference Olyaeemanesh, Takian and Mostafavi17] to determine who benefits and who does not. In the examples we provided from the Satellite Centers, community representation promoted broad and equitable reach and adoption, by working with tribal leaders and community partners to promote inclusion across the program development, roll-out, and evaluation phases.

Our proposed adaptations align with calls from other scholars in the fields of health equity and implementation science for a more specific focus of implementation science frameworks on (1) SDOH and societal context; (2) consideration of culturally relevant factors/cultural tailoring; (3) attention to potential bias/stigma in the interactions between those delivering and receiving interventions; (4) leveraging community strengths-based approaches to health promotion, and (5) assessing for inequities in outcomes among subpopulations [Reference Fort, Manson and Glasgow7,12,Reference Haire-Joshu and Hill-Briggs22,Reference Redvers, Reid and Carroll23,Reference Jernigan, D’Amico and Keawe’aimoku Kaholokula36]. There are limitations to our proposed recommendations, including that they are more applicable to translational research of efficacious interventions to health systems (T2–T3) and from health systems to populations (T3–T4), as compared to early-phase translational research from to develop efficacious interventions (T1–T2). Also, more formal approaches for communities of practice to propose refinements to processes are emerging that would have strengthened our critical appraisal approach – we encourage others seeking to adapt our approach to consider these methods [Reference Van Woensel, Tu and Michalowski37].

Adding to our specific recommendations for adaptations to TSBM and the CDTR Research Impact Framework above, it may be useful for researchers and program implementers/evaluators to consider the following approaches to demonstrate impact with attention to health equity:

  1. 1. To center activities in community, researchers and program evaluators should use CBPR cycles of problem definition, assessment, interpretation, and dissemination [Reference Wallerstein and Duran9]. Indicators of these participatory engagement processes should be reported as a key equity outcome of community representation in their own right as outlined in Table 2 (revisions 1a/1b, 2, 3a/3b, 5a), and these processes should be continued across the project life cycle.

  2. 2. To guide researchers who must report impacts according to the original TSBM Logic Model’s benefits to Health and Societal Impact, the TSBM online toolkit [38] may be used to give specific attention to its designated categories of impact. We encourage use of CBPR cycles to identify which outcomes matter most to community partners, as well as what potential impacts are logical to expect. NIH institutes that require researchers to report impacts according to TSBM as part of their deliverables may offer this guidance to help centers plan accordingly.

  3. 3. The Community and Clinical impacts of TSBM may be considered as part of a holistic “Health and Well-Being” category of outcomes and may consider aspects of the Indigenous determinants of health recommendations adopted by the United Nations Social and Economic Council [Reference Redvers, Reid and Carroll23,39].

  4. 4. The Economic category of TSBM could be updated to count impact on SDOH as part of the economic financial and societal costs of illness. Efforts to address these elements may also be considered as solutions in the Clinical, Community, or Policy dimensions.

  5. 5. The Policy category should include a broad lens. As currently operationalized in TSBM, this includes advocacy, such as negotiation, testimony, or writing evidence briefs to support policy change. In addition, policy change is important at multiple levels, including the tribal nation, state, and federal levels. For example, policies to advance health at a tribal level by promoting food self-determination and sovereignty are important outcomes to report. Based on the relevance of policy outcomes to advance health, the CAIANDTR is considering a policy core for the next round of NIDDK funding.

Conclusion

We met our objective to describe potential gaps in the fit of TSBM as an evaluation approach with sensitivity to health equity issues based on the CAIANDTR experience. To fill these gaps, we proposed adding measures of community representation across the research life cycle, assessment of priority community outcomes, and the representativeness (equity) of outcomes. These proposed adaptations are fully in line with the goal of TSBM to assess impact on health and societal benefits that matter to the public and add further specificity to the “Equity Lens” that is already a part of the CDTR Research Impact Framework. These recommendations from the CAIANDTR experience are also in line with recommendations from other national leaders to add a stronger equity focus to both implementation science and diabetes translation research [Reference Brownson, Kumanyika, Kreuter and Haire-Joshu6,Reference Fort, Manson and Glasgow7,12,Reference Haire-Joshu and Hill-Briggs22,Reference Redvers, Reid and Carroll23].

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/cts.2024.638.

Acknowledgments

The coauthors are grateful for the collective insights and input shared to shape this paper from the dialogue amongst the 7 Satellite Centers affiliated with our Center for American Indian Alaska Native Diabetes Translation Research (CAIANDTR) – the Alaska Satellite Center (Roxanna King, PhD [Lakota descendant], Aliassa L. Shane, MPH [Shoshone-Paiute, Unangax]), the Southeast Satellite Center (R. Turner Goins, PhD [Catawba descendant]), the Southwest Satellite Center (Tassy Parker, PhD, RN [Seneca], Nathania Tsosie, MCRP [Diné], Kandyce Garcia, MS [Kewa]), the Central Plains Satellite Center (Valarie Blue Bird Jernigan, PhD [Choctaw], Kaylee R. Clyma, MPH [Cherokee]), the Rocky Mountain Satellite Center (Spero Manson, PhD [Little Shell Chippewa]), the Northcentral Satellite Center (Colette Adamesen, PhD [Turtle Mountain Band of Chippewa Indians]), and the Pacific Northwest Satellite Center (Gary Ferguson, ND [Unangax/Aleut]).

For Figure 3, the authors wish to acknowledge the graphic design work of these Vecteezy creators (artwork was downloaded from www.vecteezy.com/): Arif Wijanarko (nettles), Diana Johanna Velasquez (wild rice), Giuseppe Ramos (cloudberries, huckleberries), happymeluv (green chiles), Mansoor Ali (chestnut tree), Praewpailin Phonsri (maple tree), sunshine-91 (baskets), Vladimir Maeuski (corn), wuttichainanchaikan (pine/cedar trees), and Yehor Lisnyi (spruce tips), as well as these creators from The Noun Project (artwork was downloaded from https://thenounproject.com/): anisah mahfudhah billah (growing tree), Ivan Avdeev (apple), kareemov (mother tree), and Stone (piñon tree, cottonwood tree).

Author contributions

Dr Huebschmann co-developed the design of the work, drafted and edited the manuscript, took notes from the critical appraisal meetings, provided interpretation of findings, and took final responsibility for the manuscript as a whole. Drs. Brega, Fort, Manson, Stotz, and Ms. Mumby co-developed the design of the work, provided contributions of expertise and interpretation of findings, and edited the manuscript. All other authors (Drs. King, Jernigan, Ferguson, and Parker and Ms. Shane, Clyma, and Tsosie) provided contributions of expertise, interpretation of findings, and edited the manuscript.

Competing interests

All authors declare they have no conflicts of interest.

Funding statement

All authors are supported by the CAIANDTR grant from the NIDDK (P30DK092923). RK and ALS were also supported by the National Institute of General Medical Sciences of the National Institutes of Health (S06GM142122). VBBJ and KRC were also supported by the Office of Minority Health (1 CPIMP211317-02-00). SAS was also supported by the NIDDK K01 (1K01DK128023). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

References

National Institutes of Health. National institute of diabetes and digestive and kidney diseases. Diabetes centers (https://www.niddk.nih.gov/research-funding/research-programs/diabetes-centers) Accessed November 8, 2024.Google Scholar
Centers for Disease Control and Prevention. CDC National Diabetes Statistics Report. 2023 U.S. Department of Health & Human Services. (https://nationaldppcsc.cdc.gov/s/article/CDC-National-Diabetes-Statistics-Report) Accessed November 8, 2024.Google Scholar
Dembe, AE, Lynch, MS, Gugiu, PC, Jackson, RD. The translational research impact scale: development, construct validity, and reliability testing. Eval Health Prof. 2014;37(1):5070. doi: 10.1177/0163278713506112 Google Scholar
Luke, DA, Sarli, CC, Suiter, AM, et al. The translational science benefits model: a new framework for assessing the health and societal benefits of clinical and translational sciences. Clin Transl Sci. 2018;11(1):7784. doi: 10.1111/cts.12495 Google Scholar
Schmittdiel, J, Herman, W, Thornton, P, Pragnell, M, Haire-Joshu, D. Adapting the translational science benefits model to improve health and advance health equity in diabetes: the centers for diabetes translation research impact framework. J Clin Transl Sci. 2024;8 (1):e131. doi: 10.1017/cts.2024.580 Google Scholar
Brownson, RC, Kumanyika, SK, Kreuter, MW, Haire-Joshu, D. Implementation science should give higher priority to health equity. Implement Sci. 2021;16(1):28. doi: 10.1186/s13012-021-01097-0 Google Scholar
Fort, MP, Manson, SM, Glasgow, RE. Applying an equity lens to assess context and implementation in public health and health services research and practice using the PRISM framework. Front Health Serv. 2023;1 3:1139788-1–139788. doi: 10.3389/frhs.2023 Google Scholar
Jones, CP. Systems of power, axes of inequity: parallels, intersections, braiding the strands. Med Care. 2014;52(10 Suppl 3):S71–5. doi: 10.1097/mlr.0000000000000216 Google Scholar
Wallerstein, N, Duran, B. Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity. Am J Public Health. 2010;100(S1):S40S46. doi: 10.2105/ajph.2009.184036 Google Scholar
Glasgow, RE, Huebschmann, AG, Brownson, RC. Expanding the CONSORT figure: increasing transparency in reporting on external validity. Am J Prev Med. 2018;55(3):422430. doi: 10.1016/j.amepre.2018.04.044 Google Scholar
Goodman, MS, Ackermann, N, Bowen, DJ, Thompson, V. Content validation of a quantitative stakeholder engagement measure. J Community Psychol. 2019;47(8):1937-2–1951-2239. doi: 10.1002/jcop Google Scholar
NIDDK Advisory Council. Pathways to health for all: health disparities and health equity research recommendations and opportunities, report of the working group of the NIDDK advisory council. National Institute of Diabetes and Digestive and Kidney Diseases May. 2023 (https://www.niddk.nih.gov/about-niddk/strategic-plans-reports/pathways-health-all) Accessed February 8, 2024.Google Scholar
LaBrier, M, Andersen, S, Heidbreder, J, et al. Translating for equity impact: a community-engaged approach to integrate health equity into the translational science benefits model. J Clin Transl Sci. 2024;8(1):84–84. doi: 10.1017/cts.2024.253 Google Scholar
Kirkness, VJ, Barnhardt, R. First nations and higher education: the four R’s - respect, relevance, reciprocity, responsibility, knowledge across cultures: a contribution to dialogue among civilizations. In: Hayoe, R, Pan, J, Comparative Education Research Centre, The University of Hong Kong; 2001.Google Scholar
Teare, A, Mease, A, Madampage, C, King, A, King, M. A process for indigenous community research through meaningful engagement with grandmother’s Bay. AlterNative. 2024;20(1):3041. doi: 10.1177/11771801241235348 Google Scholar
Sadare, O, Williams, M, Simon, L. Implementation of the health equity impact assessment (HEIA) tool in a local public health setting: challenges, facilitators, and impacts. Can J Public Health. 2020;111(2):212219. doi: 10.17269/s41997-019-00269-2 Google Scholar
Olyaeemanesh, A, Takian, A, Mostafavi, H, et al. Health equity impact assessment (HEIA) reporting tool: developing a checklist for policymakers. Int J Equity Health. 2023;22(1):241. doi: 10.1186/s12939-023-02031-0 Google Scholar
Fort, MP, Reid, M, Russell, J, et al. Diabetes prevention and care capacity at urban Indian health organizations. Front Public Health. 2021;9:740946. doi: 10.3389/fpubh.2021.740946 Google Scholar
Steiner, JF, Goodrich, GK, Moore, KR, et al. An approach to selecting single or multiple social risk factors for clinic-based screening. J Gen Intern Med. 2021;37(3):703705. doi: 10.1007/s11606-021-06740-6 Google Scholar
Moore, KR, Schroeder, EB, Goodrich, GK, et al. Racial and ethnic equity in care for hypertension and diabetes in an urban Indian health organization. J Racial Ethn Health Disparities. 2022;10(3):13191328. doi: 10.1007/s40615-022-01317-3 Google Scholar
Manson, SM, Buchwald, DS. Aging and health of American Indians and alaska natives: contributions from the native investigator development program. J Aging Health. 2021;33(7-8_suppl):3s9s. doi: 10.1177/08982643211014399 Google Scholar
Haire-Joshu, D, Hill-Briggs, F. The next generation of diabetes translation: a path to health equity. Annu Rev Public Health. 2019;40(1):391410. doi: 10.1146/annurev-publhealth-040218-044158 Google Scholar
Redvers, N, Reid, P, Carroll, D, et al. Indigenous determinants of health: a unified call for progress. Lancet. 2023;402(10395):79. doi: 10.1016/s0140-6736(23)01183-2 Google Scholar
Ramanadhan, S, Alemán, R, Bradley, CD, et al. Using participatory implementation science to advance health equity. Annu Rev Public Health. 2023;45(1):4767. doi: 10.1146/annurev-publhealth-060722-024251 Google Scholar
Kimmerer, RW. Braiding sweetgrass. Milkweed Editions; 2013.Google Scholar
Jernigan, VBB, Nguyen, CJ, Maudrie, TL, et al. Food sovereignty and health: a conceptual framework to advance research and practice. Health Promot Pract. 2023;24(6):10701074. doi: 10.1177/15248399231190367 Google Scholar
Centers for Disease Control and Prevention. Social determinants of health (SDOH).2024 (https://www.cdc.gov/about/priorities/why-is-addressing-sdoh-important.html) Accessed July 29, 2024.Google Scholar
Healthy People 2030, U.S. Department of Health and Human Services, Promotion OoDPaH. Social determinants of health .2020 (https://health.gov/healthypeople/priority-areas/social-determinants-health) Accessed July 29, 2024.Google Scholar
Trinkley, K, McNeal, D, Fort, M, Green, L, Huebschmann, A. Furthering dissemination and implementation research: the need for more attention to external validity. In: Brownson, R, Colditz, G, Proctor, E, eds. Dissemination and implementation in health. 3rd ed. Oxford University Press; 2023.Google Scholar
Wohlleben, P. The hidden life of trees. Greystone Books; 2016.Google Scholar
American Diabetes Association. What can I eat? (WCIE) healthy choices for American Indians and alaska natives (AI/ANs) with T2D. (https://professional.diabetes.org/what-can-i-eat-wcie-healthy-choices-american-indians-and-alaska-natives-aians-t2d) Accessed November 8, 2024.Google Scholar
Stotz, S, Brega, AG, Henderson, JN, Lockhart, S, Moore, K. Food insecurity and associated challenges to healthy eating among American Indians and alaska natives with type 2 diabetes: multiple stakeholder perspectives. J Aging Health. 2021;33(7-8_suppl):31s39s. doi: 10.1177/08982643211013232 Google Scholar
Stotz, SA, Brega, AG, Gonzales, K, Hebert, LE, Moore, KR, AI/AN WCIE Study Group. Facilitators and barriers to healthy eating among American Indian and alaska native adults with type 2 diabetes: stakeholder perspectives. Curr Dev Nutr. 2021;5(15):2231. doi: 10.1093/cdn/nzaa114 Google Scholar
Stotz, SA, Moore, KR, McNulty, M, et al. Evaluation of a synchronous, online diabetes nutrition education program for American Indians and alaska natives with type 2 diabetes: facilitators and participants’ experiences. J Nutr Educ Behav. 2023;55(2):114124. doi: 10.1016/j.jneb.2022.10.013 Google Scholar
Jernigan, VBB, Demientieff, LX, Maunakea, AK. Food sovereignty as a path to health equity for indigenous communities: introduction to the focus issue. Health Promot Pract. 2023;24(6):10661069. doi: 10.1177/15248399231190355 Google Scholar
Jernigan, VBB, D’Amico, EJ, Keawe’aimoku Kaholokula, J. Prevention research with indigenous communities to expedite dissemination and implementation efforts. Prev Sci. 2020;21(Suppl 1):7482. doi: 10.1007/s11121-018-0951-0 Google Scholar
Van Woensel, W, Tu, SW, Michalowski, W, et al. A community-of-practice-based evaluation methodology for knowledge intensive computational methods and its application to multimorbidity decision support. J Biomed Inform. 2023;142:104395. doi: 10.1016/j.jbi.2023.104395 Google Scholar
Washington University in St. Louis. TSBM translating for impact toolkit. (https://translationalsciencebenefits.wustl.edu/toolkit/#/login) Accessed November 8, 2024.Google Scholar
U.N. Economic and Social Council. Indigenous determinants of health in the 2030 Agenda for sustainable development 2023 (https://www.nihb.org/resources/IDH%20UNPFII%20Report%20-%202023.pdf) Accessed February 8, 2024.Google Scholar
International Association for Public Participation. IAP2 Spectrum of Public Participation.2018 (https://cdn.ymaws.com/www.iap2.org/resource/resmgr/pillars/Spectrum_8.5x11_Print.pdf) Accessed July 29, 2024.Google Scholar
Gonzalez, R, Power, Facilitating. Spectrum of community engagement to ownership.2019 (https://www.facilitatingpower.com/spectrum_of_community_engagement_to_ownership) Accessed July 29, 2024.Google Scholar
Harding, A, Harper, B, Stone, D, et al. Conducting research with tribal communities: sovereignty, ethics, and data-sharing issues. Environ Health Perspect. 2012;120(1):610doi:10.1289/ehp Google Scholar
Carroll, SR, Rodriguez-Lonebear, D, Martinez, A. Indigenous data governance: strategies from United States native nations. Data Sci J. 2019;18(1):31. doi: 10.5334/dsj-2019-031 Google Scholar
Goins, RT, Haozous, EA, Anderson, E, Winchester, B. Cultural tailoring advance care planning for an American Indian community: make your wishes about you. Ethnic Health. 2024;116. doi: 10.1080/13557858.2024.2401830 Google Scholar
Smylie, J, Olding, M, Ziegler, C. Sharing what we know about living a good life: indigenous approaches to knowledge translation. J Can Health Libr Assoc. 2014;35(1):1623. doi: 10.5596/c14-009 Google Scholar
Parker, T, Kelley, A, Cooeyate, N, Tsosie, N. Tribal perspectives on hypertension: results from the center for native American health native-CHART needs assessment. J Prim Care Community Health. 2022;13:21501319221144269. doi: 10.1177/21501319221144269 Google Scholar
Figure 0

Figure 1. Comparison of Translational Science Benefits Model and CDTR Research Impact Framework. Abbreviations: CDTR = Centers for Diabetes Translation Research; TSBM = Translational Science Benefits Model [4]. The elements of the CDTR Research Impact Framework were developed from TSBM [5].

Figure 1

Figure 2. Proposed novel elements to measure within TSBM related to representation and representativeness. Abbreviations: TSBM = Translational Science Benefits Model; CDTR = Centers for Diabetes Translation Research; figure adapted from TSBM by Luke et al., 2018 [4], CDTR Research Impact Framework by Schmittdiel et al., 2024 [5], with influences from Trinkley et al., 2023 [29]. See tables 1 and 2 for descriptions of the novel elements proposed.

Figure 2

Table 1. Proposed novel additions or revisions to the Translational Science Benefits Model (TSBM) Logic Model from the CDTR Research Impact Framework [5]

Figure 3

Table 2. Proposed novel addition or revisions to the Translational Science Benefits Model (TSBM) Logic Model to promote health equity

Figure 4

Table 3. CAIANDTR examples of representation and community priority outcomes to promote equity in addition to classic translational science benefit outcomes

Figure 5

Figure 3. Visual model of the CAIANDTR. Each of our 7 Satellite Centers connects with their respective communities, the CAIANDTR hub, and each other. We model these multi-directional partnerships as the sharing of nutrients in a participatory and reciprocal process within the interconnected root systems of a forest ecosystem. We also model the diversity and regional connectedness of each Satellite Center visually in terms of the biodiversity of trees/plants that are local to each region (e.g., Birch, chestnut, Cottonwood, piňon trees) and their interwoven root systems locally. Depicting the fruit/produce in each region in woven baskets that are traditionally used to prepare and store produce for Indigenous peoples is a tangible illustration of the outcomes of impact according to the CDTR Research Impact Framework. The local produce depicted includes: cloudberries and spruce tips (Alaska), nettles and huckleberries (Pacific Northwest), green and red chiles (Southwest), peaches (Rocky mountain), corn (Central plains), wild rice (Northcentral), and elderberries (Southeast).

Supplementary material: File

Huebschmann et al. supplementary material

Huebschmann et al. supplementary material
Download Huebschmann et al. supplementary material(File)
File 1.4 MB