Hostname: page-component-586b7cd67f-2brh9 Total loading time: 0 Render date: 2024-11-25T03:12:29.682Z Has data issue: false hasContentIssue false

Examining the development of information needs assessment tools for use in the cancer context: A scoping and critical review

Published online by Cambridge University Press:  12 September 2023

Maclean Thiessen*
Affiliation:
Faculty of Nursing, University of Calgary, Calgary, AB, Canada Section of Oncology and Hematology, Department of Internal Medicine, Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, MB, Canada
Daranne Harris
Affiliation:
Faculty of Nursing, University of Calgary, Calgary, AB, Canada
Patricia A. Tang
Affiliation:
Department of Oncology, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
Shelley Raffin Bouchal
Affiliation:
Faculty of Nursing, University of Calgary, Calgary, AB, Canada
Shane Sinclair
Affiliation:
Faculty of Nursing, University of Calgary, Calgary, AB, Canada Department of Oncology, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
*
Corresponding author: M. Thiessen; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

Information needs are one of the most common unmet supportive care needs of those living with cancer. Little is known about how existing tools for assessing information needs in the cancer context have been created or the role those with lived cancer experience played in their development.

Objectives

This review aimed to characterize the development and intended use of existing cancer specific information needs assessment tools.

Methods

A systematic scoping review was conducted using a peer-reviewed protocol informed by recommendations from the Joanna Briggs Institute and the Prefered Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) checklist.

Results

Twenty-one information needs assessment tools were included. Most tools were either breast cancer (n = 8) or primary tumor nonspecific (n = 8). Patients and informal carers participated in initial identification of questionnaire items in the minority of cases (n = 6) and were more commonly involved in reviewing the final questionnaire before use or formal psychometric testing (n = 9). Most questionnaires were not assessed for validity or reliability using rigorous quantitative psychometric testing.

Significance of results

Existing tools are generally not designed to provide a rigorous assessment of informational needs related to a specific cancer challenge and are limited in how they have been informed by those with lived cancer experience. Tools are needed that both rigirously address information needs for specific cancer challenges and that have been developed in partnership with those who have experienced cancer. Future directions should include understanding barriers and facilitators to developing such tools.

Type
Review Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2023. Published by Cambridge University Press.

Introduction

Information sharing and the cancer journey

Information can be defined as the awareness an individual has of the patterns of reality, including the structures placed upon reality by humans (Dervin et al. Reference Dervin, Zweizig and Hall1977; Freimuth et al. Reference Freimuth, Stein and Kean1989; Rogers and Kincaid Reference Rogers and Kincaid1981). People seek information to reduce the uncertainty they have about the nature of their reality, including how to meet their goals both in the short and long term (Wilson Reference Wilson1997). Uncertainty is an important source of stress, as stress occurs when individuals perceive that the challenges they are facing may exceed the resources they have (Lazarus Reference Lazarus1993; Lazarus and Folkman Reference Lazarus and Folkman1984). In situations of uncertainty, stress may occur for a few reasons including because an individual perceives that they do not have the resources to manage the challenge they are facing, or the situation has used more resources than expected, resulting in fewer resources being available for the other challenges occurring simultaneously in their life. The cancer journey is one where individuals face many new and unfamiliar challenges, often simultaneously (Thiessen et al. Reference Thiessen, Harris and Tang2022). This makes information a key supportive care need because of its ability to decrease uncertainty and support the effective management of personal resources such as time, energy, and finances (Rutten et al. Reference Rutten, Arora and Bakos2005; Thiessen et al. Reference Thiessen, Sinclair and Tang2020).

Health-care providers play an important role in the provision of information for both patients and their care partners. Health-care providers are consistently identified in survey research as one of, if not the most, important informational resources for patients with cancer and their informal caregivers (Chua et al. Reference Chua, Ng and Tan2020, Reference Chua, Tan and Gandhi2018). The information that comes from health-care providers is generally described as high-quality (Thiessen et al. Reference Thiessen, Sinclair and Tang2020), in that it is usually found to be both credible and applicable by the health-care recipients receiving it. However, credibility and applicability alone do not necessarily guarantee the information that health-care providers share will be useful or that it will address all of an individual’s information needs. Accessibility and how the information is framed, in terms of providing hope and empowerment, are also important features of high-quality information that may be lacking from information shared by health-care providers (Thiessen et al. Reference Thiessen, Sinclair and Tang2020). Additionally, the information health-care providers identify as important to share may be affected by the provider’s scope of practice, personal biases, or their potentially limited perceptions of the patient’s and informal caregiver’s informational needs.

Information sharing in cancer care: A critical lens

Critical education theory explores how power and politics in educational settings impact the well-being of individuals and societies (Mellor Reference Mellor2013). Importantly, it provides valuable perspective for understanding the impact of unmet information needs on the lives of those living with cancer. In his work, Paulo Freire, who is considered a foundational figure in the early evolution of critical education theory, explored how the education system in Brazil reinforced classism and propagated poverty for Brazil’s poorest citizens (Elias Reference Elias1975). Freire described that the traditional Brazilian education system viewed students as empty vessels, and it was the educators’ job to deposit the knowledge into the pupils that would ultimately lead to their value in society and as human beings (Freire and Ramos Reference Freire and Ramos2014). This is the banking concept of education – where educators, and the system they operate in, determine what is important for the learners to know, disregarding the challenges the learners are trying to overcome in their own lives and communities. As part of his work to teach literacy, Freire developed the problem-based education approach. This approach involved first engaging with communities to understand the issues that were important to them, and then developing a literacy curriculum that encouraged dialogue around these issues (Freire and Ramos Reference Freire and Ramos2014). Notably, the results that Freire achieved were impressive, with some reports identifying that in 1 community his methods resulted in 300 adults learning to read and write in 45 days (Elias Reference Elias1975).

Freire’s work raises important questions about what is known about the information needs of those living with cancer and whether what is considered to be important by health-care professionals (i.e., normative informational needs) reflects the actual information needs of those living with cancer (i.e., expressed informational needs) (Elias Reference Elias1975). This is not a small issue given the reported prevalence of unmet information needs, cited between 50% and 100% for patients and informal caregivers, in both the curative and non-curative contexts (Christophe et al. Reference Christophe, Anota and Vanlemmens2022; Fletcher et al. Reference Fletcher, Flight and Chapman2017; Halbach et al. Reference Halbach, Ernstmann and Kowalski2016; Matsuyama et al. Reference Matsuyama, Kuhn and Molisani2013; Moghaddam et al. Reference Moghaddam, Coxon and Nabarro2016; Park and Hwang Reference Park and Hwang2012; Puts et al. Reference Puts, Papoutsis and Springall2012; Rutten et al. Reference Rutten, Arora and Bakos2005; Wang et al. Reference Wang, Molassiotis and Chung2018). These high rates of unmet need highlight an urgency for tools that accurately assess informational needs to guide the development and implementation of effective evidence-based informational interventions (Craig et al. Reference Craig, Dieppe and Macintyre2013). Additionally, Freire’s work raises questions about whether existing tools truly assess the informational priorities of those living with cancer.

A gap in the literature and research objectives

Little is known about the tools that exist for assessing information needs in the cancer context, or how those with lived cancer experience participated in their development. While 1 systemic review summarized existing information needs assessment tools, this review was not specific to the cancer context, and did not explore the role of patients and informal caregivers in the tool development process (Christalle et al. Reference Christalle, Zill and Frerichs2019). To characterize the tools that are available for assessing the information needs of those living with cancer, this literature review was undertaken. The scoping review methodology (Arksey and O’Malley Reference Arksey and O’Malley2005; Peters et al. Reference Peters, Godfrey, McInerney, Aromataris and Munn2020) was used for this review, as it provides a rigorous approach to systematically reviewing the literature, and yet provides flexibility in terms of the types of research objectives that can be achieved (Munn et al. Reference Munn, Peters and Stern2018). This is in contrast to systematic reviews (Aromataris and Pearson Reference Aromataris and Pearson2014) which may be better suited for exploring the literature related to a specific clinical question requiring systematic and unbiased review of clinical experimental reports.

This review was guided by the objectives of (a) identifying existing information needs assessment tools developed for the cancer context and (b) summarizing how they were developed, including how patients and informal caregivers influenced the information needs being assessed. The specific research questions that informed data collection and analysis were as follows:

  1. 1. What questionnaires have been created for evaluating the information needs of people living with cancer?

    1. a. What is the stated purpose of each questionnaire?

    2. b. What cancer contexts (i.e., cancer type, treatment intent, and population) have these tools been developed for?

  2. 2. How were the questionnaires developed?

    1. a. How were the questionnaire items initially identified and finalized?

    2. b. How were patients, informal caregivers, and health-care professionals involved in item identification, and finalizing the questionnaires?

    3. c. How were the questionnaires validated?

    4. d. What guided assessments of validity and reliability of the questionnaires?

Methods

Protocol and registration

Before conducting this review, a protocol, including search strategy, was developed based on guidance for scoping reviews from the Joanna Briggs Institute (Peters et al. Reference Peters, Godfrey, McInerney, Aromataris and Munn2020), published in a peer-reviewed journal (Thiessen et al. Reference Thiessen, Harris and Tang2022), and the review was registered (PRR1-10.2196/35639). The PRISMA-ScR reporting checklist is found in Supplement 1.

Eligibility criteria

To be included in this review, papers needed to report on the development or initial testing of questionnaires for assessing the information needs of adult patients with cancer and/or their care partners – at any point after initial diagnosis. Only peer-reviewed articles published in English that were available in full-text were included. Articles reporting on the development or use of questionnaires in the pediatric population and in the cancer screening context were excluded. Articles reporting on multidimensional tools that assessed multiple supportive care need domains, in addition to information needs, were also excluded.

Figure 1. PRISMA flowchart of study selection process.

Information sources

To identify as many relevant articles as possible, articles published at any date up to the date of search initiation (i.e., January 1, 2022) were included. Databases searched included MEDLINE (OVID), EMBASE (OVID), CINAHL, Scopus, Web of Science, the Cochrane Database of Systematic Reviews, and PsycInfo. The search strategy was developed by M.T., with guidance from a health science librarian, based on a preliminary limited search of MEDLINE (OVID) and CINAHL Plus. The search strategy is published with the study protocol (Thiessen et al. Reference Thiessen, Harris and Tang2022).

Selection of sources of evidence

The database search results were exported to COVIDENCE (www.covidence.org) to facilitate article screening and data extraction. After duplicates were removed, initial title and abstract screening was performed by M.T.. Next, full-text versions of the articles were uploaded into COVIDENCE and screened independently by M.T. and D.H. Data extraction was subsequently performed, again independently by M.T. and D.H. All disagreements in terms of screening decisions and data extraction were resolved through discussion. Data extraction used the template previously generated as part of protocol development. As expected, the template evolved from the protocol version (Thiessen et al. Reference Thiessen, Harris and Tang2022) in the initial phases of data extraction to ensure the extracted data was suitable for answering the study questions. The data extraction sheet, in its final form, is reported in Supplement 2.

Synthesis of results

Following completion of data extraction, the extracted data were exported into an excel spreadsheet to facilitate synthesis of results. Tables were then generated summarizing the data relevant for answering each of the guiding research questions.

Results

Forty-eight articles describing the development and use of 21 questionnaires were identified in the literature. The PRISMA flowchart summarizing the article selection process is presented in Fig. 1. Articles were published between 1990 and 2020. Based on country of first author, Canadian teams (n = 7) were responsible for developing the most instruments. Most tools were designed to assess the information needs of patients, not informal caregivers, and were developed to be applicable either specifically in the breast cancer context or were cancer type nonspecific. Table 1 summarizes the countries of article’s first authors reporting on the development of the questionnaires as well as the cancer contexts the questionnaires were developed for.

Table 1. Summary of identified information needs questionnaires

What questionnaires have been created for evaluating the information needs of those living with cancer?

Each questionnaire, including the purpose and cancer context it was developed for, is listed in Table 2. Information needs questionnaires that were either not specific to a type of cancer (n = 8) or were focused on the breast cancer experience (n = 8) were the most common. In terms of non-type-specific questionnaires, 4 were global assessments of information needs as opposed to focusing on any specific aspect of the cancer journey. Of these global assessments, 1 of these was designed specifically to identify the information priorities of patients to guide information sharing. The remaining tools were designed to assess information regarding specific challenges that patients face including related to brain metastases (Papadakos et al. Reference Papadakos, Agarwal and Charow2019), chemotherapy (van Weert et al. Reference van Weert, Jansen and de Bruijn2009), radiotherapy (Halkett and Kristjanson Reference Halkett and Kristjanson2007; Zeguers et al. Reference Zeguers, de Haes and Zandbelt2012), and online information needs (Maddock et al. Reference Maddock, Lewis and Ahmad2011).

Table 2. Summary of information needs measures including reason for development, intended use, cancer context, and country/context of development

NS = not stated, Q.I. = quality improvement.

In terms of breast cancer–specific information questionnaires (n = 8), 4 of these were designed to be used in the curative context, 2 in both the curative and non-curative context, and for the remaining 2 it was not specified which context it should be used in. Two of the measures were designed to assess global information needs of patients while the remaining were designed to assess information needs regarding specific aspects of the breast cancer journey including those related to those arising during the first course of treatment (Galloway et al. Reference Galloway, Graydon and Harrison1997; Graydon et al. Reference Graydon, Galloway and Palmer-Wickham1997), lymphedema (Dorri et al. Reference Dorri, Olfatbakhsh and Asadi2020), radiotherapy (Halkett and Kristjanson Reference Halkett and Kristjanson2007), and surgical options for managing early breast cancer (Ward and Griffin Reference Ward and Griffin1990). Notably, the only 2 questionnaires intended to assess the information needs of informal caregivers identified in this review were developed in the breast cancer context, with one being designed to assess the information needs of husbands whose wives were undergoing breast cancer surgery (Kilpatrick et al. Reference Kilpatrick, Kristjanson and Tataryn1998), and the other assessing the information needs of daughters of patients with breast cancer (Rees and Bath Reference Rees and Bath2000).

Two questionnaires were identified in this review that had been developed to assess the information needs of those living with prostate cancer. These were developed to assess information needs related to treatment decision-making in the curative intent context, including regarding salvage radiotherapy post-prostatectomy. Questionnaires were also designed for patients with gynecological (Papadakos et al. Reference Papadakos, Bussiere-Cote and Abdelmutti2012), hematological (Graydon et al. Reference Graydon, Galloway and Palmer-Wickham1997), and head and neck cancer (Dall’Armi et al. Reference Dall’Armi, Simpson and Forstner2013), with each providing a global assessments of patient’s information needs. Most questionnaires were designed for use outside of the front-line care setting as either research tools (n = 14) or as part of quality of improvement work (n = 2). Notably, 4 instruments were developed with the intention of being able to be incorporated into clinical practice to guide tailoring information to meet the needs of the patient who completed the questionnaire.

How have information needs assessment questionnaires been developed and validated?

A summary of the steps taken for instrument development, as identified in the literature, from item identification to psychometric evaluation is found in Table 3. The development of the information needs assessment questionnaires, before psychometric testing, typically involved 2 steps. First, initial item selection occurred. This process was accomplished using some combination of 6 approaches including (1) adapting items from previously developed questionnaires, (2) creating items based on a review of the literature, (3) obtaining direct input from health-care professionals, and/or (4) patients and/or informal caregivers, and (5) conducting formal qualitative research with patients/informal caregivers, and/or (6) health-care professionals. Adapting previously developed questionnaires was the most common method incorporated (n = 9), followed by using a literature review (n = 7), with 1 questionnaire being developed using both approaches.

Table 3. Item identification, selection, and psychometric evaluation of information needs questionnaires

Qual. = qualitative research, Pt/Cr = patients and/or carers, HPs = health-care professionals, + = quantitative evaluation of psychometric properties, C = content validity assessment, including through review by HPs or Pt/Cr as part of item finalization.

In terms of generating questionnaire items using input from health-care professionals, patients, and informal caregivers, 2 approaches were used. These included either obtaining direct feedback, including through panel discussions, on items that should be included or conducting formal qualitative research to identify information needs. None of the questionnaires were developed using both direct input and formal qualitative research. One questionnaire was developed based on direct input from both patients and health-care professionals (Arraras et al. Reference Arraras, Wright and Greimel2004) and 2 incorporated direct input from health-care professionals. No questionnaires were identified to have initial item selection based on only input from patients or informal caregivers. Initial item selection using qualitative research methods, including interviews and focus groups, were described in the development of 5 questionnaires. This research involved both patients and health-care providers for 1 questionnaire (Halkett et al. Reference Halkett, Kristjanson and Lobb2012). The development of 3 questionnaires involved only patients, and 1 included only informal caregivers (Rees and Bath Reference Rees and Bath2000). Notably, the development of 1 questionnaire involved patients completing an open-ended writing assignment to identify information needs instead of participating in formal interviews or focus groups (Thomas et al. Reference Thomas, Kaminski and Stanton2004). Importantly, the initial item selection of questionnaire items was based on either direct input from patients/informal caregivers or qualitative research involving people with lived cancer experience in 6 of the 21 identified questionnaires.

After initial item selection, the second step generally involved developing a draft of the questionnaire and forwarding it to health-care professionals and/or patients/caregivers for additional feedback regarding clarity of items and the identification of any missing items. Patient and health-care provider feedback was obtained at this stage in 7 cases, health-care professional feedback only was obtained in 3 cases, patient feedback only in 1 case, and informal carer feedback only in 1 case.

Most instruments had undergone some aspects of psychometric testing. It was identified that quantitative testing of psychometric properties such as content validity, internal consistency, and reliability, in addition to an assessment of content validity, had been performed on 12 of the questionnaires. Assessment of content validity, which, at a minimum, included evidence of review of the questionnaire by health-care providers or those with lived cancer experience, was found for 7 of the questionnaires. For 2 questionnaires, no evidence of validity testing was identified in the articles reviewed. Of the questionnaires identified, only the EORTC-INFO25 (Arraras et al. Reference Arraras, Greimel and Sezer2010, Reference Arraras, Wright and Greimel2004) was identified to have had psychometric property testing guided by established guidelines, as the testing was done in accordance with procedures previously established by the EORTC (Sprangers et al. Reference Sprangers, Cull and Bjordal1993).

Discussion

This review identified and described the development of 21 information needs assessments questionnaires developed for patients with cancer and their informal caregivers. The majority of questionnaires were designed to be used in the research setting or quality improvement setting and intended to be applicable to all cancers or specific to the patient population with breast cancer. Very few questionnaires were designed to assess information needs at a specific point in the cancer journey (D’Alimonte et al. Reference D’Alimonte, Hahn and Makhani2011; Feldman-Stewart et al. Reference Feldman-Stewart, Brundage and Hayter2000; Galloway et al. Reference Galloway, Graydon and Harrison1997; Ward and Griffin Reference Ward and Griffin1990), and only 2 were designed to specifically assess the information needs of informal carers (Kilpatrick et al. Reference Kilpatrick, Kristjanson and Tataryn1998; Rees and Bath Reference Rees and Bath2000). Importantly, input from patients and/or health-care professionals was obtained in the minority of cases for initial questionnaire item identification, and in only 12 of the 21 questionnaires as part of finalizing questionnaire items. These findings suggest that existing needs assessment questionnaires may be limited in their ability to accurately assess what is most important to those living with cancer for a number of reasons.

First, very few questionnaires were identified that are suitable for assessing information needs regarding specific cancer challenges (Thiessen et al. Reference Thiessen, Raffin Bouchal and Tang2023). Of the 21 questionnaires, only 7 focused on specific challenges arising during the cancer journey such as curative intent treatment decision-making in prostate cancer (D’Alimonte et al. Reference D’Alimonte, Hahn and Makhani2011; Feldman‐stewart et al. Reference Feldman‐stewart, Brundage and Nickel2001) or lymphedema in the breast cancer context (Dorri et al. Reference Dorri, Olfatbakhsh and Asadi2020). Of these, only 5 were identified to have undergone some form of rigorous psychometric evaluation. The remainder were global assessments designed to assess information needs for multiple informational topics at once. These findings are important because they identify that a number of tools are currently available that may be of utility for studying the information needs of individuals navigating certain cancers (e.g., breast cancer or prostate cancer), or specific aspects of the cancer journey (e.g., lymphedema related to breast cancer). However, they also draw attention to the need for more tools to adequately assess information needs at many points in the cancer journey, especially in the non-breast cancer setting. A better understanding of the barriers to developing and implementing informational needs assessments, including why there is a predominance of breast cancer specific tools and a relative lack of tools for assessing the informational needs of informal caregivers, is important to address in future work.

Second, this review suggests that the expressed information needs of those living with cancer may not necessarily be reflected in existing questionnaires. Initial item selection commonly relied on review of the pre-existing literature, previously developed instruments, and, presumably, the expertise of the research teams. Patients and carers were only identified to be involved in this process in 6 cases (Arraras et al. Reference Arraras, Wright and Greimel2004; Halkett and Kristjanson Reference Halkett and Kristjanson2007; Neumann et al. Reference Neumann, Wirtz and Ernstmann2011; Rees and Bath Reference Rees and Bath2000; Thomas et al. Reference Thomas, Kaminski and Stanton2004; van Weert et al. Reference van Weert, Jansen and de Bruijn2009). More commonly, patients and carers, along with health-care care professionals, were involved at the stage of reviewing a version of the questionnaire that was previously created by the team of researchers developing the questionnaire to help finalize it. In 8 instances, patients or carers were not identified as having been involved in any aspect of questionnaire development.

The expertise of health-care providers and the value of the peer-reviewed literature should not be discounted. However, the risks associated with not including patients and informal caregivers in developing questionnaires that are intended to assess their informational needs are important as discrepancies between what those receiving health care want to know and what those providing it feel is important to share are known to exist (Thiessen et al. Reference Thiessen, Raffin Bouchal and Tang2023). Data collected from these questionnaires may inform research conclusions and ultimately the evolution of clinical practice. Using the lens of Freire’s critical education philosophy (Freire and Ramos Reference Freire and Ramos2014), approaches for developing tools for identifying informational needs that do not rigorously engage with patients and informal caregivers to identify the issues to be addressed risk the promotion of health-care systems that are limited in terms of how they empower the individuals they claim to serve – and the person-centeredness of the care provided. Moving forward, teams developing information needs assessment questionnaires are encouraged to carefully consider not only how to ensure that the items included in their tools authentically reflect the informational needs and priorities of those living with cancer but also how to actively and meaningfully engage those living with illness in the development process (Sinclair et al. Reference Sinclair, Jaggi and Hack2020).

Clinical implications

Routine capturing of patient-reported measures is increasingly becoming a standard in contemporary cancer care (Minvielle et al. Reference Minvielle, Fierobe and Fourcade2023). Given the prevalence of unmet information needs, and the powerful impact that information can have on those living with cancer, it makes sense that incorporation of information needs assessment as part of routine care be a priority, alongside capturing patient reported data related to distress (Ownby Reference Ownby2019), and other aspects of physical and emotional well-being. Routine implementation of tools to capture data related to these concepts is critical for guiding clinical care, including through the identification of service delivery process that are working well, that require revision, and for identifying individual patients that may benefit from individual interventions from health-care providers.

From a health system and front-line clinician perspective, this review is helpful because it characterizes which tools may be helpful to incorporate into clinical practice. In particular, the EORTC-INFO25 (Arraras et al. Reference Arraras, Wright and Greimel2004) was found to be well validated and rigorously developed, including through the involvement of patient partners at early stages of development. Incorporating this tool into routine clinical practice may support front line clinicians by helping to identify patients that will benefit from additional informational support. On a health systems level, aggregate data from such a tool would be helpful for guiding the delivery of routine informational support by aiding in the identification of which patient groups experience the most unmet informational needs.

However, the relative lack of sophisticated tools tailored to identify information needs related to specific challenges occurring during the cancer journey remains problematic. While several tools may be helpful for guiding information delivery related to specific challenges, such as the tool for assessing information needs related to lymphedema by Dorri et al. (Reference Dorri, Olfatbakhsh and Asadi2020), the number of such tools is limited. Until more tools are available for assessing the informational needs related to each of the many challenges individuals face along the cancer journey, including the expressed needs of those with lived cancer experience, clinicians are encouraged to consider that, despite best efforts, many informational needs will go unrecognized and unaddressed in the front-line clinical context. As such, clinicians are encouraged to support patients and informal caregivers in accessing specialized cancer informational resources such as nurse educators and reputable online content (Thiessen et al. Reference Thiessen, Raffin Bouchal and Tang2023). Perhaps most importantly, clinicians are encouraged to work with those in their care to understand how the issues they are navigating in their lives while receiving cancer treatment can be mitigated through information sharing and education, both on an individual and systemic level.

Study limitations

This review was limited to cancer-specific tools with domains directly related to information needs. As a result, tools possibly useful for assessing the information needs of those living with cancer, but not specifically developed for the cancer context, were not included in this review. Researchers and clinicians working to identify measures for assessing the information needs of those living with cancer to use in their work, are encouraged to review previously published literature reviews not specific to the cancer context (Christalle et al. Reference Christalle, Zill and Frerichs2019) that review informational needs tools to identify addition tools to the ones presented here. However, when selecting tools not originally grounded in the cancer context, taking additional steps to validate that the content and constructs assessed are relevant to the cancer population is an important step.

This scoping review sought to specifically characterize the development of informational tools developed specifically for the cancer context. Recent literature reviews (Fletcher et al. Reference Fletcher, Flight and Chapman2017; Rutten et al. Reference Rutten, Arora and Bakos2005) support that many different types of tools and approaches to assess information needs in the cancer context have been used, including information-nonspecific tools and tools developed outside of the cancer context. However, a rigorous review of the development of existing tools used in the cancer context, including those nonspecific to informational needs and those developed outside of the cancer context is not believed to have been performed. This is an important endeavor, as a better understanding of how the information needs of those living with cancer have been characterized in the literature, including how those with lived cancer experience influenced the methods that were used, will likely provide important insights into the strengths and limitations of the current scientific understanding of information needs in the cancer context.

Lastly, this review did not explore how relative involvement of patients and informal caregivers ultimately influenced final item selection. Overall, the process of item selection appeared to progress through the stages of initial item identification, item revision, and then – if conducted – psychometric testing. Theoretically, based on Freire’s educational philosophy (Freire and Ramos Reference Freire and Ramos2014), if patients and informal caregivers are engaged from the early stage of item identification, the items identified included in the final questionnaire will be different than if they are only engaged at the later stages or at all. Formally testing this hypothesis is an important future direction, which may further inform understanding of the importance of involving patients and informal caregivers in questionnaire development. This scoping review, by providing a summary of the development of existing tools, will likely aid in exploring this hypothesis in future work.

Conclusions

The information needs of those living with cancer often go unmet, resulting in negative consequences such as increased anxiety and decrease quality of life (Husson et al. Reference Husson, Mols and van de Poll-franse2011; Mesters et al. Reference Mesters, van den Borne and De Boer2001; Mollaoglu and Erdogan Reference Mollaoglu and Erdogan2014; Thiessen et al. Reference Thiessen, Hack and Pitz2018, Reference Thiessen, Sinclair and Tang2020; Wang et al. Reference Wang, Molassiotis and Chung2018). Tools available for quantitatively assessing whether information needs in the cancer context are being met are limited. While several tools exist for globally assessing information needs, few tools exist for assessing information needs at specific parts of the cancer journey (Dorri et al. Reference Dorri, Olfatbakhsh and Asadi2020; Galloway et al. Reference Galloway, Graydon and Harrison1997; Graydon et al. Reference Graydon, Galloway and Palmer-Wickham1997; Halkett and Kristjanson Reference Halkett and Kristjanson2007; Ward and Griffin Reference Ward and Griffin1990) where targeted informational educational interventions could be developed. Additionally, only a few tools exist for assessing the unique informational needs of informal carers, who are important, often unacknowledged partners in patients’ cancer journey (Kilpatrick et al. Reference Kilpatrick, Kristjanson and Tataryn1998; Rees and Bath Reference Rees and Bath2000). More research is needed develop tools that can be confidently used to assess the information needs of those living with cancer, including to assist with the development of informational interventions (Craig et al. Reference Craig, Dieppe and Macintyre2013). In order to ensure that this work is in line with the priorities and needs of those living with cancer, effective engagement with patients and informal caregivers should be a priority at all stages of measure development (Merker et al. Reference Merker, Hyde and Herbst2022).

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S1478951523001232.

Data availability statement

Raw extracted data can be made available upon reasonable request to the corresponding author.

Acknowledgments

The authors would like to acknowledge Dr. Alix Hayden, health sciences librarian at the University of Calgary for assisting with initial development of the search strategy. Additionally, scholarships awarded to M.T. including the Harry and Laura Jacques Graduate Scholarship, and the University of Calgary Department of Graduate Studies Scholarship, provided financial support for this work.

Author contributions

Conceptualization, M.T. and S.S.; methodology, M.T. and S.S.; data extraction, M.T. and D.H.; data analysis, M.T.; writing-original draft preparation, M.T.; writing-review, S.S., P.T., and S.R.B.; supervision, S.R.B., P.T., and S.S.

Funding

The research received no external funding.

Competing interests

The authors declare no conflict of interest.

References

Arksey, H and O’Malley, L (2005) Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology 8(1), 1932. doi:10.1080/1364557032000119616CrossRefGoogle Scholar
Aromataris, E and Pearson, A (2014) The systematic review: An overview. American Journal of Nursing 114(3), 5358. doi:10.1097/01.NAJ.0000444496.24228.2cCrossRefGoogle ScholarPubMed
Arraras, JI, Greimel, E, Sezer, O, et al. (2010) An international validation study of the EORTC QLQ-INFO25 questionnaire: An instrument to assess the information given to cancer patients. European Journal of Cancer 46(15), 27262738. doi:10.1016/j.ejca.2010.06.118CrossRefGoogle ScholarPubMed
Arraras, JI, Kuljanic-Vlasic, K, Bjordal, K, et al. Group EQoL (2007) EORTC QLQ-INFO26: A questionnaire to assess information given to cancer patients a preliminary analysis in eight countries. Psycho-Oncology 16(3), 249254. doi:10.1002/pon.1047CrossRefGoogle ScholarPubMed
Arraras, JI, Manterola, A, Hernandez, B, et al. (2011) The EORTC information questionnaire, EORTC QLQ-INFO25. Validation study for Spanish patients. Clinical and Translational Oncology 13(6), 401410. doi:10.1007/s12094-011-0674-1CrossRefGoogle ScholarPubMed
Arraras, JI, Wright, S, Greimel, E, et al. Group EQoL (2004) Development of a questionnaire to evaluate the information needs of cancer patients: The EORTC questionnaire. Patient Education and Counseling 54(2), 235241. doi:10.1016/S0738-3991(03)00240-4CrossRefGoogle ScholarPubMed
Asadi-Lari, M, Ahmadi Pishkuhi, M, Almasi-Hashiani, A, et al. (2015) Validation study of the EORTC information questionnaire (EORTC QLQ-INFO25) in Iranian cancer patients. Supportive Care in Cancer 23(7), 18751882. doi:10.1007/s00520-014-2510-yCrossRefGoogle ScholarPubMed
Bilodeau, BA and Degner, LF (1996) Information needs, sources of information, and decisional roles in women with breast cancer. Oncology Nursing Forum 23(4), 691696.Google ScholarPubMed
Christalle, E, Zill, JM, Frerichs, W, et al. (2019) Assessment of patient information needs: A systematic review of measures. PLoS One 14(1), . doi:10.1371/journal.pone.0209165CrossRefGoogle Scholar
Christophe, V, Anota, A, Vanlemmens, L, et al. (2022) Unmet supportive care needs of caregivers according to medical settings of cancer patients: A cross-sectional study. Supportive Care in Cancer 30(11), 94119419. doi:10.1007/s00520-022-07379-7CrossRefGoogle ScholarPubMed
Chua, GP, Ng, QS, Tan, HK, et al. (2020) Caregivers of cancer patients: What are their information-seeking behaviours and resource preferences? ecancermedicalscience 14, . doi:10.3332/ecancer.2020.1068CrossRefGoogle ScholarPubMed
Chua, GP, Tan, HK and Gandhi, M (2018) Information sources and online information seeking behaviours of cancer patients in Singapore. ecancermedicalscience 12, . doi:10.3332/ecancer.2018.880CrossRefGoogle ScholarPubMed
Craig, P, Dieppe, P, Macintyre, S, et al. (2013) Developing and evaluating complex interventions: The new Medical Research Council guidance. International Journal of Nursing Studies 50(5), 587592. doi:10.1016/j.ijnurstu.2012.09.010CrossRefGoogle ScholarPubMed
D’Alimonte, L, Hahn, S, Makhani, L, et al. (2011) The informational needs of prostate cancer patients treated with radical prostatectomy regarding adjuvant or salvage radiotherapy: Determinants of community health pilot project. Journal of Medical Imaging and Radiation Sciences 42(4), 198209. doi:10.1016/j.jmir.2011.08.004CrossRefGoogle ScholarPubMed
Dall’Armi, L, Simpson, GK, Forstner, D, et al. (2013) The information needs of patients with head and neck cancer and their caregivers: A short report of instrument development and testing. Applied Nursing Research 26(1), 4044. doi:10.1016/j.apnr.2012.08.001CrossRefGoogle Scholar
Degner, LF, Kristjanson, LJ, Bowman, D, et al. (1997) Information needs and decisional preferences in women with breast cancer. JAMA: The Journal of the American Medical Association 277(18), 14851492. doi:10.1001/jama.1997.03540420081039CrossRefGoogle ScholarPubMed
Dervin, B, Zweizig, D, Hall, E, et al. (1977) The development of strategies for dealing with the information needs of urban residents: Phase II - Information practitioner study. (Final report on Project No. 475 AH 50014). ED 136791. Office of Libraries and Learning Resources, Office of Education, U.S. Department of Health, Education, and Welfare.Google Scholar
Dorri, S, Olfatbakhsh, A and Asadi, F (2020) Informational needs in patients with breast cancer with lymphedema: Is it important? Breast Cancer: Basic & Clinical Research 14, 17. doi:10.1177/1178223420911033Google ScholarPubMed
Elias, JL (1975) The paulo freire literacy method: A critical evaluation. McGill Journal of Education/Revue Des Sciences de L’éducation de McGill 10(002): 207217.Google Scholar
Feldman‐stewart, D, Brundage, MD, Nickel, JC, et al. (2001) The information required by patients with early‐stage prostate cancer in choosing their treatment. BJU International 87(3), 218223. doi:10.1046/j.1464-410x.2001.02046.xCrossRefGoogle ScholarPubMed
Feldman-Stewart, D, Brundage, MD, Hayter, C, et al. (2000) What questions do patients with curable prostate cancer want answered? Medical Decision Making 20(1), 719. doi:10.1177/0272989X0002000102CrossRefGoogle ScholarPubMed
Fletcher, C, Flight, I, Chapman, J, et al. (2017) The information needs of adult cancer survivors across the cancer continuum: A scoping review. Patient Education and Counseling 100(3), 383410. doi:10.1016/j.pec.2016.10.008CrossRefGoogle ScholarPubMed
Freimuth, VS, Stein, JA and Kean, TJ (1989) Searching for Health Information: the Cancer Information Service Model. Philadelphia: University of Pennsylvania Press.CrossRefGoogle Scholar
Freire, P and Ramos, MB (2014) Pedagogy of the Oppressed: 30th Anniversary Edition. New York: Bloomsbury Publishing.Google Scholar
Galloway, S, Graydon, J, Harrison, D, et al. (1997) Informational needs of women with a recent diagnosis of breast cancer: Development and initial testing of a tool. Journal of Advanced Nursing 25(6), 11751183. doi:10.1046/j.1365-2648.1997.19970251175.xCrossRefGoogle ScholarPubMed
Graydon, J, Galloway, S, Palmer-Wickham, S, et al. (1997) Information needs of women during early treatment for breast cancer. Journal of Advanced Nursing 26(1), 5964. doi:10.1046/j.1365-2648.1997.1997026059.xCrossRefGoogle ScholarPubMed
Halbach, SM, Ernstmann, N, Kowalski, C, et al. (2016) Unmet information needs and limited health literacy in newly diagnosed breast cancer patients over the course of cancer treatment. Patient Education and Counseling 99(9), 15111518. doi:10.1016/j.pec.2016.06.028CrossRefGoogle ScholarPubMed
Halkett, GKB and Kristjanson, LJ (2007) Validity and reliability testing of two instruments to measure breast cancer patients’ concerns and information needs relating to radiation therapy. Radiation Oncology 2(1), . doi:10.1186/1748-717X-2-43CrossRefGoogle ScholarPubMed
Halkett, GK, Kristjanson, LJ, Lobb, E, et al. (2012) Information needs and preferences of women as they proceed through radiotherapy for breast cancer. Patient Education and Counseling 86(3), 396404. doi:10.1016/j.pec.2011.05.010CrossRefGoogle ScholarPubMed
Harrison-Woermke, DE and Graydon, JE (1993) Perceived informational needs of breast cancer patients receiving radiation therapy after excisional biopsy and axillary node dissection. Cancer Nursing 16(6), 449455. doi:10.1097/00002820-199312000-00004CrossRefGoogle ScholarPubMed
Husson, O, Mols, F, van de Poll-franse, L, et al. (2011) The relation between information provision and health-related quality of life, anxiety and depression among cancer survivors: A systematic review. Annals of Oncology 22(4), 761772. doi:10.1093/annonc/mdq413CrossRefGoogle ScholarPubMed
Kilpatrick, MG, Kristjanson, LJ and Tataryn, DJ (1998) Measuring the information needs of husbands of women with breast cancer: Validity and reliability of the Family Inventory of Needs–husbands. Oncology Nursing Forum 25(8), 13471351.Google ScholarPubMed
Kuruppu, DC, Wijeyaratne, CN, Gunawardane, N, et al. (2017) Development and validation of an instrument to measure informational needs of breast cancer patients in Sri Lanka. Ceylon Journal of Medical Science 54(1), 917. doi:10.4038/cjms.v54i1.4821CrossRefGoogle Scholar
Lazarus, RS (1993) Coping theory and research: Past, present, and future. Psychosomatic Medicine 55(3), 234247. doi:10.1097/00006842-199305000-00002CrossRefGoogle ScholarPubMed
Lazarus, RS and Folkman, S (1984) Stress, Appraisal, and Coping. New York: Springer Publishing Company.Google Scholar
Maddock, C, Lewis, I, Ahmad, K, et al. (2011) Online information needs of cancer patients and their organizations. ecancermedicalscience 5, 122. doi:10.3332/ecancer.2011.235Google ScholarPubMed
Matsuyama, RK, Kuhn, LA, Molisani, A, et al. (2013) Cancer patients’ information needs the first nine months after diagnosis. Patient Education and Counseling 90(1), 96102. doi:10.1016/j.pec.2012.09.009CrossRefGoogle ScholarPubMed
Matsuyama, RK, Wilson-Genderson, M, Kuhn, L, et al. (2011) Education level, not health literacy, associated with information needs for patients with cancer. Patient Education and Counseling 85(3), e229e236. doi:10.1016/j.pec.2011.03.022CrossRefGoogle Scholar
Mellor, D (2013) Sociology of Education: an A-to-Z Guide. Thousand Oaks: SAGE Publications, Inc.Google Scholar
Merker, VL, Hyde, JK, Herbst, A, et al. (2022) Evaluating the impacts of patient engagement on health services research teams: Lessons from the veteran consulting network. Journal of General Internal Medicine 37(1), 3341. doi:10.1007/s11606-021-06987-zCrossRefGoogle ScholarPubMed
Mesters, I, van den Borne, B, De Boer, M, et al. (2001) Measuring information needs among cancer patients. Patient Education and Counseling 43(3), 253262. doi:10.1016/s0738-3991(00)00166-xCrossRefGoogle ScholarPubMed
Minvielle, E, Fierobe, A, Fourcade, A, et al. (2023) The use of patient-reported outcome and experience measures for health policy purposes: A scoping review in oncology. Health Policy 129, . doi:10.1016/j.healthpol.2022.12.010CrossRefGoogle ScholarPubMed
Moghaddam, N, Coxon, H, Nabarro, S, et al. (2016) Unmet care needs in people living with advanced cancer: A systematic review. Supportive Care in Cancer 24(8), 36093622. doi:10.1007/s00520-016-3221-3CrossRefGoogle ScholarPubMed
Mollaoglu, M and Erdogan, G (2014) Effect on symptom control of structured information given to patients receiving chemotherapy. European Journal of Oncology Nursing 18(1), 7884. doi:10.1016/j.ejon.2013.07.006CrossRefGoogle ScholarPubMed
Munn, Z, Peters, MDJ, Stern, C, et al. (2018) Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Medical Research Methodology 18(1), . doi:10.1186/s12874-018-0611-xCrossRefGoogle ScholarPubMed
Neumann, M, Wirtz, M, Ernstmann, N, et al. (2011) Identifying and predicting subgroups of information needs among cancer patients: An initial study using latent class analysis. Supportive Care in Cancer 19(8), 11971209. doi:10.1007/s00520-010-0939-1CrossRefGoogle ScholarPubMed
O’Connor, G, Coates, V and O’Neill, S (2010) Exploring the information needs of patients with cancer of the rectum. European Journal of Oncology Nursing 14(4), 271277. doi:10.1016/j.ejon.2010.01.024CrossRefGoogle ScholarPubMed
Ownby, KK (2019) Use of the distress thermometer in clinical practice. Journal of the Advanced Practitioner in Oncology 10(2), 175179. doi:10.6004/jadpro.2019.10.2.7Google ScholarPubMed
Papadakos, J, Agarwal, A, Charow, R, et al. (2019) Informational needs of brain metastases patients and their caregivers. Neuro-Oncology Practice 6(1), 4760. doi:10.1093/nop/npy008CrossRefGoogle ScholarPubMed
Papadakos, J, Bussiere-Cote, S, Abdelmutti, N, et al. (2012) Informational needs of gynecologic cancer survivors. Gynecologic Oncology 124(3), 452457. doi:10.1016/j.ygyno.2011.10.030CrossRefGoogle ScholarPubMed
Park, BW and Hwang, SY (2012) Unmet needs of breast cancer patients relative to survival duration. Yonsei Medical Journal 53(1), 118125. doi:10.3349/ymj.2012.53.1.118CrossRefGoogle ScholarPubMed
Peters, MDJ, Godfrey, C, McInerney, P, et al. (2020) Chapter 11: Scoping reviews. In Aromataris, E and Munn, Z (eds), JBI Manual for Evidence Synthesis. JBI. https://synthesismanual.jbi.global.Google Scholar
Puskulluoglu, M, Tomaszewski, KA, Zygulska, AL, et al. (2014) Pilot testing and preliminary psychometric validation of the polish translation of the EORTC INFO25 Questionnaire Validation of the Polish version of INFO25-pilot study. Applied Research in Quality of Life 9(3), 525535. doi:10.1007/s11482-013-9250-xCrossRefGoogle ScholarPubMed
Puts, MT, Papoutsis, A, Springall, E, et al. (2012) A systematic review of unmet needs of newly diagnosed older cancer patients undergoing active cancer treatment. Supportive Care in Cancer 20(7), 13771394. doi:10.1007/s00520-012-1450-7CrossRefGoogle ScholarPubMed
Rees, CE and Bath, PA (2000) Meeting the information needs of adult daughters of women with early breast cancer - Patients and health care professionals as information providers. Cancer Nursing 23(1), 7179. doi:10.1097/00002820-200002000-00012CrossRefGoogle ScholarPubMed
Rogers, E and Kincaid, D (1981) Communication Networks: toward a New Paradigm for Research. New York, NY: Macmillan Publishing Co.Google Scholar
Rood, JAJ, Lissenberg-Witte, BI, Eeltink, C, et al. (2018) The need for information among patients with hematological malignancies: Psychometric analyses of the 62-item Hematology Information Needs Questionnaire (HINQ-62). PLoS One 13(8), . doi:10.1371/journal.pone.0201699CrossRefGoogle ScholarPubMed
Rutten, LJ, Arora, NK, Bakos, AD, et al. (2005) Information needs and sources of information among cancer patients: A systematic review of research (1980-2003). Patient Education and Counseling 57(3), 250261. doi:10.1016/j.pec.2004.06.006CrossRefGoogle ScholarPubMed
Sinclair, S, Jaggi, P, Hack, TF, et al. (2020) A practical guide for item generation in measure development: Insights from the development of a patient-reported experience measure of compassion. Journal of Nursing Measurement 28, 138156. doi:10.1891/JNM-D-19-00020CrossRefGoogle Scholar
Sprangers, MAG, Cull, A, Bjordal, K, et al. (1993) The European Organization for Research and treatment of cancer approach to quality of life assessment: Guidelines for developing questionnaire modules. Quality of Life Research 2(4), 287295. doi:10.1007/BF00434800CrossRefGoogle ScholarPubMed
Tabchi, S, El Rassy, E, Khazaka, A, et al. (2016) Validation of the EORTC QLQ-INFO 25 questionnaire in Lebanese cancer patients: Is ignorance a bliss? Quality of Life Research 25(6), 15971604. doi:10.1007/s11136-015-1201-6CrossRefGoogle ScholarPubMed
Thiessen, M, Hack, TF, Pitz, M, et al. (2018) A model of identity grounded in the acute season of survivorship. Psycho-Oncology 27(10), 24122418. doi:10.1002/pon.4842CrossRefGoogle Scholar
Thiessen, M, Harris, D, Tang, P, et al. (2022) Examining the development of information needs assessment questionnaires in oncology: Protocol for a scoping review. JMIR Research Protocols 11(9), . doi:10.2196/35639CrossRefGoogle ScholarPubMed
Thiessen, M, Raffin Bouchal, S, Tang, PA, et al. (2023) Navigating the cancer journey using web-based information: Grounded theory emerging from the lived experience of cancer patients and informal caregivers with implications for web-based content design. JMIR Cancer 9, . doi:10.2196/41740CrossRefGoogle ScholarPubMed
Thiessen, M, Sinclair, S, Tang, PA, et al. (2020) Information access and use by patients with cancer and their friends and family: Development of a grounded theory. Journal of Medical Internet Research 22(10), . doi:10.2196/20510CrossRefGoogle ScholarPubMed
Thomas, R, Kaminski, E, Stanton, E, et al. (2004) Measuring information strategies in oncology - developing an information satisfaction questionnaire. European Journal of Cancer Care 13(1), 6570. doi:10.1111/j.1365-2354.2004.00445.xCrossRefGoogle ScholarPubMed
van Weert, J, Jansen, J, de Bruijn, G-J, et al. (2009) QUOTEchemo: A patient-centred instrument to measure quality of communication preceding chemotherapy treatment through the patient’s eyes. European Journal of Cancer 45(17), 29672976. doi:10.1016/j.ejca.2009.06.001CrossRefGoogle ScholarPubMed
Wang, T, Molassiotis, A, Chung, BPM, et al. (2018) Unmet care needs of advanced cancer patients and their informal caregivers: A systematic review. BMC Palliative Care 17(1), . doi:10.1186/s12904-018-0346-9CrossRefGoogle ScholarPubMed
Ward, S and Griffin, J (1990) Developing a test of knowledge of surgical options for breast cancer. Cancer Nursing 13(3), 191196. doi:10.1097/00002820-199006000-00009CrossRefGoogle ScholarPubMed
Wilson, TD (1997) Information behaviour: An interdisciplinary perspective. Information Processing & Management 33(4), 551572. doi:10.1016/S0306-4573(97)00028-9CrossRefGoogle Scholar
Yi, M, Cho, J, Noh, DY, et al. (2007) Informational needs of Korean women with breast cancer: Cross-cultural adaptation of the Toronto informational needs questionnaire of breast cancer. Asian Nursing Research 1(3), 176186. doi:10.1016/S1976-1317(08)60020-1CrossRefGoogle ScholarPubMed
Zaid, YA, Egberongbe, HS and Adekanye, AE (2016) Needs and sources of information for women in the treatment and management of breast cancer in Lagos State, Nigeria. Information Development 32(2), 175185. doi:10.1177/0266666914537286CrossRefGoogle Scholar
Zeguers, M, de Haes, H, Zandbelt, LC, et al. (2012) The information needs of new radiotherapy patients: How to measure? Do they want to know everything? And if not, why? International Journal of Radiation Oncology, Biology, Physics 82(1), 418424. doi:10.1016/j.ijrobp.2010.09.032CrossRefGoogle Scholar
Figure 0

Figure 1. PRISMA flowchart of study selection process.

Figure 1

Table 1. Summary of identified information needs questionnaires

Figure 2

Table 2. Summary of information needs measures including reason for development, intended use, cancer context, and country/context of development

Figure 3

Table 3. Item identification, selection, and psychometric evaluation of information needs questionnaires

Supplementary material: File

Thiessen et al. supplementary material 1
Download undefined(File)
File 509.9 KB
Supplementary material: File

Thiessen et al. supplementary material 2
Download undefined(File)
File 108.5 KB