Hostname: page-component-78c5997874-s2hrs Total loading time: 0 Render date: 2024-10-27T05:06:06.909Z Has data issue: false hasContentIssue false

The development of the Negative Mental Imagery Questionnaire (MIQ-N)

Published online by Cambridge University Press:  18 October 2024

Florentina Ecaterina Oaie
Affiliation:
Northampton NHS Foundation Trust (NFT), Northampton, Northamptonshire, UK
Joanne L. Bower
Affiliation:
University of East Anglia, Norwich, UK
Craig Steel*
Affiliation:
Oxford Health NHS Foundation Trust, Oxford, UK University of Oxford, Oxford, UK
*
Corresponding author: Craig Steel; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background:

Mental imagery plays a key role in the onset and maintenance of psychological disorders, and has become the target of psychological interventions for the treatment of several anxiety-related conditions. However, there are currently no transdiagnostic measures designed to assess the varied dimensions of mental imagery relevant to psychopathology.

Aim:

To develop and validate a new measure assessing the experiences and appraisals of negative mental imagery.

Method:

The initial item pool was generated through a comprehensive literature review and interviews with subject-matter experts. An online community sample provided data for the exploratory (n=345) and confirmatory (n=325) factor analyses.

Results:

The new 16-item Negative Mental Imagery Questionnaire demonstrated four subscales (Intrusiveness, Controllability, Beliefs about Mental Imagery, and Realness). Reliability and validity were good to excellent for both the full- and sub-scales.

Conclusions:

Appraisals of mental imagery captured by the new measure are consistent with previous research on mental imagery and psychopathology.

Type
Main
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of British Association for Behavioural and Cognitive Psychotherapies

Introduction

Mental imagery has been defined as the experience of ‘seeing with the mind’s eye’ or ‘hearing with the mind’s ear’ in the absence of the actual perceptual information (Kosslyn et al., Reference Kosslyn, Ganis, Thompson and Hall2001). Mental imagery can include any sensory modality and enables people to vividly recall past events as well as mentally simulate hypothetical future events (‘flash-forwards’) (Ji et al., Reference Ji, Burnett Heyes, MacLeod and Holmes2016; Laing et al., Reference Laing, Morland and Fornells-Ambrojo2016). The purpose of this internal mental simulation has been argued to be the generation of specific predictions based on past events (Moulton & Kosslyn, Reference Moulton and Kosslyn2009). Advances in cognitive neuroscience and functional imaging have highlighted the shared underlying neural circuity within both perception and mental imagery, which helps us understand how imagery is often described as being experienced ‘as it were real’ (Kosslyn et al., Reference Kosslyn, Ganis, Thompson and Hall2001).

Beck originally described cognitive theory in which cognitions could present in the form of verbal thoughts or mental images (Beck et al., Reference Beck1976). That is, an individual may experience themselves as ‘in danger’ both in the form of the verbal thought ‘I am about to be attacked’ or in the form of an internally generated image of themself in which they are ‘being attacked’. Within this example, the emotional impact of the mental image will be higher than that of the verbal thought (Holmes et al., Reference Holmes, Mathews, Mackintosh and Dalgleish2008b). The impact of the image will also vary depending on characteristics such as vividness, this being via the shared neural circuitry and the more vivid image being experienced as ‘more real’. However, a cognitive approach allows us a wider understanding of the impact of mental imagery. First, as said, the image is a cognition and is imbued with meaning which can be exposed and explored within cognitive therapy. Second, just as metacognitive beliefs about verbal thought contribute to an emotional outcome (Wells, Reference Wells2010), an individual’s beliefs about their mental images are also important to understand. For example, a belief that a current mental image is an accurate prediction of a future event will have significant implications.

Whether a mental image is experienced as either ‘positive’ or ‘negative’ will, therefore, depend on a number of variables. Another important characteristic of mental imagery is an individual’s belief about their control over the experience. This may range from a fully controlled mental simulation to an intrusive image which is experienced as involuntary, unwelcome and distressing. Whilst these emotional intrusive mental images are considered the ‘hallmark’ symptom of post-traumatic stress disorder (Ehlers and Clark, Reference Ehlers and Clark2000), they are also present in the development and maintenance of a wide variety of other mental health problems (Çili and Stopa, Reference Çili and Stopa2015), including social phobia (Hackmann et al., Reference Hackmann, Clark and McManus2000), health anxiety (Muse et al., Reference Muse, McManus, Hackmann, Williams and Williams2010), and obsessive compulsive disorder (Coughtrey et al., Reference Coughtrey, Shafran and Rachman2015). Such experiences overlap with many of the features of a hallucinatory experience within a psychotic presentation. Furthermore, when based on memories, these images may not always be accurate representations of past events (see Çili and Stopa, Reference Çili and Stopa2022). Consequently, intrusive negative mental imagery has been identified as a potential target for psychological interventions (Arntz, Reference Arntz2012; Skottnik and Linden, Reference Skottnik and Linden2019).

Within a cognitive behavioural framework (Harvey et al., Reference Harvey, Watkins and Mansell2004), both content and appraisals of emotional mental imagery have been shown to play key roles in the development and maintenance of distress (Kelly et al., Reference Kelly, Dodd and Mansell2017; Reimer and Moscovitch, Reference Reimer and Moscovitch2015). Psychological interventions have therefore focused on these specific mechanisms. One example of an imagery based psychological intervention is ‘imagery rescripting’, a widely used approach that involves the vivid recall of past events, including trauma and other adverse life experiences, in all modalities and then using a ‘rescript’ of these events to modify their meaning (e.g. Arntz, Reference Arntz2012; Luppino et al., Reference Luppino, Pellegrini, Perdighe, Romano, Saliani and Mancini2020; Ritter and Stangier, Reference Ritter and Stangier2016). This approach has been developed to work with people suffering from trauma reactions who have received varied diagnoses (e.g. Paulik et al., Reference Paulik, Steel and Arntz2019). Interventions have also been developed to target an individual’s beliefs about mental images. People who suffer distress in relation to their images often report that they believe that they are not in control of the experience. If these experiences are not trauma memories, then some basic imagery manipulation exercises can teach people that they can take control of the content of the image, which has a positive impact (Steel et al., Reference Steel, Wright and Goodwin2023). For example, an individual may be troubled by a repetitive image of a future event in which they are attacked. This image can be held in mind, and then manipulated through changing colour, context, wind and rewind, so the person increases their beliefs about their control over the image.

There are numerous imagery measures and tasks available to assess individual differences in mental imagery experiences (for a review, see Pearson et al., Reference Pearson, Deeprose, Wallace-Hadrill, Heyes and Holmes2013). However, clinically relevant measures are limited to specific aspects of emotional mental imagery such as re-experiencing trauma memories in PTSD (e.g. Impact of Events Scale-Revised; Weiss and Marmer, Reference Weiss, Marmar, Wilson and Keane1997) and prospective intrusive imagery (e.g. Impact of Future Events Scale; Deeprose and Holmes, Reference Deeprose and Holmes2010). A semi-structured interview developed by Hackmann and colleagues (Hackmann et al., Reference Hackmann, Clark and McManus2000) has been used to assess the frequency, nature and meaning of recurrent imagery in social anxiety, and subsequently adapted for use in relation to other disorders (Hales et al., Reference Hales, Deeprose, Goodwin and Holmes2011; Holmes et al., Reference Holmes, Crane, Fennell and Williams2007). However, despite the increasing evidence for the role of mental imagery in psychopathology, there are currently no transdiagnostic measures which aim to measure the experience of clinically relevant aspects of mental imagery. Moreover, although measures have been used to assess the appraisals of mental imagery within specific disorders, e.g. depression (Starr and Moulds, Reference Starr and Moulds2006), there are no transdiagnostic measures for this purpose.

Although both negative and positive mental imagery have been shown to drive mood instability in bipolar disorder (Holmes et al., Reference Holmes, Geddes, Colom and Goodwin2008a), and a lack of future positive images is associated with low mood (Morina et al., Reference Morina, Deeprose, Pusowski, Schmid and Holmes2011), it is commonly the presence of negative intrusive images that are thought to maintain symptomatology in other mood and anxiety disorders (Çili and Stopa, Reference Çili and Stopa2015). Therefore, the aim of the present study was to develop a transdiagnostic measure of visual mental imagery that captures negative mental imagery experiences and appraisals commonly experienced within mental health problems, e.g. a belief that imagery is uncontrollable. The measure is based on, and intended to be used within, a cognitive behavioural framework. Although imagery is a multi-modal phenomenon, we have focused on visual images as this is the modality where most clinical and research developments have occurred, and therefore the modality within which a measure is most needed.

Method

Design

The study used a cross-sectional design, with exploratory factor analysis (EFA; sample 1) and confirmatory factor analysis (CFA; sample 2) used to determine the factor structure of the new measure. Convergent and divergent validity was evaluated using correlational analyses, and discriminant validity was established through independent t-tests using data from the combined EFA sample. Finally, a third sample was used to assess test–retest reliability.

Participants

Sample 1: Exploratory factor analysis

The community sample for the EFA was recruited via social media, email circulation to known contacts (not specific groups), and through advertisements placed on research recruitment websites (e.g. Psychological Research on the Net). Participants were required to be aged 18 and above, with no other inclusion or exclusion criteria. No reward was offered in exchange for participation.

The online survey was accessed by 978 participants, of which 676 (69%) completed the consent form, 634 (64.8%) completed the demographic information questions, and 364 (37%) completed all measures. Cases where the response time was less than 10 minutes (n=19) were removed, response times were also screened for excessive time taken (n=0) to ensure that only genuine responses were included. The final sample used for data analyses consisted of n=345 participants, a subject to item ratio of >7:1.

Approximately two-thirds of participants were female (73%), predominantly White (77.4%), and educated to undergraduate (28.1%) and postgraduate level (33.2%). Age ranged from 18 to 74, with more than half of the sample aged between 18 and 34 (64.4%). Further information regarding sample characteristics can be found in Table 1.

Table 1. Sample socio-demographic characteristics

Sample 2: Confirmatory factor analyses

The sample for CFA was recruited via an undergraduate recruitment system (SONA) and word of mouth via social media. Usable data were obtained from 325 individuals (84.6% female) aged 18–54, with 93% of individuals aged between 18 and 24. The sample was predominantly white (81.2%), single (81.8%) and currently in education (83.4%; see Table 1 for full participant characteristics).

Sample 3: Test–retest reliability

Participants were recruited via an undergraduate recruitment system (SONA) for assessment of test–retest reliability. Participants were required to be aged 18 or above, and willing to complete two test sessions, approximately 6 weeks apart (mean=46.1 days, SD=5.3 days). No other inclusion or exclusion criteria were used. The survey was accessed by 167 respondents at Time 1, with usable data obtained from 163 people. Data were removed from three people who withdrew consent, and one person due to extensive missing data. Retention for Time 2 was 60.7%, with 99 participants completing the second survey (M age=20.26, SD age=4.30; 79.8% female; 84.8% British). There were no significant differences in age (t 127.14=1.67, p=.10), gender (χ2(2,N=163)=3.27, p=.19) or nationality (χ2(2,N=163)=2.59, p=.27) between those who completed both assessments and those who did not return for Time 2.

Measures

Measures were selected for the assessment of convergent, divergent and discriminant validity from the limited number of scales available. Divergent validity was assessed using a general mental health measure with discriminant validity assessed using mental health scales related to specific presentations in which distressing mental imagery is prevalent.

Convergent validity

The Spontaneous Use of Imagery Scale (SUIS; Reisberg et al., Reference Reisberg, Pearson and Kosslyn2003)

The SUIS is a 12-item unidimensional self-report measure of spontaneous visual non-emotional mental imagery use in daily life. Rated on a 5-point scale from ‘never appropriate’ to ‘completely appropriate’, the SUIS has good reliability (corrected item-total correlations >.98; Reisberg et al., Reference Reisberg, Pearson and Kosslyn2003) and good internal consistency (α=.83; McCarthy-Jones et al., Reference McCarthy-Jones, Knowles and Rowse2012), also demonstrated in the current sample (α=.84). The total score is obtained by summing the scores for all items, and ranges from 12 to 60, where higher scores suggest more mental imagery use in everyday life (Nelis et al., Reference Nelis, Holmes, Griffith and Raes2014). This measure was chosen within the context of limited transdiagnostic imagery measures being available and it being expected that more frequent imagery experiences overlapping with the aims of the current measure.

Divergent validity

The General Health Questionnaire 12-item version (GHQ-12; Goldberg and Williams, Reference Goldberg and Williams1988)

The GHQ-12 is a widely used and validated screening tool for general mental health problems in primary care settings. The 12 items are rated on a 4-point Likert scale (0–3) and assess the severity of mental health problems for the past month. Total scores on the GHQ-12 range from 0 to 36 and higher scores indicate more severe difficulties. It has demonstrated good reliability, specificity, and internal consistency and high sensitivity (Anjara et al., Reference Anjara, Bonettu, van Bortel and Brayne2020). Cronbach’s alpha in the current sample was excellent (α=.90). This measure was adopted for divergent validity as although there will be some convergence of both measures in relation to general wellbeing, the new imagery measure will be distinct in its target to the level that the convergence should be low.

Discriminant validity

The Obsessive-Compulsive Inventory-Revised (short version, OCI-R; Foa et al., Reference Foa, Huppert, Leiberg, Langner, Kichic and Hajcak2002)

The OCI-R is an 18-item self-report measure for assessing distress associated with obsessive-compulsive disorder (OCD) symptoms. The items are rated on a 5-point scale (0–4) generating a total score, which ranges from 0 to 72, and six subscales (Washing, Obsessing, Hoarding, Ordering, Checking, Neutralising) with scores ranging from 0 to 12. Total scores above 21 are indicative of OCD. The OCI-R has excellent psychometric properties and differentiates well between individuals with and without OCD (Foa et al., Reference Foa, Huppert, Leiberg, Langner, Kichic and Hajcak2002). Cronbach’s alpha in the current sample was excellent (α=.93).

Altman Self-Rating Mania Scale (ASRM; Altman et al., Reference Altman, Hedeker, Peterson and Davis1997)

The ASRM is a 5-item self-report questionnaire assessing the presence and severity of manic and hypomanic symptoms. The scale includes five groups of statements, with associated scores ranging from 0 to 4, asking participants to choose one statement from each group that best describes their experience for the previous week. A total score is obtained by summing items 1–5, with scores of 6 and above suggesting a high probability of mania/hypomania. The scale has shown significant correlations with the Clinician-Administered Rating Scale for Mania and Mania Rating Scale, good sensitivity and specificity (Altman et al., Reference Altman, Hedeker, Peterson and Davis1997), and adequate (α=.73; Kim and Kwon, Reference Kim and Kwon2017) to good internal consistency (α=.90; Skokou et al., Reference Skokou, Asimakopoulou, Andreopoulou, Kolettis, Perrou and Gourzis2021). In the current sample, Cronbach’s alpha was acceptable (α=.65).

Procedure

The development of a version of the measure to be used for data collection included three phases: (i) item generation from the existing literature, (ii) consultation with clinical experts, and (iii) feedback on proposed items from a community sample. All stages were applied to the development of both a positive and negative mental imagery questionnaire. Given the more significant role of negative images in clinical settings, the negative scale is disseminated first.

Phase 1 involved a literature search that identified nine existing measures of mental imagery and relevant thought-related questionnaires (e.g. Impact of Events Scale: Weiss and Marmar, Reference Weiss, Marmar, Wilson and Keane1997; Impact of Future Events Scale: Deeprose and Holmes, Reference Deeprose and Holmes2010). This generated an item pool that could be adapted to capture different aspects of mental imagery. Additional novel items were generated based on published research articles on the role of mental imagery in bipolar disorder and unipolar depression (Hales et al., Reference Hales, Deeprose, Goodwin and Holmes2011), social phobia (Hackmann et al., Reference Hackmann, Clark and McManus2000), PTSD (Clark and Mackay, Reference Clark and Mackay2015), and psychosis (Chadwick and Birchwood, Reference Chadwick and Birchwood1995). The items considered relevant were retained for inclusion and reviewed independently by the second and third authors (J.B. and C.S.).

Phase 2 involved individual semi-structured interviews conducted online and individually with four clinical psychologists with extensive expertise in using imagery-based interventions across a range of disorders. Insights from their experience provided a broad perspective on relevant mental imagery dimensions to consider in developing the current measure. The expert clinicians were also consulted on the item pool regarding item relevance, amendments required, or further additional items to be included.

Interviews were recorded and reviewed noting the key aspects of mental imagery highlighted by clinicians as relevant. Following each interview, clincians were asked to review the intial item pool and feedback on whether the items captured aspects relevant to mental imagery. Clinicians could also make suggestions for further items to be included. To reduce the data, a visual ‘map’ was created looking to identify any relationships between these aspects of mental imagery. This approach was complemented by a further search of the literature to identify potentially relevant additional mental imagery dimensions. To account for potential data interpretation bias and omission of relevant information, the interviews were also reviewed by the second and third authors. Items were added to those developed in Phase 1 to produce a new item pool.

Phase 3 involved consulting a community sample on the appropriateness and clarity of the item pool generated from Phases 1 and 2. Five participants from the general population (two males, three females; age range 34–45) individually provided feedback on the items as part of a cognitive interview (Boateng et al., Reference Boateng, Neilands, Frongillo, Melgar-Quiñonez and Young2018). They were asked to read each item and describe how they interpreted the questions, whether they were easy to read and understand, how they would answer them, and whether they would make any changes to the item phrasing. The suggestions made were reviewed in consultation with the second and third authors.

The version of the measure to be used in data collection and psychometric development included 44 items rated on a 7-point scale from ‘very untrue of me’ to ‘very true of me’.

Survey administration and data collection

Data collection for the EFA and CFA was completed between July and September 2021, using an online survey platform (Qualtrics; https://www.qualtrics.com). To account for order effects, the items within the new measure were randomly presented to participants. The mental imagery measure (MIQ-N) was presented first, followed by the SUIS, GHQ-12, OCI-R and ASRM. All questions were made mandatory to avoid incomplete or missing data.

Data collection for the test–retest reliability assessment was completed between February and April 2023, also using Qualtrics (https://www.qualtrics.com). The final version of the questionnaire was presented along with demographic information (age, gender, nationality), at two time points approximately 6 weeks apart (mean=46.1 days, SD=5.3 days).

Statistical analyses

Statistical analyses for EFA were conducted using the Statistical Package for Social Sciences (SPSS) for Mac version 28. Data were checked for anomalous responses and only cases with complete data were retained for analysis (n=345). The full range of answer options were endorsed across all items.

To account for data non-normality, the EFA was performed using principal axis factoring (PAF) with oblique (promax) rotation, which allows for inter-factor correlations (Costello and Osborne, Reference Costello and Osborne2005). Initial factor extraction was conducted based on Kaiser’s criterion of Eigenvalues >1. The recommended number of factors to be extracted, however, was inconsistent with the scree plot, which suggested a smaller number of factors. Subsequent EFAs, after removing items based on low commonalities, produced a factor solution consistent with the scree plot.

The new measure subscales were constructed by retaining the four highest loading items for each factor and subscale reliability was assessed using Cronbach’s alpha. Normality tests indicated that data were not normally distributed for any of the measures, except for MIQ-N total scale scores. Therefore, Spearman’s rho correlations were conducted to determine the convergent and divergent validity of the new measure. Discriminant validity was established using independent-samples t-tests.

The factor structure of the new measure was evaluated using CFA in a new sample (n=325). All analyses were conducted in RStudio (version 2023.06.0) using the Lavaan package (Rosseel, Reference Rosseel2012). Model fit was assessed using comparative fit index (CFI), root mean square error of approximation (RMSEA) and standardised root mean square residual (RMSR). Good model fit was confirmed if CFI>.95 and SRMSR is below .06 (Hu and Bentler, Reference Hu and Bentler1999), and RMSEA <.06 (Shi et al., Reference Shi, Lee and Maydeu-Olivares2019). Robust values for all measures were interpreted to allow for data non-normality.

Test–retest reliability was evaluated using a third sample (n=99). Intra-class correlation coefficients (ICCs) were used to examine the test–retest consistency for the scale total and each subscale, and a t-test was used to compare mean values of the full-scale at Time 1 and Time 2. ICC values were calculated using SPSS (version 25), based on a mean-rating, absolute agreement, two-way mixed effects model. ICC values between .5 and .75 were considered moderate, between .75 and .9 good, and above .9 excellent test–retest reliability (Koo and Li, Reference Koo and Li2016).

Results

EFA and item reduction

Inter-item correlations ranged from low to moderate and no items correlated at r>.80. The Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy and Bartlett’s test of sphericity suggested that data were appropriate for EFA (KMO=0.934; χ2=9168.02, p<.001). As no items had commonalities above .80 (to suggest singularity), multi-collinearity was addressed by removing items with commonalities <.50 (Field, Reference Field2013). This improved the determinant, suggesting that multi-collinearity was potentially driven by the large number of initial items.

Following removal of items based on commonalities <.50 (n=15), the EFA including the 29 remaining items generated a 5-factor solution based on Eigenvalues >1. Only two items loaded onto factor 5 and were therefore removed, while an additional two were removed as they closely cross-loaded onto factors 1 and 2. A stable model was obtained by specifying a 4-factor solution. Based on the content of the items and mental imagery dimensions being captured, the four factors were named Intrusiveness, Controllability, Beliefs about Mental Imagery, and Realness. Items loadings ranged from .50 to 1.0 (Table 2).

Table 2. EFA factor loadings for Negative Mental Imagery Questionnaire items

Internal consistency

The newly developed Mental Imagery Questionnaire (MIQ-N; 16 items) showed good internal consistency and reliability. Cronbach’s alpha was in the good to excellent range (α=.91) and subscale alphas ranged from .84 to .90 (see Table 2).

Total scores for the measure were obtained by summing the scores for the four subscales. For the Controllability subscale, items were reverse scored prior to computing the total scale score as they were all negatively correlated to the remaining MIQ-N items. A total scale score was used to indicate an overall measure of impact associated with mental imagery that is experienced as vivid, intrusive and uncontrollable.

Means, standard deviations and Spearman’s rho correlation coefficients for the MIQ-N subscales and the SUIS, GHQ-12, OCI-R and ASRM are presented in Table 3. Subscales within the MIQ-N were weakly to moderately inter-correlated and strongly correlated with the total scale score (p<.001).

Table 3. Descriptive statistics and Spearman’s rho correlations between MIQ-N total scores, MIQ-N subscales, SUIS, GHQ-12, OCI-R and ASRM

MIQ-N, Mental Imagery Questionnaire; SUIS, Spontaneous Use of Imagery Scale; GHQ-12, General Health Questionnaire-12; OCI-R, Obsessive Compulsive Inventory-Revised; ASRM, Altman Self-Rating Mania Scale. **p<.01; *p<.05.

Convergent validity

The convergent validity of the new measure was determined by computing Spearman’s rho correlations between the MIQ-N and the SUIS. The results showed weak significant correlations (p<.01) between three of the MIQ-N subscales and the SUIS (Intrusiveness, Beliefs about Mental Imagery, Realness). This indicates poor convergent validity.

Divergent validity

Spearman’s rho correlations showed a weak to moderate positive relationship between MIQ-N subscales and GHQ-12 (ρ<.5, p<.001), indicating adequate divergent validity.

Discriminant validity

To establish whether there were any differences in MIQ-N scores between high and low scorers on GHQ-12, OCI-R and ASRM, the top and bottom quartile for each measure were compared on MIQ-N total scores. Applying this criterion, OCI-R and ASRM top quartile respondents scored within the clinically meaningful range (OCI-R≥24; ASRM≥6). Independent t-tests showed statistically significant mean score differences for MIQ-N between low and high scorers on the OCI-R (t 177=–10.17, p<0.001) and GHQ-12 (t 191=–8.36, p<0.001), but not ASRM (t 177=1.60, p=.06). The results indicate good discriminant validity.

Confirmatory factor analysis

Confirmatory factor analyses were conducted using the Lavaan Package in RStudio (Rosseel, Reference Rosseel2012). Robust maximum likelihood estimations were conducted to account for non-normality within the data. While χ2 was significant (χ2(98)=273.45, p<.001), this is known to be over-sensitive at high sample sizes, thus additional fit models were also considered. Data from the CFI (.96), RMSEA (.06; 90% CI [.05, .07]) and SRMR (.05) all indicated that the 4-factor solution obtained via EFA provided a good model fit for the scale data.

Test–retest reliability

Full scale scores at Time 1 (M=34.18, SD=17.16) and Time 2 (M=32.83, SD=18.13) did not significantly differ (t 98= 1.00, p=.32), and the ICC=.75 (95% CI: .75–.89) indicated good overall test–retest reliability. Subscale ICCs also ranged from moderate (Controllability: ICC=.64, 95% CI: .47–.76) to good (Intrusiveness: ICC=.75, 95% CI: .63–.83; Beliefs: ICC=.78, 95% CI: .67–.85; Realness: ICC=.80, 95% CI: .70–.86).

Discussion

This study has produced a reliable measure for assessing people’s experience and appraisals of past and future oriented visual mental imagery. The measure includes 16 items and contains four factors (Intrusiveness, Controllability, Beliefs about Mental Imagery and Realness). The subscales of the new measure are consistent with the mental imagery domains identified as significant in the development and maintenance of psychopathology, such as vividness/realness and intrusiveness, but also perceived controllability (Cloos et al., Reference Cloos, Di Simplicio, Hammerle and Steil2020). The MIQ-N subscales were moderately correlated with each other and strongly correlated with the total scale score, suggesting clinical utility is most likely to occur when considering the subscale scores, but the total score also represents a meaningful outcome. The divergent validity demonstrated in the current study indicates that distinct mental health problems will ‘map onto’ the MIQ-N subscales in a manner that will inform clinical interventions. For example, some disorders may be closely associated with issues of ‘controllability’ such as generalised anxiety disorder, whereas the ‘realness’ subscale maybe more of a focus during trauma-focused work.

Mental imagery and mental imagery-based interventions for the treatment of psychological disorders have received increasing attention in recent years. Intrusive negative imagery is frequently associated with negative emotions, leading to disorder-specific behavioural responses which can maintain distress (Çili and Stopa, Reference Çili and Stopa2015; Kadriu et al., Reference Kadriu, Claes, Witteman, Norré, Vrieze and Krans2019; Wild et al., Reference Wild, Hackmann and Clark2008). The MIQ-N is a promising new tool for use in imagery research and as part of assessment in clinical settings. Future developments of the measure include reporting on psychometric properties within diagnosed clinical populations. The measure may also be complemented with the development of a tool designed to measure the negative ‘beliefs about self’ often associated with negative mental imagery, such as ‘I am worthless’ or ‘I am disgusting’.

There are some limitations of the current study which have implications for our findings. First, the inclusion of the SUIS as a measure of convergent validity produced low correlations with the MIQ-N total and subscales. The SUIS is a measure of spontaneously occurring or non-emotional voluntary imagery experiences, unlike the MIQ-N which is a broader measure including the involuntary experiences found in clinical groups. This was a known limitation prior to starting the study and reflects the lack of current measures in the field with which a meaningful assessment of convergence can be conducted. However, the use of a measure of emotional imagery would be better suited for accessing convergent validity. Second, although the sampling method provided a sufficiently large sample size for conducting EFA, this had an impact on the demographic composition of the current sample and its representativeness of the general population. Notably, a significant proportion of respondents were White and female. This has implications for the cross-cultural use of the new measures and the applicability of the items to people from different ethnic and cultural backgrounds. Third, the current study did not include people with lived experience of psychological difficulties at the item development stage of the project. While consultation with experts by profession provided a broad range of perspectives, relevant to the transdiagnostic utility of the measure, interviews with experts by experience may have provided additional insights into people’s experience of mental imagery. Furthermore, due to time constraints and limited resources, the qualitative data collected from interviews with clinicians were not analysed using a systematic method of qualitative analysis, e.g. thematic analysis. Although the interview data were reviewed by the three authors independently, not applying a systematic method of qualitative analysis may have introduced bias in the interpretation of the data. Finally, it is noted that the test–retest reliability was lowest for the ‘controllability’ subscale, which may indicate some variance in this concept over relatively short periods of time.

The current study was motivated by the growing interest in mental imagery and the lack of a transdiagnostic clinically relevant mental imagery measure. As such, the MIQ-N was developed and validated to assess experiences and appraisals of negative visual imagery in a community sample. Using an exploratory approach, the factor structure MIQ-N comprised of mental imagery domains is consistent with the literature. Although convergent validity was found to be inadequate in this study, the measure demonstrated good divergent and discriminant validity, and test–retest reliability, and will be a useful measure in future clinical and research practice.

Data availability statement

The data that support the findings of this study are available on request from the corresponding author, C.S.

Acknowledgements

The authors would like to thank Dr Kerry Young, Dr Susie Hales, Dr Helen Close and Dr Zoe Chessell for their insights and feedback on the initial item pool, as well as the participants who contributed their time by taking part in this project.

Author contributions

Florentina Oaie: Conceptualization (equal), Data curation (lead), Formal analysis (lead), Methodology (equal), Project administration (lead), Writing – original draft (equal), Writing – review & editing (equal); Jo Bower: Conceptualization (equal), Formal analysis (equal), Methodology (equal), Project administration (equal), Supervision (equal), Writing – original draft (equal), Writing – review & editing (equal); Craig Steel: Conceptualization (equal), Methodology (equal), Project administration (equal), Supervision (equal), Writing – original draft (equal), Writing – review & editing (equal).

Financial support

This research did not receive any specific grant form any funding agency, commercial or not-for-profit sectors.

Competing interests

C.S. provides training for clinicians that involves the use of imagery based approaches.

Ethical standards

The authors have abided by the Ethical Principles of Psychologists and the Code of Conduct as set out by the BABCP and BPS. Ethical approval for recruiting the community sample for the EFA and CFA was obtained from the Central University Research Ethics Committee, University of Oxford (ethical approval reference number R75759/RE001) and Research Ethics Committee, University of East Anglia. Ethics approval for the test–retest assessment was granted by the Research Ethics Committee, University of East Anglia. Ethical approval included informed consent for the results to be published.

References

Altman, E. G., Hedeker, D., Peterson, J. L., & Davis, J. M. (1997). The Altman Self-Rating Mania Scale. Biological Psychiatry, 42, 948955. https://doi.org/10.1016/S0006-3223(96)00548-3 CrossRefGoogle Scholar
Anjara, S. G., Bonettu, C., van Bortel, T. & Brayne, C. (2020). Using the GHQ-12 to screen for mental health problems among primary care patients: psychometrics and practical considerations. International Journal of Mental Health Systems, 14, 62. https://doi.org/10.1186/s13033-020-00397-0 CrossRefGoogle Scholar
Arntz, A. (2012). Imagery rescripting as a therapeutic technique: review of clinical trials, basic studies, and research agenda. Journal of Experimental Psychopathology, 3, 189208. doi: 10.5127/jep.024211 CrossRefGoogle Scholar
Beck, A. T. (1976). Cognitive Therapy and the Emotional Disorders. New York: International Universities Press.Google Scholar
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: a primer. Frontiers in Public Health, 6, 118. https://doi.org/10.3389/fpubh.2018.00149 CrossRefGoogle Scholar
Chadwick, P., & Birchwood, M. (1995). The omnipotence of voices. II: The Beliefs About Voices Questionnaire (BAVQ). British Journal of Psychiatry, 166, 773776. https://doi.org/10.1192/bjp.166.6.773 CrossRefGoogle Scholar
Çili, S., & Stopa, L. (2015). Intrusive mental imagery in psychological disorders: Is the self the key to understanding maintenance? Frontiers in Psychiatry, 6, 610. https://doi.org/10.3389/fpsyt.2015.00103 CrossRefGoogle Scholar
Çili, S., & Stopa, L. (2022). A taxonomy of intrusive mental images in clinical disorders: what can ‘non-veridical’ images tell us about the nature of human memory? Memory, 30, 6066.CrossRefGoogle Scholar
Clark, I. A., & Mackay, C. E. (2015). Mental imagery and post-traumatic stress disorder: a neuroimaging and experimental psychopathology approach to intrusive memories of trauma. Frontiers in Psychiatry, 6. https://doi.org/10.3389/fpsyt.2015.00104 CrossRefGoogle Scholar
Cloos, M., Di Simplicio, M., Hammerle, F., & Steil, R. (2020). Mental images, entrapment and affect in young adults meeting criteria of nonsuicidal self-injury disorder (NSSID) – a daily diary study. Borderline Personality Disorder and Emotion Dysregulation, 7, 115. https://doi.org/10.1186/s40479-019-0117-0 CrossRefGoogle Scholar
Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Practical Assessment, Research and Evaluation, 10. https://doi.org/10.7275/jyj1-4868 Google Scholar
Coughtrey, A. E., Shafran, R., & Rachman, S. J. (2015). Imagery in mental contamination. Behavioural and Cognitive Psychotherapy, 43, 257269. https://doi.org/10.1017/S1352465813000957 CrossRefGoogle Scholar
Deeprose, C., & Holmes, E. A. (2010). An exploration of prospective imagery: the Impact of Future Events Scale. Behavioural and Cognitive Psychotherapy, 38, 201209. https://doi.org/10.1017/s1352465809990671 CrossRefGoogle Scholar
Ehlers, A., & Clark, D. M. (2000). A cognitive model of posttraumatic stress disorder. Behaviour Research and Therapy, 38, 319345. https://doi.org/10.1016/S0005-7967(99)00123-0 CrossRefGoogle Scholar
Field, A. (2013). Discovering Statistics Using IBM SPSS Statistics, 4th Edition. Los Angeles, London, New Delhi: Sage Publications.Google Scholar
Foa, E.B., Huppert, J.D., Leiberg, S., Langner, R., Kichic, R., Hajcak, G., et al. (2002). The Obsessive-Compulsive Inventory: development and validation of a short version. Psychological Assessment, 14, 485496.CrossRefGoogle Scholar
Goldberg, D., & Williams, P. (1988). A User’s Guide to the General Health Questionnaire. Windsor, UK: NFER-Nelson Google Scholar
Hackmann, A., Clark, D. M., & McManus, F. (2000). Recurrent images and early memories in social phobia. Behaviour Research and Therapy, 38, 601610. https://doi.org/10.1016/S0005-7967(99)00161-8 CrossRefGoogle Scholar
Hales, S. A., Deeprose, C., Goodwin, G. M., & Holmes, E. A. (2011). Cognitions in bipolar affective disorder and unipolar depression: imagining suicide. Bipolar Disorders, 13, 651661. https://doi.org/10.1111/j.1399-5618.2011.00954.x CrossRefGoogle Scholar
Harvey, A. G., Watkins, E., & Mansell, W. (2004). Cognitive Behavioural Processes Across Psychological Disorders: A Transdiagnostic Approach to Research and Treatment. Oxford University Press, USA.CrossRefGoogle Scholar
Holmes, E. A., Crane, C., Fennell, M. J. V., & Williams, J. M. G. (2007). Imagery about suicide in depression – ‘Flash-forwards’? Journal of Behavior Therapy and Experimental Psychiatry, 38, 423434. https://doi.org/10.1016/j.jbtep.2007.10.004 CrossRefGoogle Scholar
Holmes, E. A., Geddes, J. R., Colom, F., & Goodwin, G. M. (2008a). Mental imagery as an emotional amplifier: application to bipolar disorder. Behaviour Research and Therapy, 46, 12511258. https://doi.org/10.1016/j.brat.2008.09.005 CrossRefGoogle Scholar
Holmes, E. A., Mathews, A., Mackintosh, B., & Dalgleish, T. (2008b). The causal effect of mental imagery on emotion assessed using picture-word cues. Emotion, 8, 395409.CrossRefGoogle Scholar
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling, 6, 155. https://doi.org/10.1080/10705519909540118 CrossRefGoogle Scholar
Ji, J. L., Burnett Heyes, S. B., MacLeod, C., & Holmes, E. A. (2016). Emotional Mental imagery as simulation of reality: Fear and Beyond – A Tribute to Peter Lang. Behavior Therapy, 47, 702719. https://doi.org/10.1016/j.beth.2015.11.004 CrossRefGoogle Scholar
Kadriu, F., Claes, L., Witteman, C., Norré, J., Vrieze, E., & Krans, J. (2019). Characteristics and content of intrusive images in patients with eating disorders. European Eating Disorders Review, 27, 495506. https://doi.org/10.1002/erv.2671 CrossRefGoogle Scholar
Kelly, R. E., Dodd, A. L., & Mansell, W. (2017). ‘When my moods drive upward there is nothing I can do about it’: a review of extreme appraisals of internal states and the bipolar spectrum. Frontiers in Psychology, 8, 116. https://doi.org/10.3389/fpsyg.2017.01235 CrossRefGoogle Scholar
Kim, B. N., & Kwon, S. M. (2017). Initial psychometric properties of the Korean Altman Self-Rating Mania Scale: preliminary validation study in a non-clinical sample. Psychiatry Investigation, 14, 562567. https://doi.org/10.4306/pi.2017.14.5.562 CrossRefGoogle Scholar
Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15, 155163.CrossRefGoogle Scholar
Kosslyn, S. M., Ganis, G., Thompson, W. L., & Hall, W. J. (2001). Neural foundations Of imagery. Nature Reviews Neuroscience, 2, 635642. http://web.b.ebscohost.com.ez.sun.ac.za/ehost/pdfviewer/pdfviewer?vid=1&sid=ef7c6e6d-6132-4348-8a0d-c1d160dbd6a7%40sessionmgr102 CrossRefGoogle Scholar
Laing, J., Morland, T., & Fornells-Ambrojo, M. (2016). The phenomenology and generation of positive mental imagery in early psychosis. Clinical Psychology and Psychotherapy, 23, 523532. https://doi.org/10.1002/cpp.1976 CrossRefGoogle Scholar
Luppino, O. I., Pellegrini, V., Perdighe, C., Romano, G., Saliani, A. M., & Mancini, F. (2020). Imagery rescripting on guilt-inducing memories in OCD: a single case series study. Frontiers in Psychiatry, 11, 543806.Google Scholar
McCarthy-Jones, S., Knowles, R., & Rowse, G. (2012). More than words? Hypomanic personality traits, visual imagery and verbal thought in young adults. Consciousness and Cognition, 21, 13751381. https://doi.org/10.1016/j.concog.2012.07.004 CrossRefGoogle Scholar
Morina, N., Deeprose, C., Pusowski, C., Schmid, M., & Holmes, E. A. (2011). Prospective mental imagery in patients with major depressive disorder or anxiety disorders. Journal of Anxiety Disorders, 25, 10321037.CrossRefGoogle Scholar
Moulton, S. T., & Kosslyn, S. M. (2009). Imagining predictions: mental imagery as mental emulation. Philosophical Transactions of the Royal Society of London Series B Biological Sciences, 364, 1273–80.CrossRefGoogle Scholar
Muse, K., McManus, F., Hackmann, A., Williams, M., & Williams, M. (2010). Intrusive imagery in severe health anxiety: prevalence, nature and links with memories and maintenance cycles. Behaviour Research and Therapy, 48, 792798. https://doi.org/10.1016/j.brat.2010.05.008 CrossRefGoogle Scholar
Nelis, S., Holmes, E. A., Griffith, J. W., & Raes, F. (2014). Mental imagery during daily life: psychometric evaluation of the Spontaneous Use of Imagery Scale (SUIS). Psychologica Belgica, 54, 1932. https://doi.org/10.5334/pb.ag CrossRefGoogle Scholar
Paulik, G., Steel, C., & Arntz, A. (2019). Imagery rescripting for the treatment of trauma in voice hearers: a case series. Behavioural and Cognitive Psychotherapy, 47, 709725. https://doi.org/10.1017/S1352465819000237 CrossRefGoogle Scholar
Pearson, D. G., Deeprose, C., Wallace-Hadrill, S. M. A., Heyes, S. B., & Holmes, E. A. (2013). Assessing mental imagery in clinical psychology: a review of imagery measures and a guiding framework. Clinical Psychology Review, 33, 123. https://doi.org/10.1016/j.cpr.2012.09.001 CrossRefGoogle Scholar
Reimer, S. G., & Moscovitch, D. A. (2015). The impact of imagery rescripting on memory appraisals and core beliefs in social anxiety disorder. Behaviour Research and Therapy, 75, 4859. https://doi.org/10.1016/j.brat.2015.10.007 CrossRefGoogle Scholar
Reisberg, D., Pearson, D. G., & Kosslyn, S. M. (2003). Intuitions and introspections about imagery: the role of imagery experience in shaping an investigator’s theoretical views. Applied Cognitive Psychology, 17, 147160. https://doi.org/10.1002/acp.858 CrossRefGoogle Scholar
Ritter, V., & Stangier, U. (2016). Seeing in the mind’s eye: imagery rescripting for patients with body dysmorphic disorder. A single case series. Journal of Behavior Therapy and Experimental Psychiatry, 50, 187e195.CrossRefGoogle Scholar
Rosseel, Y. (2012). lavaan: an R package for structural equation modeling. Journal of Statistical Software, 48, 136. https://doi:10.18637/jss.v048.i02.CrossRefGoogle Scholar
Shi, D., Lee, T., & Maydeu-Olivares, A. (2019). Understanding the model size ef fect on SEM fit indices. Educational and Psychological Measurement, 79, 310334. https://doi.org/10.1177/0013164418783530 CrossRefGoogle Scholar
Skokou, M., Asimakopoulou, R., Andreopoulou, O., Kolettis, G., Perrou, S., Gourzis, P., et al. (2021). Reliability, validity and psychometric properties of the Greek version of the Altman Self Rating Mania Scale. Comprehensive Psychiatry, 109, 152243. https://doi.org/10.1016/j.comppsych.2021.152243 CrossRefGoogle Scholar
Skottnik, L., & Linden, D. E. J. (2019). Mental imagery and brain regulation – new links between psychotherapy and neuroscience. Frontiers in Psychiatry, 10, 114. https://doi.org/10.3389/fpsyt.2019.00779 CrossRefGoogle Scholar
Starr, S., & Moulds, M. L. (2006). The role of negative interpretations of intrusive memories in depression. Journal of Affective Disorders, 93, 125132. https://doi.org/10.1016/j.jad.2006.03.001 CrossRefGoogle Scholar
Steel, C., Wright, K., Goodwin, G.M. et al. (2023). The IBER study: a feasibility randomised controlled trial of imagery based emotion regulation for the treatment of anxiety in bipolar disorder. International Journal of Bipolar Disorders, 11, 27. https://doi.org/10.1186/s40345-023-00305-8.CrossRefGoogle Scholar
Weiss, D. S., & Marmar, C. R. (1997). The Impact of Event Scale-Revised. In Wilson, J.P. , & Keane, T.M. (eds), Assessing Psychological Trauma and PTSD: A Practitioner’s Handbook (pp. 399411). New York: Guilford Press.Google Scholar
Wells, A. (2010). Metacognitive theory and therapy for worry and generalized anxiety disorder: review and status. Journal of Experimental Psychopathology, 1, 133145.CrossRefGoogle Scholar
Wild, J., Hackmann, A., & Clark, D. M. (2008). Rescripting early memories linked to negative images in social phobia: a pilot study. Behavior Therapy, 39, 4756. https://doi.org/10.1016/j.beth.2007.04.003 CrossRefGoogle Scholar
Figure 0

Table 1. Sample socio-demographic characteristics

Figure 1

Table 2. EFA factor loadings for Negative Mental Imagery Questionnaire items

Figure 2

Table 3. Descriptive statistics and Spearman’s rho correlations between MIQ-N total scores, MIQ-N subscales, SUIS, GHQ-12, OCI-R and ASRM

Submit a response

Comments

No Comments have been published for this article.