Hostname: page-component-55f67697df-gmt7q Total loading time: 0 Render date: 2025-05-12T03:52:58.292Z Has data issue: false hasContentIssue false

Smartphone-based text obtained via passive sensing as it relates to direct suicide risk assessment

Published online by Cambridge University Press:  09 May 2025

Brooke A. Ammerman*
Affiliation:
Department of Psychology, University of Wisconsin–Madison, Madison, WI, USA
Evan M. Kleiman
Affiliation:
Department of Psychology, Rutgers University, Piscataway, NJ, USA
Connor O’Brien
Affiliation:
Department of Psychology, University of Wisconsin–Madison, Madison, WI, USA
Anne C. Knorr
Affiliation:
Department of Psychology, University of Notre Dame, Notre Dame, IN, USA
Kerri-Anne Bell
Affiliation:
Department of Psychology, University of Notre Dame, Notre Dame, IN, USA
Nilám Ram
Affiliation:
Departments of Psychology and Communications, Stanford University, Stanford, CA, USA
Thomas N. Robinson
Affiliation:
Departments of Pediatrics, Medicine, and Epidemiology and Population Health, Stanford University, Stanford, CA, USA
Bryon Reeves
Affiliation:
Department of Communications, Stanford University, Stanford, CA, USA
Ross Jacobucci
Affiliation:
Center for Healthy Minds, University of Wisconsin–Madison, Madison, WI, USA
*
Corresponding author: Brooke A. Ammerman; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

Recent research highlights the dynamics of suicide risk, resulting in a shift toward real-time methodologies, such as ecological momentary assessment (EMA), to improve suicide risk identification. However, EMA’s reliance on active self-reporting introduces challenges, including participant burden and reduced response rates during crises. This study explores the potential of Screenomics—a passive digital phenotyping method that captures intensive, real-time smartphone screenshots—to detect suicide risk through text-based analysis.

Method

Seventy-nine participants with past-month suicidal ideation or behavior completed daily EMA prompts and provided smartphone data over 28 days, resulting in approximately 7.5 million screenshots. Text from screenshots was analyzed using a validated dictionary encompassing suicide-related and general risk language.

Results

Results indicated significant associations between passive and active suicidal ideation and suicide planning with specific language patterns. Detection of words related to suicidal thoughts and general risk-related words strongly correlated with self-reported suicide risk, with distinct between- and within-person effects highlighting the dynamic nature of suicide risk factors.

Conclusions

This study demonstrates the feasibility of leveraging smartphone text data for real-time suicide risk detection, offering a scalable, low-burden alternative to traditional methods. Findings suggest that dynamic, individualized monitoring via passive data collection could enhance suicide prevention efforts by enabling timely, tailored interventions. Future research should refine language models and explore diverse populations to extend the generalizability of this innovative approach.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2025. Published by Cambridge University Press

Introduction

Suicidal behaviors are associated with an economic burden upwards of $90 billion per year (Shepard et al., Reference Shepard, Gurewich, Lwin, Reed and Silverman2016), significant personal and emotional costs (Andriessen et al., Reference Andriessen, Rahman, Draper, Dudley and Mitchell2017), and extensive resources dedicated to prevention efforts (National Institute of Health, 2018). In attempts to improve suicide risk identification, prediction, and intervention, researchers have shifted to identifying short windows of heightened suicide risk. Supporting this transition, technological advances have increased the accessibility of intensive time sampling methodologies, like ecological momentary assessment (EMA), aiding our understanding of suicide risk dynamics. Most notable is knowledge regarding the fluctuating nature of suicidal ideation (SI; Czyz, Horwitz, Arango, & King, Reference Czyz, Horwitz, Arango and King2019; Hallensleben et al., Reference Hallensleben, Spangenberg, Forkmann, Rath, Hegerl, Kersting and Glaesmer2018; Kleiman et al., Reference Kleiman, Turner, Fedor, Beale, Huffman and Nock2017), one of the top risk factors for future suicidal behavior. However, limitations of an active assessment approach to intensive time sampling (e.g., EMA; daily diary) have hindered reliable, real-time detection of suicide risk, a necessary step in momentary suicide risk intervention (i.e., Torous et al., Reference Torous, Larsen, Depp, Cosco, Barnett, Nock and Firth2018).

Sole reliance on active assessment methodologies to inform suicide risk identification presents several challenges. Foremost, this approach depends on individuals’ willingness and availability to provide self-reports of their experience(s) multiple times per day, resulting in a high burden that is not sustainable for extended periods (Ammerman & Law, Reference Ammerman and Law2022). Preliminary work also suggests that individuals may be less likely to respond to active assessments during times of suicidal crisis (Jacobucci, Ammerman, & Ram, Reference Jacobucci, Ammerman and Ram2024), potentially resulting in missed opportunities for risk detection and intervention. To balance such burden, many EMA studies restrict their temporal granularity, delivering EMA prompts every 3–4 hours (Ammerman & Law, Reference Ammerman and Law2022). Yet, the escalation of suicide risk can transpire in a matter of minutes (Deisenhammer et al., Reference Deisenhammer, Ing, Strauss, Kemmler, Hinterhuber and Weiss2009; Millner, Lee, & Nock, Reference Millner, Lee and Nock2017), requiring more temporally intensive, low-burden designs for risk identification and ultimate intervention.

Digital phenotyping is a promising avenue to improve real-time suicide risk detection (Onnela & Rauch, Reference Onnela and Rauch2016). Digital phenotyping has seen an increase in application across clinical research broadly, with the term being previously applied to suicide risk profiles based on active assessments (i.e., EMA) (Kleiman et al., Reference Kleiman, Turner, Fedor, Beale, Picard, Huffman and Nock2018). However, little research has specifically targeted passive assessment approaches to suicide risk detection; existing work has largely centered on passively collected psychophysiological responses (i.e., heart rate, electrodermal activity, daily steps; Czyz et al., Reference Czyz, King, Al-Dajani, Zimmermann, Hong and Nahum-Shani2023; Horwitz et al., Reference Horwitz, Czyz, Al-Dajani, Dempsey, Zhao, Nahum-Shani and Sen2022; Kleiman et al., Reference Kleiman, Turner, Fedor, Beale, Picard, Huffman and Nock2018). An alternative approach is a novel form of digital phenotyping called Screenomics (Ram et al., Reference Ram, Yang, Cho, Brinberg, Muirhead, Reeves and Robinson2020; Reeves et al., Reference Reeves, Ram, Robinson, Cummings, Giles, Pan and Gagneja2019; Reeves, Robinson, & Ram, Reference Reeves, Robinson and Ram2020). Screenomics leverages the ubiquitous nature of smartphones by unobtrusively capturing screenshots from participants’ smartphones at an intensive rate (e.g., 5-second intervals during active phone use), resulting in comprehensive smartphone-based data streams (e.g., text extracted from screenshots) that does not require participant action. This low-burden, high-granularity data may demonstrate associations with actively assessed suicide risk.

While several elements may be extracted from screenshots (Ram et al., Reference Ram, Yang, Cho, Brinberg, Muirhead, Reeves and Robinson2020; Reeves et al., Reference Reeves, Ram, Robinson, Cummings, Giles, Pan and Gagneja2019; Reeves et al., Reference Reeves, Robinson and Ram2020), the use of text data has seen a recent rise in the field of suicide. Given high measurement reliability (Jodoin, Reference Jodoin2003), the increasing prevalence of text-based communication, and the use of smartphones for numerous daily activities (i.e., reading, information gathering), text is a promising tool for suicidal risk detection. In prior research, various forms of social media postings (e.g., Facebook, Twitter) have been used to identify patterns in text (i.e., language content) to successfully classify those at high suicide risk (Bryan et al., Reference Bryan, Butner, Sinclair, Bryan, Hesse and Rose2018; Coppersmith, Leary, Crutchley, & Fine, Reference Coppersmith, Leary, Crutchley and Fine2018; Du et al., Reference Du, Zhang, Luo, Jia, Wei, Tao and Xu2018; Guan et al., Reference Guan, Hao, Cheng, Yip and Zhu2015). Downloaded text messages have also been used to retrospectively identify specific emotional content and stressors leading up to suicidal thoughts and behaviors (Glenn, Nobles, Barnes, & Teachman, Reference Glenn, Nobles, Barnes and Teachman2020). Such prior work has underscored the potential of text-based communication in understanding suicide risk; however, to our knowledge, there has yet to be a comprehensive assessment of text-based information obtained from smartphones (i.e., across platforms; e.g., text messages, social media, web browsing), which may offer a more holistic view of suicide risk.

Current study

The current study employs Screenomics – intensive, real-time data captured from participants’ smartphones, including text-based content across all platforms and applications that an individual uses – to explore a less intrusive, lower-burden method for assessing suicide risk. With growing interest in just-in-time interventions for suicide prevention (e.g., Coppersmith et al., Reference Coppersmith, Dempsey, Kleiman, Bentley, Murphy and Nock2022), which necessitate continuous, long-term monitoring, this study evaluates whether text data from smartphones may be related to self-reported suicide risk indicators, ultimately serving as a signal of suicide risk. Specifically, using a previously validated dictionary that includes words indicative of a crisis (Swaminathan et al., Reference Swaminathan, López, Mar, Heist, McClintock, Caoili and Nock2023), we aim to identify language patterns linked to real-time reports of passive and active SI, as well as suicidal planning. By introducing a scalable, innovative approach to suicide risk monitoring, this study has the potential to lay the groundwork for more timely and effective interventions.

Method

Participants

Participants were 79 individuals who reported past-month active SI or suicidal behaviors and owned an Android-based smartphone (required for the smartphone application). Participants were recruited via social media advertisements and community flyers from a mid-sized city in the Midwest. Participants ranged in age from 20–63 years (M = 35.15, SD = 11.07); 68.3% were female; 84.8% identified as white, 6.3% as Black, 6.3% as American Indian/Alaska Native, and 2.6% as another race; and 92.4% identified as non-Hispanic/Latino. Most participants (93.7%) had engaged in individual therapy or counseling in their lifetime. Regarding baseline diagnostic assessment of current clinical presentation, 83.8% of the sample met diagnostic criteria for at least one psychiatric disorder, and 64.9% met current diagnostic criteria for two or more disorders (M = 2.55, SD = 1.86). (Individuals with and without comorbid diagnoses were compared regarding the sum of dictionary-identified words across the course of the study. The sleep dictionary showed a significant difference between groups (t(53.08) = −2.72, p = .009), with comorbid participants (M = 73.49) exhibiting more than twice the sleep-related content compared to noncomorbid participants (M = 32.50). All other dictionaries showed no statistically significant differences between the two groups.) More specifically, 43.0% met diagnostic criteria for major depressive disorder, 34.2% for generalized anxiety disorder, 40.5% for panic disorder, 25.3% for social anxiety disorder, 32.9% for post-traumatic stress disorder, 22.8% for alcohol use disorder, and 25.3% for substance use disorder. Considering suicide risk history, 39.2% reported past week SI; 72.2% had a lifetime history of a suicide plan (38% in the past year, 15.1% in the past month); and 64.5% had a lifetime history of a suicide attempt (12.7% in the past year, 2.5% in the past month).

Procedures

Participants completed an in-laboratory assessment consisting of a diagnostic interview (MINI; Sheehan et al., Reference Sheehan, Janavs, Baker, Harnett-Sheehan, Knapp and Sheehan1998), an interview of suicide risk history (i.e., Self-Injurious Thoughts and Behaviors Interview; Nock, Holmberg, Photos, & Michel, Reference Nock, Holmberg, Photos and Michel2007), and an orientation to the out-of-lab procedures. The out-of-lab protocol included 28 days of EMA and screenshot capture. All participants who reported any SI via EMA during the out-of-lab protocol received an automated prompt with crisis resources; if participants reported elevated active SI (i.e., ≥ 4 on 5-point scale), a study team member reached out to conduct a comprehensive risk assessment. The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. All study procedures were approved by the Institutional Review Board at the data collection site.

Ecological Momentary Assessment. Participants received six signal-contingent EMA prompts per day (i.e., randomized within 2-hour windows across a 12-hour block) via the LifeData app, each taking 3–4 minutes to complete. Each prompt had to be completed within 30 minutes. Participants received momentary compensation and were incentivized to complete 75% of daily surveys. Responses indicating moderate levels of SI prompted a reminder of crisis resources, whereas responses indicating potentially imminent risk triggered an email to the research team, resulting in a comprehensive suicide risk assessment conducted via phone. This sample had an overall EMA response rate of 68.8%.

Screenshot Capture. Screenshots were collected from participants’ smartphones via the Screenlife Capture application (Yee et al., Reference Yee, Yu, Lim, Lim, Dinh, Loh and Quizon2023). Participants downloaded this application on their phones, which captures screenshots at 5-second intervals when the smartphone is in use, stores them on the local device, and then encrypts and securely transmits bundles of screenshots to research servers. Data were stored on secure, HIPPA-compliant servers internal to the first author’s institution. Participants deleted the Screenlife Capture application and all locally stored data at the end of the study period. The text data from each screenshot was then extracted for analysis (see Data Analysis section).

Measures

Suicidal ideation. Four questions assessed momentary (i.e., ‘At this moment…’) passive SI (i.e., ‘Life is not worth living for me’; ‘There are more reasons to die than to live for me’) and active SI (i.e., ‘I think about taking my life’; ‘I want to die’), which have been previously validated (Forkmann et al., Reference Forkmann, Spangenberg, Rath, Hallensleben, Hegerl, Kersting and Glaesmer2018). These items were answered on a 5-point Likert scale and summed to create passive SI and active SI composite scores.

Suicidal planning. Three questions assessed suicidal planning (i.e., ‘Considered a specific suicide method’; ‘Identified how to acquire your suicide method’; ‘Made other preparation for your death [e.g., wrote a suicide note, made arrangements]’) occurring over the EMA prompt interval (i.e., ‘Since the last prompt…’). These three items were adapted from the Beck Suicide Scale (Beck, Kovacs, & Weissman, Reference Beck, Kovacs and Weissman1979) and were answered on a 5-point Likert scale. All were summed to create a suicidal planning composite score.

Data analysis

Data Processing. EasyOCR (Jaided, Reference Jaided2024), a deep learning-based optical character recognition system, was applied to each screenshot to extract text content. The Python implementation of EasyOCR uses a combination of text detection and recognition models to identify and transcribe text regions from images. During the manual inspection, we observed that text blocks with lower OCR confidence scores often contained inserted special characters rather than complete misreadings, making dictionary matching possible regardless of confidence thresholds. Therefore, we chose not to exclude any text blocks based on EasyOCR confidence scores.

Initial data analysis revealed that the mean smartphone use ‘session’ – which we defined as continuous use without breaks (i.e., no phone use) exceeding 30 seconds – lasted approximately 11 minutes (specifically, 696.73 seconds; 95% CI: 518.49, 874.96). Based on this, we analyzed screenshots in 10-minute intervals, combining dictionary counts for each 10-minute window before a given EMA assessment (extending back to the previous EMA prompt). For missed EMA prompts, we maintained the original time variables since these were used to model EMA response patterns (see below) while applying listwise deletion for missing outcomes in the remaining multilevel models. To maintain focus on proximal associations, we excluded rows where the time between screenshot collection and EMA responses exceeded 3 hours; this decision was made based on the average time between EMA prompts (i.e., 3.4 hours), resulting in primarily exclusion of screenshots leading up to a missed EMA prompt and those from the night/morning.

Dictionary-Based Method. A dictionary-based approach was selected over data-driven approaches to enhance the interpretability of findings. We applied a previously developed and validated dictionary, originally designed to support triaging crisis messages in real-time, based on chat data from a crisis line (Swaminathan et al., Reference Swaminathan, López, Mar, Heist, McClintock, Caoili and Nock2023). The system, which consists of 276 words, previously demonstrated high sensitivity (0.98) and positive predictive value (0.66), effectively distinguishing crisis-related from noncrisis content within telehealth settings (Swaminathan et al., Reference Swaminathan, López, Mar, Heist, McClintock, Caoili and Nock2023). To increase the specificity of our findings, two members of the study team with suicide expertise independently evaluated the complete dictionary and identified empirically and theoretically relevant themes; each word in the dictionary was assigned to one of the seven identified themes, which were used to generate subdictionaries. Any discrepancies in word placements within themes were discussed until a consensus was reached. This resulted in seven subdictionaries that were used in the current analyses: suicidal thoughts (41 words; e.g., ‘kill myself’; ‘no longer want to live’); suicide methods (75 words; e.g., ‘bridge’; ‘hang myself’); alcohol and illicit substances (26 words; e.g., ‘drinking’; ‘heroin’); sleep (8 words; e.g., ‘haven’t slept’; ‘nightmares’); hopeless (26 words; e.g., ‘defeated’; ‘no point’); general risk (93 words; e.g., ‘hate my life’; ‘depressed’); and help-seeking (8 words; e.g., ‘help me’; ‘want to be alive’). See Supplemental Table 1 for the full list of dictionary words.

Three complementary text-matching approaches were implemented to maximize detection accuracy: exact matching identified precise keyword occurrences (after lower-casing the OCR text), fuzzy matching (with a 95% similarity threshold) accounted for minor OCR errors and spelling variations, and lemmatized matching captured morphological variants of keywords. For each screenshot’s text content (at the OCR text block level), we calculated separate counts of keyword matches using each matching method across all dictionary categories. The analysis was implemented in Python, utilizing the NLTK library (Bird, Klein, & Loper, Reference Bird, Klein and Loper2009) for text processing and lemmatization, and FuzzyWuzzy (Cohen & Schick, Reference Cohen and Schickn.d.) for approximate string matching. Below, we only detail results for exact matching, as exact had very high correlations with lemmatization (mean = 0.98; range = 0.90–1.0), while fuzzy matching had correlations near zero with both other matching forms. The outcome of this approach is the word count for each dictionary, indicating the frequency with which words matching the dictionary criteria appear in the text within a given 10-minute interval.

Data Analysis. To examine the relationship between dictionary-detected language patterns and suicide risk, we calculated the mean rate of dictionary word usage in periods preceding EMAs. Dictionary rates were computed by summing the occurrences of words from each dictionary and normalizing by the time elapsed before each EMA. We compared these rates between responses of zero/nonzero for each suicide risk variable. Wilcoxon rank-sum tests were used to assess statistical significance between groups, given the nonnormal distribution of dictionary rates. To assess the strength and direction of relationships between dictionary-detected language patterns and suicide risk, we conducted Spearman rank correlations. Correlations were calculated between each dictionary’s usage rate and the three outcomes.

For each predictor, we disaggregated between- and within-person effects by calculating: (1) each participant’s mean proportion of 10-minute intervals containing any dictionary words (termed between-person effects) and (2) the interval-specific deviations from this individual average (termed within-person effects). We opted for dichotomizing dictionary count for both the between- and within-person specifications, given the extreme zero inflation of each 10-minute window dictionary count. We tested models that included multiple within-person specifications (namely, included deviations in count from person-specific means); however, there was a high correlation between these variables given the low base rate of nonzero counts. We found improved model convergence with the dichotomous relative to continuous coding. Relationships within the data were examined using generalized multilevel models that accommodated the nested nature of the data (repeated assessments nested within persons) and the nonnormal distributions of the outcome variables, which were characterized by a high number of zero values (Moghimbeigi, Eshraghian, Mohammad, & Mcardle, Reference Moghimbeigi, Eshraghian, Mohammad and Mcardle2008; Snijders & Bosker, Reference Snijders and Bosker2011). Given this, we specified zero-inflated negative binomial (ZINB; zero-inflated Poisson models had a high rate of convergence problems) distributions for each of the suicide risk outcomes. These models consisted of two parts (zero versus nonzero part and the count part; referred to as excess zero and count in-text, respectively). The resulting model part estimates warrant different interpretations: estimates from the nonzero (‘excess zero’ in text) part explain the probability that an observation falls into the category of excess zeros (logistic model); estimates from the count part of the model (negative binomial model; ‘count’ in text) describe the frequency of nonzero outcomes.

This model took the general form:

$$ a{ctive}_{ti}\sim {\beta}_{0i}+{\beta}_1\cdotp bp\_ dict\_{any}_i+{\beta}_2\cdotp wp\_ dict\_{any}_{ti}+{\varepsilon}_{ti} $$
$$ {zi}_{ti}\sim {\gamma}_{0i}+{\gamma}_1\cdotp bp\_ dict\_{any}_i+{\gamma}_2\cdotp wp\_ dict\_{any}_{ti}, $$

where for each dictionary (dict), both the within- ( $ wp\_ dict\_{any}_{ti} $ ) and between-person ( $ bp\_ dict\_{any}_i $ ) variables are specified for both parts of the outcome (Count: $ a{ctive}_{ti} $ ; 0/1 $ {zi}_{ti} $ ).

To clarify the interpretation of model outputs, we provide a hypothetical example using the hopeless dictionary and the outcome of passive suicidal ideation. Zero-inflated negative binomial (ZINB) models consist of two components: the zero-inflation component and the count component. Each helps us understand different aspects of the relationship between predictors and outcomes. The zero-inflation component addresses the likelihood of excess zeros. In our context, an estimate from this portion represents the relationship between dictionary use and the probability that a participant reports no passive suicidal ideation. For example, a negative coefficient for the within-person hopeless dictionary variable in the zero-inflation component would indicate that on days when an individual uses more hopeless language than their personal average, they are less likely to report zero passive suicidal ideation—in other words, they have a higher probability of experiencing at least some passive suicidal ideation. It’s important to note that unlike common practice in logistic regression, the reference case here is ‘zero’ (absence of the outcome), so coefficient interpretations may appear counterintuitive. Conversely, the count component models the intensity of the outcome when it is present. An estimate from this portion reflects the relationship between dictionary use and the severity of passive suicidal ideation on days when such ideation occurs. For instance, a positive coefficient for the between-person hopeless dictionary variable in the count component would suggest that individuals who generally exhibit more hopeless language throughout the study period tend to report higher levels of passive suicidal ideation when experiencing any such ideation. This dual-component approach allows us to distinguish between: (1) factors influencing whether any suicide risk is present, and (2) factors affecting the severity of that risk when it occurs – providing a more nuanced understanding of suicide risk factors than traditional regression approaches.

The full set of generalized multilevel models was estimated in a Bayesian framework using the brms package (Bürkner, Reference Bürkner2017) in R (R Core Team, 2021). Model convergence was assessed using the Rhat metric and effective sample size (ESS; Vehtari, Gelman, & Gabry, Reference Vehtari, Gelman and Gabry2017). To achieve an adequate number of samples for each parameter, 10 chains were used, with at least 200 samples per chain (100 burn-in). Additionally, we tested combined models that included all dictionary counts in one model. However, we opted against this specification due to the correlation across some dictionary counts and convergence issues.

Results

Preliminary analysis

The average screenshot image count per participant was 92,613 (median = 85,795; range = 2,185–431,623). Regarding each dictionary, the suicide methods dictionary had the highest percentage of nonzero entries within the 10-minute intervals across the study (45.68%), followed by the general risk dictionary (19.83%), suicidal thoughts dictionary (9.07%), alcohol and illicit substances dictionary (5.64%), help-seeking dictionary (1.09%), hopeless dictionary (0.36%), and the sleep dictionary (0.33%). Correlations between screenshot image count and word count per subdictionary were small in magnitude, with the strongest correlation being with suicide methods (r = .24), followed by general risk (r = .15) and suicidal thoughts (r = .11), with all other correlations r < .10. Nonzero passive SI was reported on 35.0% of EMA prompts; nonzero active SI on 32.72% of prompts; and nonzero suicidal planning on 13.11% of prompts.

Analysis of dictionary rates revealed significant differences between high (i.e., > threshold) and low (i.e., ≤ threshold) suicide risk across multiple dictionaries. For both passive and active SI, participants reporting higher SI showed significantly elevated rates of usage from the general risk, suicide methods, alcohol and illicit substances, and suicidal thoughts dictionaries. No differences were found for suicidal planning. See Table 1. Similarly, spearman correlations revealed small but significant associations for passive and active SI with the general risk, suicide methods, alcohol and illicit substances, and suicidal thoughts dictionaries. There was also a correlation between the help-seeking dictionary and passive SI; no significant correlations were found for suicidal planning. See Table 2.

Table 1. Mean dictionary rates by suicide risk outcome

Note: SI, suicidal ideation; SP, suicidal planning; Low, mean rate when outcome ≤ threshold; High, mean rate when outcome > threshold; *=p < .05. **=p < .01. ***=p < .001.

Table 2. Spearman correlation between dictionary usage and suicide risk outcomes

Note: SI, suicidal ideation; SP, suicidal planning; *p < .05.

Passive SI

There was a significant, negative, excess zero, between-person effect for the hopeless dictionary in predicting passive SI (Supplemental Table 3). There was a significant, positive, count, within-person effect, and a significant, positive, excess zero, within-person effect for the general risk dictionary predicting passive SI (Supplemental Table 5). There was a significant, positive, count, between-person effect and a significant, negative, excess zero, between-person effect for the suicidal thoughts dictionary predicting passive SI (Supplemental Table 8). There were no significant effects for help-seeking (Supplemental Table 2), suicide methods (Supplemental Table 4), sleep (Supplemental Table 6), or alcohol or illicit substances (Supplemental Table 7) dictionaries.

Active SI

There was a significant, positive, excess zero, within-person effect for the suicide methods dictionary predicting active SI (Supplemental Table 11). There was a significant, positive, count, within-person effect, and a significant, negative, excess zero, between-person effect for the general risk dictionary predicting active SI (Supplemental Table 12). There was a significant, negative, excess zero, between-person effect for the suicidal thoughts dictionary predicting active SI (Supplemental Table 15). There were no significant effects for hopelessness (Supplemental Table 10), sleep (Supplemental Table 13), alcohol and illicit substances (Supplemental Table 14), or help-seeking (Supplemental Table 9) dictionaries.

Suicidal planning

There was a significant, negative, excess zero, within-person effect for the general risk dictionary predicting suicidal planning (Supplemental Table 19). There was a significant, positive, count, within-person effect for the sleep dictionary predicting suicidal planning (Supplemental Table 20). There was a significant, negative, excess zero, within-person effect for the suicidal thoughts dictionary predicting suicidal planning (Supplemental Table 22). There were no significant effects for help-seeking (Supplemental Table 16), hopelessness (Supplemental Table 17), suicide methods (Supplemental Table 18), or alcohol and illicit substances (Supplemental Table 21) dictionaries.

Discussion

This study evaluated whether language patterns extracted from smartphone-based text were associated with self-reported passive SI, active SI, and suicidal planning. Findings demonstrate the potential promise of dictionary-based approaches for real-time suicide risk detection, with consistent associations observed for suicidal thoughts and general risk dictionaries, and outcome-specific effects identified in other subdictionaries. These results align with prior research on text-based communication for suicide risk detection (e.g., Bryan et al., Reference Bryan, Butner, Sinclair, Bryan, Hesse and Rose2018; Glenn et al., Reference Glenn, Nobles, Barnes and Teachman2020) and advance this work by showing the feasibility of leveraging diverse text sources across platforms in real time. Additionally, the findings provide initial support for the potential of smartphone-based text as a low-burden, scalable complement to traditional EMA methods for suicide risk assessment.

The suicidal thoughts dictionary was consistently linked to suicide risk outcomes. Greater detection of suicidal thought words was associated with more severe passive SI and higher likelihood of active SI and suicidal planning. Passive and active SI effects were between person, indicating individuals with higher average detection reported more passive and active SI. In contrast, suicidal planning reflected within-person effects, with spikes in word detection linked to planning behaviors. These findings highlight the potential value of smartphone-based suicide-related content, as well as the benefits of examining both between- and within-person variance. Screenomics captures cross-platform text, including direct and indirect engagement with suicide-related content, enabling more comprehensive detection of suicide risk. For example, in addition to capturing direct conversations regarding suicide risk (i.e., via text messages and social media), it also captures engagement with online support platforms (i.e., IMAlive, 7 Cups of Tea, r/SuicideWatch; e.g., Lewis & Seko, Reference Lewis and Seko2016; Memon, Sharma, Mohite, & Jain, Reference Memon, Sharma, Mohite and Jain2018), as well as other informative smartphone use behavior (i.e., online searches for suicide information; Biddle et al., Reference Biddle, Gunnell, Owen-Smith, Potokar, Longson, Hawton and Donovan2012; Choi, Han, & Hong, Reference Choi, Han and Hong2023), which may ultimately open doors for supportive interventions.

The general risk factors dictionary was linked to all three suicide risk outcomes. Within-person effects showed that spikes in general risk word detection were associated with passive SI, active SI, and suicidal planning, while a between-person effect indicated individuals with higher overall detection reported more passive SI. These findings align with prior research on the difficulty of predicting suicide risk using single constructs (Franklin et al., Reference Franklin, Ribeiro, Fox, Bentley, Kleiman, Huang and Nock2017). By combining diverse risk indicators (e.g., ‘no energy’, ‘depressed’, ‘lonely’; e.g., Cai et al., Reference Cai, Xie, Zhang, Cui, Lin, Sim and Xiang2021; Shoib et al., Reference Shoib, Amanda, Saeed, Ransing, Bhandari, Armiya’u and Chandradasa2023; Schafer et al., Reference Schafer, Duffy, Kennedy, Stentz, Leon, Herrerias and Joiner2022), the general risk factors dictionary addresses this challenge – capturing both specific and broad expressions of distress that may signal suicide risk. Unexpectedly, within-person increases in general risk words were linked to lower odds of reporting passive SI. Elevated general risk language may reflect increased cognitive engagement with distress (e.g., venting or catastrophizing), temporarily mitigating passive SI; however, the consistent positive relationships with active SI and suicidal planning, along with research linking venting to negative mental health outcomes (Marr, Zainal, & Newman, Reference Marr, Zainal and Newman2022;), make this explanation less likely. It is possible that passive SI is a more dynamic process (e.g., more fleeting thoughts), such that the timing of our EMA prompts may not have captured the complete risk picture, limiting the interpretation of our findings. The broad emotional language included in the general risk dictionary may partly explain these findings. For example, some words (e.g., ‘depressed’, ‘lonely’) might align with high-severity passive SI but fall short of predicting its presence, while others (e.g., ‘hate my life’) may reflect intense distress linked to active SI or planning. These results may also highlight variability in how individuals experience and express passive SI (Czyz et al., Reference Czyz, Koo, Al-Dajani, Kentopp, Jiang and King2022; Kleiman et al., Reference Kleiman, Turner, Fedor, Beale, Picard, Huffman and Nock2018). To better understand these patterns, future research should explore which specific words in the dictionary drive these divergent relationships and how general risk language evolves with passive SI severity and transitions between passive and active SI over time.

Several outcome-specific findings emerged. Between-person analyses showed that higher overall detection of hopelessness-related words predicted passive SI. These findings offer information that may potentially expand our understanding of the constructs central to the Interpersonal Theory of Suicide (Van Orden et al., Reference Van Orden, Witte, Cukrowicz, Braithwaite, Selby and Joiner2010), which links hopelessness to active SI through thwarted belongingness and perceived burdensomeness. In contrast, the hopelessness dictionary captures broader despair (e.g., ‘given up’, ‘can’t take it’, ‘defeated’), possibly helping to explain the link to passive SI. This finding is supported by a meta-analysis suggesting that general hopelessness is more strongly associated with passive than active SI (Liu, Bettis, & Burke, Reference Liu, Bettis and Burke2020); together, this may highlight the role of hopelessness across types of SI (i.e., passive, active). It is also important to consider the intensive data structure underlying the current findings, uncovering dynamic associations not often accounted for in theoretical models. As prior intensive sampling research has shown a robust link between hopelessness and passive SI (Hallensleben et al., Reference Hallensleben, Glaesmer, Forkmann, Rath, Strauss, Kersting and Spangenberg2019), the current study builds on these findings, demonstrating that passively collected text data may be an alternative way to capture hopelessness at an intensive time scale, reducing self-report burdens and providing a scalable tool for early detection and intervention.

Higher-than-usual detection of sleep-related words (e.g., ‘haven’t slept’, ‘nightmares’) was associated with greater severity of suicidal planning. While research has linked sleep disorders to SI and suicide attempts (Drapeau & Nadorff, Reference Drapeau and Nadorff2017), meta-analyses show that general sleep problems (e.g., difficulty falling asleep, staying asleep) are strongly associated with suicidal planning (OR = 2.6; Wojnar et al., Reference Wojnar, Ilgen, Wojnar, McCammon, Valenstein and Brower2009). These findings align with longitudinal studies linking sleep disturbances, duration, and quality to next-day SI (Brüdern et al., Reference Brüdern, Hallensleben, Höller, Spangenberg, Forkmann, Rath and Glaesmer2022; Kivelä, Van der Does, & Antypa, Reference Kivelä, Van der Does and Antypa2024; Littlewood et al., Reference Littlewood, Kyle, Carter, Peters, Pratt and Gooding2019). Given biases in self-reported sleep data, particularly among individuals with mood disorders (Biddle et al., Reference Biddle, Robillard, Hermens, Hickie and Glozier2015; Lauderdale et al., Reference Lauderdale, Knutson, Yan, Liu and Rathouz2008), text-based detection of sleep-related language may offer a potential objective tool for assessing sleep’s role in suicidal planning risk.

The findings for the suicide methods dictionary were unexpected, as greater detection of these words was associated with the absence of active SI, contrary to expectations. One possibility is that discussing suicide methods may serve as a coping mechanism (e.g., venting or cognitive diffusion), reducing SI. While venting has been linked to increased suicide risk in some studies (Baer et al., Reference Baer, Spitzen, Richmond, Tull and Gratz2022), other research suggests that talking with peers, providers, or crisis lines reduces daily suicidal urges (Al-Dajani, Horwitz, & Czyz, Reference Al-Dajani, Horwitz and Czyz2022). Alternatively, these terms may often reflect nonsuicidal content. Words like ‘bridge’ may appear in unrelated contexts, or phrases like ‘hang me’ could be sarcastic. Future research should examine specific terms within the dictionary to better understand these patterns and their potential meanings.

This study has several strengths, including the use of temporally granular data and text integration across various smartphone activities, offering a comprehensive view of suicide risk. However, limitations should be noted. The sample, drawn from a Midwest city, was homogenous, highly engaged in treatment, and reported high psychopathology comorbidity, limiting generalizability to more diverse populations, including those of lower clinical severity or with recent onset of suicidal ideation. Excluding iOS users, who differ demographically from Android users (e.g., higher income, younger age; Howarth, Reference Howarth2024), further impacts generalizability. Dictionary-based methods, while interpretable, rely on predefined word lists, limiting flexibility and the ability to assess causal relationships (e.g., exposure to suicide-related content increasing suicidal thoughts; Marchant et al., Reference Marchant, Hawton, Burns, Stewart and John2021). Further, while the combined dictionary has previously been validated, the current analysis implemented newly subsetted subdictionaries to enhance finding interpretation. Future work could complement this approach with more flexible natural language processing techniques, such as linguistic feature extraction or machine learning models, which have seen a recent increase in application in suicide research (i.e., Arowosegbe & Oyelade, Reference Arowosegbe and Oyelade2023). Similarly, integrating other passive smartphone data sources (e.g., geolocation, activity levels, circadian patterns) may enrich the understanding of how digital behaviors relate to suicide risk. The analyses also did not account for co-occurrence of all three suicide-related outcomes, leaving the relationship between subdictionaries and comorbid ideation and planning unclear. Optional screenshot disabling may have introduced self-selection bias, potentially underestimating associations between text data and suicide risk. Additionally, the source of text (e.g., messaging apps, social media) was not differentiated, preventing platform-specific insights. Finally, reliance on OCR likely overlooked nuanced indicators of risk conveyed through images, emojis, or other nontextual content.

This study highlights the potential of smartphone-based text data to enhance real-time suicide risk detection, offering a scalable, low-burden approach that may, ultimately, be integrated into clinical care and crisis response systems. The differential predictive effects across dictionaries, such as general risk and suicidal thoughts, suggest that specific language patterns may align with distinct components of SI and suicidal planning, which, after replication, has the potential to pave the way for tailored interventions in the future. Moreover, the ability to detect within-person deviations in risk-related language emphasizes the promise of individualized, dynamic monitoring, moving beyond traditional static assessments. This initial study lays the foundation of a burgeoning research area suggesting that Screenomics may be a valid and feasible avenue for real-time data collection that could facilitate immediate support through crisis hotlines, instant messaging services, or connection with personal contacts, while also enabling the development of personalized treatment strategies. However, given the preliminary nature of the current results, future research is needed to explore the generalizability of findings. Despite these challenges, this study represents a critical step forward in leveraging digital technology for suicide prevention, offering innovative methods to address a significant public health challenge.

Supplementary material

The supplementary material for this article can be found at http://doi.org/10.1017/S0033291725001199.

Financial support

This work was funded by R21MH129688.

Competing interests

The authors have no conflicts of interest to disclose.

References

Al-Dajani, N., Horwitz, A. G., & Czyz, E. K. (2022). Does coping reduce suicidal urges in everyday life? Evidence from a daily diary study of adolescent inpatients. Depression and Anxiety, 39, 496503.CrossRefGoogle ScholarPubMed
Ammerman, B. A., & Law, K. C. (2022). Using intensive time sampling methods to capture daily suicidal ideation: A systematic review. Journal of Affective Disorders, 299, 108117.CrossRefGoogle ScholarPubMed
Andriessen, K., Rahman, B., Draper, B., Dudley, M., & Mitchell, P. B. (2017). Prevalence of exposure to suicide: A meta-analysis of population-based studies. Journal of Psychiatric Research, 88, 113120.CrossRefGoogle ScholarPubMed
Arowosegbe, A., & Oyelade, T. (2023). Application of natural language processing (NLP) in detecting and preventing suicide ideation: A systematic review. International Journal of Environmental Research and Public Health, 20, 1514.CrossRefGoogle ScholarPubMed
Baer, M. M., Spitzen, T. L., Richmond, J. R., Tull, M. T., & Gratz, K. L. (2022). Associations of interpersonal and intrapersonal emotion regulation strategies to suicidal ideation and suicide attempts. Journal of Contextual Behavioral Science, 24, 19.CrossRefGoogle Scholar
Beck, A. T., Kovacs, M., & Weissman, A. (1979). Assessment of suicidal intention: The scale for suicide ideation. Journal of Consulting and Clinical Psychology, 47, 343352.CrossRefGoogle ScholarPubMed
Biddle, L., Gunnell, D., Owen-Smith, A., Potokar, J., Longson, D., Hawton, K., … & Donovan, J. (2012). Information sources used by the suicidal to inform choice of method. Journal of Affective Disorders, 136, 702709.CrossRefGoogle ScholarPubMed
Biddle, D. J., Robillard, R., Hermens, D. F., Hickie, I. B., & Glozier, N. (2015). Accuracy of self-reported sleep parameters compared with actigraphy in young people with mental ill-health. Sleep Health, 1, 214220.CrossRefGoogle Scholar
Bird, S., Klein, E., & Loper, E. (2009). Natural language processing with Python: Analyzing text with the natural language processing toolkit. O’Reilly Media Inc.Google Scholar
Bryan, C. J., Butner, J. E., Sinclair, S., Bryan, A. B. O., Hesse, C. M., & Rose, A. E. (2018). Predictors of emerging suicide death among military personnel on social media networks. Suicide and Life-Threatening Behavior, 48, 413430CrossRefGoogle ScholarPubMed
Brüdern, J., Hallensleben, N., Höller, I., Spangenberg, L., Forkmann, T., Rath, D., … & Glaesmer, H. (2022). Sleep disturbances predict active suicidal ideation the next day: An ecological momentary assessment study. BMC Psychiatry, 22, 65.CrossRefGoogle Scholar
Bürkner, P. C. (2017). brms: An R package for Bayesian multilevel models using Stan. Journal of Statistical Software, 80, 128.CrossRefGoogle Scholar
Cai, H., Xie, X. M., Zhang, Q., Cui, X., Lin, J. X., Sim, K., … & Xiang, Y. T. (2021). Prevalence of suicidality in major depressive disorder: A systematic review and meta-analysis of comparative studies. Frontiers in Psychiatry, 12, 690130.CrossRefGoogle ScholarPubMed
Choi, W. S., Han, J., & Hong, H. J. (2023). Association between internet searches related to suicide/self-harm and adolescent suicide death in South Korea in 2016–2020: Secondary data analysis. Journal of Medical Internet Research, 25, e46254.CrossRefGoogle ScholarPubMed
Cohen, S., & Schick, L. (n.d.). fuzzywuzzy [Computer software]. https://github.com/seatgeek/fuzzywuzzyGoogle Scholar
Coppersmith, D. D., Dempsey, W., Kleiman, E. M., Bentley, K. H., Murphy, S. A., & Nock, M. K. (2022). Just-in-time adaptive interventions for suicide prevention: Promise, challenges, and future directions. Psychiatry, 85, 317333.CrossRefGoogle ScholarPubMed
Coppersmith, G., Leary, R., Crutchley, P., & Fine, A. (2018). Natural language processing of social media as screening for suicide risk. Biomedical Informatics Insights, 10, 1178222618792860.CrossRefGoogle ScholarPubMed
Czyz, E. K., Horwitz, A. G., Arango, A., & King, C. A. (2019). Short-term change and prediction of suicidal ideation among adolescents: A daily diary study following psychiatric hospitalization. Journal of Child Psychology and Psychiatry, 60, 732741.CrossRefGoogle ScholarPubMed
Czyz, E. K., Koo, H. J., Al-Dajani, N., Kentopp, S. D., Jiang, A., & King, C. A. (2022). Temporal profiles of suicidal thoughts in daily life: Results from two mobile-based monitoring studies with high-risk adolescents. Journal of Psychiatric Research, 153, 5663.CrossRefGoogle ScholarPubMed
Czyz, E. K., King, C. A., Al-Dajani, N., Zimmermann, L., Hong, V., & Nahum-Shani, I. (2023). Ecological momentary assessments and passive sensing in the prediction of short-term suicidal ideation in young adults. JAMA Network Open, 6, e2328005.CrossRefGoogle ScholarPubMed
Deisenhammer, E. A., Ing, C. M., Strauss, R., Kemmler, G., Hinterhuber, H., & Weiss, E. M. (2009) The duration of the suicidal process: How much time is left for intervention between consideration and accomplishment of a suicide attempt? Journal of Clinical Psychiatry, 70, 1924.CrossRefGoogle ScholarPubMed
Drapeau, C. W., & Nadorff, M. R. (2017). Suicidality in sleep disorders: Prevalence, impact, and management strategies. Nature and Science of Sleep, 9, 213226.CrossRefGoogle ScholarPubMed
Du, J., Zhang, Y., Luo, J., Jia, Y., Wei, Q., Tao, C., & Xu, H. (2018). Extracting psychiatric stressors for suicide from social media using deep learning. BMC Medical Informatics and Decision Making, 18, 43.CrossRefGoogle ScholarPubMed
Forkmann, T., Spangenberg, L., Rath, D., Hallensleben, N., Hegerl, U., Kersting, A., & Glaesmer, H. (2018). Assessing suicidality in real time: A psychometric evaluation of self-report items for the assessment of suicidal ideation and its proximal risk factors using ecological momentary assessments. Journal of Abnormal Psychology, 127, 758769.CrossRefGoogle Scholar
Franklin, J. C., Ribeiro, J. D., Fox, K. R., Bentley, K. H., Kleiman, E. M., Huang, X., … & Nock, M. K. (2017). Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research. Psychological Bulletin, 143, 187232.CrossRefGoogle ScholarPubMed
Glenn, J. J., Nobles, A. L., Barnes, L. E., & Teachman, B. A. (2020). Can text messages identify suicide risk in real time? A within-subjects pilot examination of temporally sensitive markers of suicide risk. Clinical Psychological Science, 8, 704722.CrossRefGoogle Scholar
Guan, L., Hao, B., Cheng, Q., Yip, P. S., & Zhu, T. (2015). Identifying Chinese microblog users with high suicide probability using internet-based profile and linguistic features: Classification model. JMIR Mental Health, 2, e17.CrossRefGoogle ScholarPubMed
Hallensleben, N., Spangenberg, L., Forkmann, T., Rath, D., Hegerl, U., Kersting, A., … & Glaesmer, H. (2018). Investigating the dynamics of suicidal ideation: Preliminary findings from a study using ecological momentary assessments in psychiatric inpatients. Crisis: The Journal of Crisis Intervention and Suicide Prevention, 39, 6569.CrossRefGoogle Scholar
Hallensleben, N., Glaesmer, H., Forkmann, T., Rath, D., Strauss, M., Kersting, A., & Spangenberg, L. (2019). Predicting suicidal ideation by interpersonal variables, hopelessness and depression in real-time. An ecological momentary assessment study in psychiatric inpatients with depression. European Psychiatry, 56, 4350.CrossRefGoogle ScholarPubMed
Horwitz, A., Czyz, E., Al-Dajani, N., Dempsey, W., Zhao, Z., Nahum-Shani, I., & Sen, S. (2022). Utilizing daily mood diaries and wearable sensor data to predict depression and suicidal ideation among medical interns. Journal of Affective Disorders, 313, 17.CrossRefGoogle ScholarPubMed
Howarth, J. (2024). iPhone vs Android users: Key differences in 2024. Exploding Topics. https://explodingtopics.com/blog/iphone-android-users.Google Scholar
Jacobucci, R., Ammerman, B., & Ram, N. (2024). Examining passively collected smartphone-based data in the days prior to psychiatric hospitalization for a suicidal crisis: Comparative case analysis. JMIR Formative Research, 8, e55999.CrossRefGoogle ScholarPubMed
Jaided, A. I. (2024). EasyOCR [Computer software]. GitHub. https://github.com/JaidedAI/EasyOCRGoogle Scholar
Jodoin, M. G. (2003). Measurement efficiency of innovative item formats in computer-based testing. Journal of Educational Measurement, 40, 115.CrossRefGoogle Scholar
Kivelä, L. M., Van der Does, W., & Antypa, N. (2024). Sleep, hopelessness, and suicidal ideation: An ecological momentary assessment and actigraphy study. Journal of Psychiatric Research, 177, 4652.CrossRefGoogle ScholarPubMed
Kleiman, E. M., Turner, B. J., Fedor, S., Beale, E. E., Huffman, J. C., & Nock, M. K. (2017). Examination of real-time fluctuations in suicidal ideation and its risk factors: Results from two ecological momentary assessment studies. Journal of Abnormal Psychology, 126, 726738.CrossRefGoogle ScholarPubMed
Kleiman, E. M., Turner, B. J., Fedor, S., Beale, E. E., Picard, R. W., Huffman, J. C., & Nock, M. K. (2018). Digital phenotyping of suicidal thoughts. Depression and Anxiety, 35, 601608.CrossRefGoogle ScholarPubMed
Lauderdale, D. S., Knutson, K. L., Yan, L. L., Liu, K., & Rathouz, P. J. (2008). Sleep duration: How well do self-reports reflect objective measures? The CARDIA Sleep Study. Epidemiology, 19, 838845.CrossRefGoogle Scholar
Lewis, S. P., & Seko, Y. (2016). A double-edged sword: A review of benefits and risks of online nonsuicidal self-injury activities. Journal of Clinical Psychology, 72, 249262.CrossRefGoogle Scholar
Littlewood, D. L., Kyle, S. D., Carter, L. A., Peters, S., Pratt, D., & Gooding, P. (2019). Short sleep duration and poor sleep quality predict next-day suicidal ideation: An ecological momentary assessment study. Psychological Medicine, 49, 403411.CrossRefGoogle ScholarPubMed
Liu, R. T., Bettis, A. H., & Burke, T. A. (2020). Characterizing the phenomenology of passive suicidal ideation: A systematic review and meta-analysis of its prevalence, psychiatric comorbidity, correlates, and comparisons with active suicidal ideation. Psychological Medicine, 50, 367383.CrossRefGoogle ScholarPubMed
Marchant, A., Hawton, K., Burns, L., Stewart, A., & John, A. (2021). Impact of web-based sharing and viewing of self-harm–related videos and photographs on young people: Systematic review. Journal of Medical Internet Research, 23(3), e18048.CrossRefGoogle Scholar
Marr, N. S., Zainal, N. H., & Newman, M. G. (2022). Focus on and venting of negative emotion mediates the 18-year bi-directional relations between major depressive disorder and generalized anxiety disorder diagnoses. Journal of Affective Disorders, 303, 1017.CrossRefGoogle ScholarPubMed
Memon, A. M., Sharma, S. G., Mohite, S. S., & Jain, S. (2018). The role of online social networking on deliberate self-harm and suicidality in adolescents: A systematized review of literature. Indian Journal of Psychiatry, 60, 384392.CrossRefGoogle ScholarPubMed
Millner, A. J., Lee, M. D., & Nock, M. K. (2017). Describing and measuring the pathway to suicide attempts: A preliminary study. Suicide Life and Threatening Behavior, 47, 353369CrossRefGoogle ScholarPubMed
Moghimbeigi, A., Eshraghian, M. R., Mohammad, K., & Mcardle, B. (2008). Multilevel zero-i nflated negative binomial regression modeling for over-dispersed count data with extra zeros. Journal of Applied Statistics, 35, 11931202.CrossRefGoogle Scholar
National Institute of Health. (2018, May). Estimates of funding for various research, condition, and disease categories (RCDC). https://report.nih.gov/categorical_spending.aspx.Google Scholar
Nock, M. K., Holmberg, E. B., Photos, V. I., & Michel, B. D. (2007). Self-Injurious thoughts and behaviors interview: Development, reliability, and validity in an adolescent sample. Psychological Assessment, 19, 309317,CrossRefGoogle Scholar
Onnela, J. P., & Rauch, S. L. (2016). Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health. Neuropsychopharmacology, 41, 16911696.CrossRefGoogle ScholarPubMed
R Core Team. (2021). A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing: http://www.R-project.org/Google Scholar
Ram, N., Yang, X., Cho, M. J., Brinberg, M., Muirhead, F., Reeves, B., & Robinson, T. N. (2020). Screenomics: A new approach for observing and studying individuals’ digital lives. Journal of Adolescent Research, 35, 1650.CrossRefGoogle ScholarPubMed
Reeves, B., Ram, N., Robinson, T. N., Cummings, J. J., Giles, C. L., Pan, J., … & Gagneja, A. (2019). Screenomics: A framework to capture and analyze personal life experiences and the ways that technology shapes them. Human–Computer Interaction, 36, 152.Google Scholar
Reeves, B., Robinson, T., & Ram, N. (2020). Time for the human screenome project. Nature, 577, 314317CrossRefGoogle ScholarPubMed
Schafer, K. M., Duffy, M., Kennedy, G., Stentz, L., Leon, J., Herrerias, G., … & Joiner, T. E. (2022). Suicidal ideation, suicide attempts, and suicide death among Veterans and service members: A comprehensive meta-analysis of risk factors. Military Psychology, 34, 129146.CrossRefGoogle ScholarPubMed
Sheehan, D., Janavs, J., Baker, R., Harnett-Sheehan, K., Knapp, E., & Sheehan, M. (1998). Mini international neuropsychiatric interview. University of South Florida.Google ScholarPubMed
Shepard, D. S., Gurewich, D., Lwin, A. K., Reed, G. A. Jr, & Silverman, M. M. (2016). Suicide and suicidal attempts in the United States: Costs and policy implications. Suicide and Life-Threatening Behavior, 46, 352362.CrossRefGoogle ScholarPubMed
Shoib, S., Amanda, T. W., Saeed, F., Ransing, R., Bhandari, S. S., Armiya’u, A. Y. U., … & Chandradasa, M. (2023). Association between loneliness and suicidal behaviour: A scoping review. Turkish Journal of Psychiatry, 34, 125132.Google ScholarPubMed
Snijders, T. A. B., & Bosker, R. (2011). Multilevel analysis: An introduction to basic and advanced multilevel modeling. Sage Publications.Google Scholar
Swaminathan, A., López, I., Mar, R. A. G., Heist, T., McClintock, T., Caoili, K., … & Nock, M. K. (2023). Natural language processing system for rapid detection and intervention of mental health crisis chat messages. NPJ Digital Medicine, 6, 213.CrossRefGoogle ScholarPubMed
Torous, J., Larsen, M. E., Depp, C., Cosco, T. D., Barnett, I., Nock, M. K., & Firth, J. (2018). Smartphones, sensors, and machine learning to advance real-time prediction and interventions for suicide prevention: A review of current progress and next steps. Current Psychiatry Reports, 20, 16.CrossRefGoogle ScholarPubMed
Wojnar, M., Ilgen, M. A., Wojnar, J., McCammon, R. J., Valenstein, M., & Brower, K. J. (2009). Sleep problems and suicidality in the national comorbidity survey replication. Journal of Psychiatric Research, 43, 526531.CrossRefGoogle ScholarPubMed
Van Orden, K. A., Witte, T. K., Cukrowicz, K. C., Braithwaite, S. R., Selby, E. A., & Joiner, T. E. Jr (2010). The interpersonal theory of suicide. Psychological Review, 117, 575600.CrossRefGoogle ScholarPubMed
Yee, A. Z., Yu, R., Lim, S. S., Lim, K. H., Dinh, T. T. A., Loh, L., … & Quizon, M. (2023). ScreenLife capture: An open-source and user-friendly framework for collecting screenomes from Android smartphones. Behavior Research Methods, 55(8), 40684085.CrossRefGoogle ScholarPubMed
Vehtari, A., Gelman, A., & Gabry, J. (2017). Practical Bayesian model evaluation using leave-one-out cross- validation and WAIC. Statistics and Computing, 27, 14131432.CrossRefGoogle Scholar
Figure 0

Table 1. Mean dictionary rates by suicide risk outcome

Figure 1

Table 2. Spearman correlation between dictionary usage and suicide risk outcomes

Supplementary material: File

Ammerman et al. supplementary material

Ammerman et al. supplementary material
Download Ammerman et al. supplementary material(File)
File 83.2 KB