Hostname: page-component-586b7cd67f-t8hqh Total loading time: 0 Render date: 2024-11-22T10:17:31.138Z Has data issue: false hasContentIssue false

A systematic appraisal of the information, engagement, aesthetic and functional quality of nutrition-related smartphone apps for children and adolescents

Published online by Cambridge University Press:  13 March 2023

Lucine Francis*
Affiliation:
Center for Community Programs, Innovation, and Scholarship, Johns Hopkins University School of Nursing, Baltimore, MD 21205, USA Johns Hopkins University School of Nursing, Baltimore, MD 21205, USA
Erin M Spaulding
Affiliation:
Johns Hopkins University School of Nursing, Baltimore, MD 21205, USA Digital Health Innovation Laboratory, Ciccarone Center for the Prevention of Cardiovascular Disease, Division of Cardiology, Department of Medicine, Johns Hopkins University School of Medicine, The Welch Center for Prevention, Epidemiology and Clinical Research, Johns Hopkins University Bloomberg School of Public Health, Baltimore, MD 21205, USA
India Bloom
Affiliation:
Johns Hopkins University School of Nursing, Baltimore, MD 21205, USA
Alisha Patel
Affiliation:
Johns Hopkins University School of Nursing, Baltimore, MD 21205, USA
Nancy Perrin
Affiliation:
Johns Hopkins University School of Nursing, Baltimore, MD 21205, USA
*
*Corresponding author: Email [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Objective:

Nutrition-related smartphone applications (apps) could improve children’s nutrition knowledge and skills. However, little is known about the quality of nutrition-related apps for children. This study aimed to identify and evaluate the quality of nutrition-related smartphone apps designed for children ages 4–17.

Design:

This systematic appraisal is guided by the Protocol for App Store Systematic Reviews.

Setting:

Using Google’s Advanced Search, we identified 1814 apps/1184 additional apps in an updated search on iOS, of which twenty-four were eligible. The apps’ objective and subjective quality were evaluated using the twenty-three-item, five-point Mobile App Rating Scale. The objective quality scale consists of four subscales: engagement, functionality, aesthetics and information.

Results:

Most of the apps (75 %) focussed solely on promoting nutrition skills, such as making food dishes, rather than nutrition knowledge. Of the twenty-four apps, 83 % targeted children 4–8 years old. The app objective quality mean score was 3·60 ± 0·41. The subscale mean scores were 3·20 ± 0·41 for engagement, 4·24 ± 0·47 for functionality, 4·03 ± 0·51 for aesthetics and 2·94 ± 0·62 for information. The app subjective quality mean score was 2·10 ± 0·90.

Conclusions:

More robust approaches to app development leveraging co-design approaches, including involving a multidisciplinary team of experts to provide evidence-based nutrition information, are warranted.

Type
Systematic Review
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2023. Published by Cambridge University Press on behalf of The Nutrition Society

Obesity affects nearly one in five children and adolescents in the USA, with Black and Hispanic communities most affected(Reference Fryar, Carroll and Afful1,Reference Ogden, Carroll and Lawman2) . Although the causes of childhood obesity are complex, poor nutrition contributes significantly to obesity in children and adolescents(3Reference Tester, Rosas and Leung5). Childhood obesity can lead to a lifetime of health issues such as type 2 diabetes, high blood pressure, sleep disorders, asthma and social problems such as being bullied(Reference Gundersen and Seligman4,6) . Settings where children spend the most time, like childcare and schools, can be leveraged to provide optimal nutrition education and implement evidence-based obesity prevention interventions. Evidence suggests that lockdowns such as the closures of schools and childcare related to the COVID-19 pandemic have exacerbated existing disparities in childhood obesity, especially for households in low-income and minoritized communities(Reference Jenssen, Kelly and Powell7). To add, pandemic-related changes in children’s eating behaviours and physical activity mirror weight gain patterns experienced during breaks from school when access to healthy foods and opportunities for physical activity are often limited(Reference Browne, Snethen and Greenberg8Reference Kourti, Stavridou and Panagouli11).

Given the magnitude of the obesity epidemic in the USA, there is a need for cost-effective, accessible and low-touch solutions to promote healthy nutrition among children and adolescents. The use of high-quality mobile health (mHealth) applications (apps) represents one promising avenue for health promotion, with mHealth apps exploding in popularity over the past several years. Although more experimental research is needed, some evidence suggests that nutrition-based apps are helpful, especially for promoting fruit and vegetable consumption among children(Reference Vepsäläinen, Skaffari and Wojtkowska12Reference Quelly, Norris and Dipietro14). Sixty percent of parents in the USA with children 12 years or younger reported that their children engage with smartphones, with 30 % doing so before age 5(Reference Auxier, Anderson and Perrin15). Most US teens aged 13–17 years have access to a smartphone, and more than half report using it to ‘pass time,’ meet others and for learning purposes(Reference Schaeffer16). With the increased use of smartphones among children and adolescents, engaging with nutrition-related mobile apps presents an opportunity for health promotion centred on nutrition. Already, parents and teachers rely on educational apps and game-based learning to support the mastery of literacy and math skills(Reference Hill and Brunvand17). Likewise, nutrition education in US schools is prevalent throughout the K-12 experience, but the frequency of the teaching and the quality of the curricula are not fully understood(18,19) . Mobile apps can help build a widely accessible and high-quality digital nutrition learning community to improve nutrition knowledge and skills and help to prevent obesity.

Prior research has demonstrated the potential for mHealth apps to aid in weight loss and improve dietary behaviours, mainly in adults(Reference Ghelani, Moran and Johnson20Reference Taj, Klein and van Halteren22). Few studies have focussed on identifying currently available health promotion apps explicitly designed to encourage healthy nutrition knowledge and practices, especially in children and adolescents. Little is known about the existence, content and quality of nutrition-related apps currently available in smartphone app stores, particularly those directed towards children and adolescents(Reference Xu and Liu23). In a recent review, the quality of nutrition promotion apps and websites was systematically appraised to assess their usability and effectiveness for improving child nutrition(Reference Zarnowiecki, Mauch and Middleton24). However, the study focussed on appraising digital tools directed towards parents to help support their children’s nutrition. More evidence is needed to identify and examine the quality of nutrition-related apps designed for children and adolescents to be the end-user.

This systematic appraisal aims to identify and appraise nutrition-related smartphone apps’ information, engagement, aesthetic and functional quality for children ages 4–17. We aim to ask the following research questions:

  1. What free nutrition-related apps in the English language exist for children?

  2. What is the app’s quality concerning the information, engagement, aesthetic and functionality?

  3. Have the identified apps been studied extensively to examine their impact on child nutrition or health outcomes and findings published in the peer-reviewed literature?

Methods

Study design

We conducted the systematic search, appraisal and reporting of nutrition-related apps for children according to the Protocol for App Store Systematic Reviews (PASSR),(Reference Marshall, Dunstan and Bartik25) which was adapted from the A MeaSurement Tool to Assess Systematic Reviews (AMSTAR)(Reference Shea, Reeves and Wells26) and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)(Reference Moher, Liberati and Tetzlaff27).

App search strategy

Our search strategy was guided by the PICOS model included in PASSR; Population: children including adolescents (4–17 years old); Intervention: nutrition-related apps; Control: none; Outcomes: ratings of app’s information, engagement, aesthetics and functional quality; Study design: a cross-sectional appraisal. We used Google Advanced Search(28) to search for apps within the Apple store (itunes.apple.com) by using the following terms: ‘nutrition AND kids,’ OR ‘foods AND kids,’ OR ‘beverages AND kids,’ OR ‘cooking AND kids,’ OR ‘obesity AND kids,’ OR ‘weight AND kids.’ We used Google Advanced Search because it allows users to apply filters (such as ‘all of these words’ or ‘any combination of these words’) that enhanced the quality of our search. This approach has also been used by other researchers conducting ratings of mobile apps(Reference Grau-Corral, Pantoja and Grajales29Reference Brouwer31). We searched only within the Apple app store to reduce bias in this way: Apps within the Apple app store are generally of higher quality than Google Play apps because the approval process for Google Play is much faster and less strict(Reference Zdraveska32). Therefore, to reduce bias, we chose to conduct the review solely within the Apple app store, which also provides the advantage of being able to search for free apps. We restricted the search to results that included ‘all these words’ and ‘English language only,’ meaning that the app store page was available in English so that reviewers could evaluate app descriptions and other relevant information displayed on the app store page. Links from each Google Search page were extracted using a link scraping tool called Linkclump(33) and then pasted into Excel(34). The final search for this review was conducted on October 26, 2020, and an updated search since the initial search was conducted on August 5, 2022.

All duplicate apps were removed from the Excel sheet using Excel’s sort function and the ‘ctrl+F’ function. If available, we only included the English language version for apps with multiple language versions. We also considered apps duplicates if they were older versions of an app or had slightly different artwork but otherwise had identical descriptions and names. iOS links that were either entirely unavailable or not available in the US app store were also removed. A master list of links was created after removing duplicates and unavailable links.

Eligibility criteria and screening process

Pre-installation screening process

Apps were eligible for inclusion in the appraisal if they met the following criteria: (1) English language only, (2) free to download and included no in-app purchases, (3) designed with children (aged 4–17 years) in mind as the end-user and (4) contained food or beverage-related content. Regarding eligibility criteria 2, free apps in Apple’s App store are more likely to rank in the top 300 grossing apps and have a two to three times higher survival rate than paid apps(Reference Lee and Raghu35). The rationale for including only free apps in this review was to identify apps that could be used widely without barriers related to costs since App cost is cited as a primary concern for mHealth app users(Reference Krebs and Duncan36). Regarding the third eligibility criteria, apps were designated as eligible if the Apple app store rated the app as for ages 4+ and the app was not targeted at professional or solely adult audiences (e.g. apps for healthcare professionals or parenting apps). The iOS app age ratings are 4+, 9+, 12+ and 17+. A rating of 4 + means the app contains no objectionable material, but not necessarily mean that the app is designed for children(37). A rating of 9+, 12+ and 17 + means the app may contain content that may not suit children under those age groups. Apps were excluded if they: (1) were designed for adult use only; (2) were deemed inappropriate for children due to profanity, nudity, alcohol/drug use, violence or crude humour or (3) contained no nutrition or food/beverage content per the description in the iOS app store. Two independent reviewers (ES and IB) assessed each app description in the iOS app store for eligibility. Eligibility disagreements were resolved with a third reviewer (AP).

Post-installation screening process

The apps that met the eligibility criteria during the pre-installation screening were downloaded onto two independent reviewers’ (ES and IB) iPhones. Eligibility for inclusion was then confirmed upon engaging with the apps. In addition to the aforementioned eligibility criteria, the apps were also excluded at this stage if they solely contained obesogenic or obesity-promoting foods. We excluded these apps to focus on nutrition-related apps that could be considered health promotion tools among school aged children. An obesogenic screening tool was developed for this purpose by the study team. The obesogenic screening tool asked, ‘Does this app only contain foods that are top sources of added sugars, saturated fat, or sodium?’ If the answer to this question was ‘yes,’ the app was excluded, and if ‘no,’ the app was included in the review. The criteria used to determine whether foods were obesogenic were mainly developed from data provided by the United States Department of Agriculture (USDA) Food Surveys Research Group(Reference Bowman, Clemens and Friday38Reference Martin, Sebastian and Wilkinson Enns44). The mission of the Food Surveys Research Group is to ‘monitor and assess food consumption and related behavior of the US population by conducting surveys and providing the resulting information for food and nutrition-related programs and public policy decisions.’ A list of the foods deemed to be top sources of added sugars, saturated fat or Na can be found in Supplementary Methods 1. During this post-installation phase, the two independent reviewers (ES and IB) assessed each app for eligibility, including using the obesogenic screener. A third reviewer was not required to resolve discrepancies.

Measures

All data amassed in the appraisal process were documented in Qualtrics(45).

Demographic data

Two independent reviewers (ES and IB) extracted demographic information for each app included in the appraisal by (1) reviewing the app’s description in the iOS app store and (2) obtaining relevant demographic information by engaging with the apps. The demographic data extracted from the app’s description in the app store included: app name, developer, date of last app update, current version of the app, size of the app in Megabytes (MB), number of users that rated the app, the user rating in the app store (scale of 1 to 5 stars), availability on iPhone and/or iPad and iOS app age rating. The demographic data extracted after interacting with each app included: developer affiliation; whether the app includes ads; the perceived targeted age group; the technical aspects and theoretical strategies incorporated into the app; whether the app aimed to promote nutrition knowledge, skills or both and the areas the app targeted. The reviewers determined the perceived targeted age group by assessing the app’s readability, design and content. For example, apps rated as appropriate for children 4 to 8 years old (pre-kindergarten – 2nd grade) primarily contained pictures but may have had some simple sentences or audio for text (readability), simple/single taps on the iPhone screen (design), minimal pages (design) and easy to understand nutrition information (content)(Reference Soni, Aloba and Morga46). After extracting the data independently, the two reviewers (ES and IB) resolved any discordances.

Quality appraisal using the mobile app rating scale

Two independent reviewers (ES and IB) engaged with the final list of apps for the systematic appraisal for three days using their iPhones. After the third day, they independently assessed the apps’ engagement (i.e. entertainment, customisation, interactivity, fit to target group), information (i.e. quality, quantity, credibility, goals), aesthetic (i.e. graphics, layout, visual appeal) and functional (i.e. performance, navigation, gestural design, ease of use) quality, as well as the apps’ subjective quality using the twenty-three-item Mobile App Rating Scale (MARS)(Reference Stoyanov, Hides and Kavanagh47). The MARS has demonstrated excellent internal consistency (alpha = 0·90) and interrater reliability (intraclass correlation coefficient (ICC) = 0·79)(Reference Stoyanov, Hides and Kavanagh47). Before evaluating each app using the MARS, the independent reviewers watched the YouTube training video provided by the MARS developers(Reference Stoyanov48). In addition to the MARS response criteria, the two reviewers developed and used a guide (Supplementary Methods 2) to standardise their responses and improve their interrater reliability.

The MARS objective quality scale (nineteen items) consists of the following subscales: engagement (five items), functionality (four items), aesthetics (three items) and information (seven items). The MARS subjective quality scale consists of four items in which the raters responded to whether they would recommend the app to people who would benefit from it, use the app and frequency in doing so for the next 12 months, pay for the app and provide an overall rating of the app. Other than the item regarding whether one would pay for the app (Yes, No Maybe), all other items have responses ranging from 1 (indicating lower quality (i.e. inadequate)) to 5 (indicating higher quality (i.e. excellent)), a few items in the information subscale have a ‘N/A’ response option. To evaluate whether the apps had been trialled or tested and published in the scientific literature (a MARS item in the information subscale), three independent reviewers (ES, IB and LF) searched Google Scholar and PubMed for the app names.

Statistical analyses

The apps’ demographic data were summarised using frequencies (percentages) for categorical variables and medians (interquartile ranges) for continuous variables. We calculated the mean score for each MARS objective subscale and the mean score for each overall objective and subjective scale. Per the MARS instructions, questions rated as ‘N/A’ were removed from the mean score calculations. The mean scores were calculated for each rater (ES and IB), and then the average of the two mean scores were recorded as the final value.

Interrater reliability was initially calculated using the first thirteen appraised apps, but the ICC for the MARS items were poor. Thus, ES, IB and LF developed the guide outlined in Supplementary Methods 2 to improve interrater reliability. After using the guide to rerate the first thirteen apps and then the additional eleven apps (for a total of twenty-four apps), the interrater reliability for the overall MARS objective and subjective quality scale scores were excellent ((ICC = 0·92), (ICC = 0·93)), respectively. The ICC for the MARS objective quality subscales were as follows: engagement (ICC = 0·88), functionality (ICC = 0·79), aesthetics (ICC = 0·72) and information (ICC = 0·85).

Results

Search results

A summary of the search and appraisal process is shown in the Fig. 1. In our original search, a total of 1814 links were identified through Google Advanced Search. In our updated search since the original search, 1184 links were identified. After removing duplicates, pre-install screening was used to determine whether the apps met the eligibility criteria. After the pre-install screening, sixty-two apps were downloaded to conduct post-install screening. Thirty-eight apps were excluded due to having primarily obesogenic content (n 32), having no nutrition content (n 1), being nonfunctional (n 3) and having references to alcohol or drugs (n 2). A total of twenty-four apps were included in this systematic appraisal of apps, and no new apps were identified in the updated search that met the eligibility criteria(Reference Zaman4972).

Fig. 1 Protocol for App Store Systematic Reviews Diagram Depicting the Flow of Apps

App characteristics

Per eligibility criteria, all the apps (n 24) were designed for children as end-users, in English, and had food or beverage-related nutrition content that was not solely obesogenic. All the apps were rated as appropriate for individuals 4+ years in the iOS app store, indicating that the apps contained no objectionable material. Additionally, all the apps were available for download on iPhones and iPads. The reviewers determined, based on readability, design and content, that 83 % (20/24) of the apps were appropriate for children 4 to 8 years old (pre-kindergarten – 2nd grade), 33 % (8/24) were suitable for children 9 to 11 years old (3rd–5th grade) and 8 % (2/24) were appropriate for children 12 to 16 years old (6th–10th grade). Only one app was updated within the past year at the installation time. The average size of each app was 77·35 megabytes (MB) (range: 13·5 MB–198·1 MB). The median star rating in the iOS app store was 4 (IQR: 2); however, only two of the apps had more than five users who had provided a star rating. Additionally, 87·5 % (21/24) of the apps were developed by an unknown entity since a developer name was not mentioned on the app page; 71 % (17/24) contained ads; and 75 % (18/24) promoted nutrition skills (i.e. cooking, baking), 13 % (3/24) nutrition knowledge (i.e. naming of fruits and vegetables) and 13 % (3/24) both skills and knowledge. None of the apps have been evaluated for effectiveness on user outcomes, as evidenced by a lack of reports in the peer-reviewed literature.

None of the apps contained any technical features noted in the MARS, including allowing for sharing (i.e. Facebook, Twitter), password protection, requiring log-in, sending reminders or needing web access. However, one app did have an app community/leaderboard. The areas most frequently targeted by the apps included (1) entertainment (i.e. gamification; 96 % (23/24)), (2) skill-building (88 % (21/24)) and (3) food/nutrition knowledge or literacy (21 % (5/24)). The theoretical/background strategies most frequently incorporated into the apps included (1) advice/tips/strategies/skills training (96 % (23/24)) and information/education (25 % (6/24)). A summary of the app characteristics can be found in Table 1, and a description of the individual app characteristics in Table 2.

Table 1 Summary of App characteristics

IQR: interquartile range; yrs.: years; PK: pre-kindergarten.

* Median iOS app store star rating out of twenty-one apps with available data.

Select all that apply, percentages add up to over 100 %.

The following targeted areas, included both in the MARS or added by the study team, were not reflected in any of the apps and were not included in the table: increase happiness/well-being, mindfulness/meditation/relaxation, reduce negative emotions, depression, anxiety/stress, anger, behavior change, alcohol/substance use, relationships, physical health, skill building, goal setting and weight management.

§ The following theoretical/background strategies, included in the MARS, were not reflected in any of the apps and were not included in the table: monitoring/tracking, CBT-Behavioral (positive events), CBT-Cognitive (thought challenging), ACT-Acceptance commitment therapy, mindfulness/meditation, relaxation, gratitude and strengths-based.

Table 2 Individual App characteristics and overall and Subscale mobile App rating scores (n 24)

* Star rating in the app store on a scale of 1.0 to 5.0; all apps were rated by less than or equal to 5 users, except for the ‘Pasta Maker Kids Cook – Free Crazy Star Chef Adventure Girls Kitchen Cooking Games’ app which was rated by 7 users and the ‘Pasta Maker – Kitchen Cooking Chef and Fast Food Game’ app which was rated by 10 users.

MARS objective rating overall scale score, the average of the two individual raters’ scores for each app; App objective quality mean scores are the average of Engagement, Functionality, Aesthetics, and Information subscores.

MARS subjective rating overall scale score, the average of the two individual raters’ scores for each app; Subjective quality (recommending app, intention to use app and frequency in doing so for the next 12 months, if one would pay for the app, and overall rating of the app).

§ N/A indicates one of the following: (1) no users have rated the app; thus, there is no star rating in the app store or (2) the app has not been updated and there is no last update date or version of the app listed in the app store.

Mobile app rating scale results

The apps’ objective quality mean score across the 24 apps was 3·60 (sd: 0·41), where a mean score of 1 indicates ‘inadequate’ and 5 indicates ‘excellent’ quality. The objective quality mean score comprises the four subscales mean scores: engagement, functionality, aesthetics and information. The information subscale had the lowest mean score with a rating of 2·94 (sd: 0·62), indicating that the apps did not contain high-quality information from credible sources. The engagement subscale mean score was 3·20 (sd: 0·41), indicating that the apps were only ‘adequate’ in terms of being fun, engaging, customizable, interactive, and well-targeted to the audience (as defined by MARS) (Reference Stoyanov, Hides and Kavanagh47). The functionality and aesthetics mean scores were higher at 4·24 (sd: 0·47) and 4·03 (sd: 0·51), respectively. Finally, the apps’ subjective quality mean score was rated as 2·10 (sd: 0·90) by the two reviewers, where a mean score of 1 indicates ‘inadequate’ and 5 indicates ‘excellent’ quality. Table 2 provides the objective, subjective scale mean scores and subscale mean scores for each app and all the apps combined.

App food categories

More than 50 % of the apps included foods in each of the following What We Eat in America Food Categories: 2017–2018: protein foods (79 % (19/24)), mixed dishes (54 % (13/24)), grains (63 % (15/24)), fruits (50 % (12/24)), vegetables (92 % (22/24)) and condiments and sauces (63 % (15/24)). Less than 50 % of the apps included foods in each of the following categories: milk and dairy (42 % (10/24)), snacks and sweets (13 % (3/24)), beverages (46 % (11/24)), water (17 % (4/24)), fats and oils (46 % (11/24)) and sugars (13 % (3/24)). We provided the 2017–2018 What We Eat in America food Categories represented in each app as a supplemental table (online Supplementary Table).

Discussion

This review aimed to identify free nutrition-related mobile apps in English and evaluate their information, engagement, aesthetic and functional quality using the MARS. Only twenty-four free nutrition-based apps for children were identified for this review. Most of the apps in this review were designed for children ages 4–8. With obesity increasing in prevalence as children age, there is a significant need for a wide variety of nutrition-based apps to meet the lifespan needs from early childhood to adolescents to promote healthy nutrition(Reference Fryar, Carroll and Afful1). Previous literature has indicated that mobile apps for children can be an effective avenue to enhance diet quality, increase physical activity and reduce BMI in children(Reference Langarizadeh, Sadeghi and As’habi73,Reference Schoeppe, Alley and Van Lippevelde74) . Systematic reviews and meta-analyses of gamified nutrition interventions have demonstrated improvement in important nutritional outcomes, such as the selection of lower-calorie foods, knowledge of healthy foods and increased fruit and vegetable consumption(Reference Suleiman-Martos, García-Lara and Martos-Cabrera75,Reference Yoshida-Montezuma, Ahmed and Ezezika76) . Nonetheless, the literature on nutrition gamification for children and adolescents does not fully describe the content available in the apps, nor has there been an appraisal of their quality.

In this review, most apps focussed on promoting nutrition skills (i.e. cooking and baking). While there is strong evidence that involving children in food preparation and providing them with culinary or cooking skills can predict healthy eating or positive attitudes towards healthy eating, these studies focus on in-person engagement and not on examining the role of gamification in a child’s nutrition practices and health(Reference Nekitsing, Hetherington and Blundell-Birtill77,Reference Muzaffar, Metcalfe and Fiese78) . Due to limited research, it is unclear whether gamification centered on promoting nutrition skills among children is effective in promoting healthy nutrition practices. Nonetheless, there is a need for more nutrition-based app development with a diversity of content to improve not only cooking skills but also nutrition knowledge, attitudes and practices.

Regarding the mobile app quality ratings, while there is still room for improvement, the engagement, functionality and aesthetics mean sub-scores indicate that, on average, the apps were easy to learn and navigate, had a logical flow and visual appeal and were stylistically consistent. However, these apps did not contain evidence-based, credible nutrition information and were mainly skill-based instead of knowledge-based. In a recent study, the MARS was used to evaluate the quality of nutrition-related mobile apps available in China, albeit apps providing dietary guidance to adults. Similar to our study, the majority of apps were designed to assist with cooking, and the information quality score was the lowest among the four subsections of the MARS(Reference Li, Ding and Wang79).

The development of nutrition-related apps to improve nutrition practices among children and adolescents is noteworthy; however, the literature and this study point to the need for more robust approaches to app development. The development process should involve a multidisciplinary team of nutritionists, child health and development experts and graphic designers engaged in human-centered design, which heightens the focus on the needs of the end-user and involves children and adolescents in the intervention development process(Reference Altman, Huang and Breland80).

Strengths and limitations

This review has many strengths and potential limitations that need consideration. The appraisal method is subject to selection bias for a few main reasons, which may limit the generalisability of our findings. We only rated apps suitable for the iPhone, which can limit the generalisability of results for apps found in other mobile operating systems like Android. We only rated apps with content in English; hence, our results are only generalisable to apps in English. Next, the raters for the appraisal are adults, whereas the apps were intended for children as end users. Even though adult caregivers are most likely to choose apps, especially for younger children, adults and children may perceive quality differently. Ideally, we could include children appraisers, as the apps are designed for them; however, developing a child-led appraisal strategy would be challenging since we would need to accommodate varying developmental stages and age groups.

Another limitation was that any apps that included inappropriate content, such as references to drug or alcohol use, profanity or sexually explicit materials, were excluded. However, because these apps were not selected for instalment, it was difficult to assess why they were flagged as containing explicit material. For example, the app could have used alcohol as an example of beverages that should not be consumed, but we did not include it because it was deemed inappropriate.

Finally, although both reviewers (ES: iOS 7 and IB: iOS 6s) used iPhones for this review, the phones used by each reviewer were different. Although there is not much difference between iOS 6s and 7 devices, and thus the anticipated impact of using different phones was minimal, we acknowledge the possible effect this could have on the rating of the apps.

Conclusion

Nutrition-related smartphone apps designed specifically for children and adolescents could serve as helpful tools to promote healthy nutrition and consequently prevent obesity. However, there are few free nutrition apps widely accessible for engagement. Although the apps in this review show promise in providing an engaging experience, this review highlights the need to develop apps with evidence-based nutrition education content that is age-appropriate for children and adolescents and evaluate their effectiveness on health outcomes. We propose accelerating the development of theory-guided apps using a human-centered and co-design approach with children for whom the apps are designed, with evidence-based nutrition content and evaluating the effectiveness on health outcomes.

Acknowledgments

Acknowledgments: The authors would like to thank Americo Amorim for his assistance in helping to develop the search strategy. Authorship: Authors L.F., E.M.S., I.B., and A.P. have made substantial contributions to the conception of the study, and all authors (L.F., E.M.S., I.B., A.P., and N.P.) drafted the article or revised it critically for important intellectual content. Additionally, N.P. provided additional statistical support for data analyses. Ethics of human subject participation: Not Applicable.

Financial support:

EMS-NIH/NHLBI T32 HL007024 Postdoctoral Fellowship in Cardiovascular Epidemiology Institutional Training.

Conflict of interest:

LF has received funding from the Nutrition & Obesity Policy Research Evaluation Network (NOPREN) and the Johns Hopkins Alliance for a Healthier Future to examine digital technology use in the childcare setting and develop an app that includes social-emotional and nutrition games for children. EMS serves as a paid consultant to Corrie Health. IB, AP and NP report no conflicts of interest.

Supplementary material

For supplementary material/s referred to in this article, please visit https://doi.org/10.1017/S1368980023000526

References

Fryar, CD, Carroll, MD & Afful, J (2020) Prevalence of Overweight, Obesity, and Severe Obesity Among Children and Adolescents Aged 2–19 Years: United States, 1963–1965 Through 2017–2018. NCHS Health E-Stats. https://www.cdc.gov/nchs/data/hestat/obesity-child-17-18/obesity-child.htm (accessed February 2022).Google Scholar
Ogden, CL, Carroll, MD, Lawman, HG et al. (2016) Trends in Obesity prevalence among children and adolescents in the United States, 1988–1994 through 2013–2014. JAMA J Am Med Assoc (Internet) 315, 22922299.10.1001/jama.2016.6361CrossRefGoogle ScholarPubMed
National Center for Chronic Disease Prevention and Health Promotion (2022) Poor Nutrition. Centers for Disease Control and Prevention. Published 2022. https://www.cdc.gov/chronicdisease/resources/publications/factsheets/nutrition.htm (accessed March 2023).Google Scholar
Gundersen, C & Seligman, HK (2015) Food insecurity and health outcomes. Health Aff 34, 18301839.CrossRefGoogle ScholarPubMed
Tester, JM, Rosas, LG & Leung, CW (2020) Food insecurity and pediatric obesity: a double whammy in the era of COVID-19. Curr Obes Rep 9, 442450.10.1007/s13679-020-00413-xCrossRefGoogle ScholarPubMed
CDC Centers for Disease Control and Prevention Childhood Obesity (2022) Causes & Consequences (Internet). https://www.cdc.gov/obesity/childhood/causes.html (accessed March 2022).Google Scholar
Jenssen, BP, Kelly, MK, Powell, M et al. (2021) COVID-19 and changes in child obesity. Pediatric (Internet) 147, e2021050123.CrossRefGoogle ScholarPubMed
Browne, NT, Snethen, JA, Greenberg, CS et al. (2021) When pandemics collide: the impact of COVID-19 on childhood obesity. J Pediatr Nurs (Internet) 56, 9098.10.1016/j.pedn.2020.11.004CrossRefGoogle ScholarPubMed
Cuschieri, S & Grech, S (2020) COVID-19: a one-way ticket to a global childhood obesity crisis? J Diabetes Metab Disord 19, 20272030.10.1007/s40200-020-00682-2CrossRefGoogle ScholarPubMed
White, A, Liburd, LC & Coronado, F (2021) Addressing racial and ethnic disparities in COVID-19 among school-aged children: are we doing enough? Prev Chronic Dis 18, E55.CrossRefGoogle Scholar
Kourti, A, Stavridou, A, Panagouli, E et al. (2021) Play behaviors in children during the covid-19 pandemic: a review of the literature. Children 8, 118.10.3390/children8080706CrossRefGoogle ScholarPubMed
Vepsäläinen, H, Skaffari, E, Wojtkowska, K et al. (2022) A mobile app to increase fruit and vegetable acceptance among finnish and polish preschoolers: randomized trial. JMIR Mhealth Uhealth (Internet) 10, e30352.10.2196/30352CrossRefGoogle ScholarPubMed
Ragelienė, T, Aschemann-Witzel, J & Grønhøj, A (2022) Efficacy of a smartphone application-based intervention for encouraging children’s healthy eating in Denmark. Health Promot Int 37, daab081.10.1093/heapro/daab081CrossRefGoogle ScholarPubMed
Quelly, SB, Norris, AE & Dipietro, JL (2016) Impact of mobile apps to combat obesity in children and adolescents: a systematic literature review. J Spec Pediatr Nurs 21, 517.10.1111/jspn.12134CrossRefGoogle ScholarPubMed
Auxier, BYB, Anderson, M, Perrin, A et al. (2020) Parenting Children in the Age of Screens. Pew Research Center (Internet). (November): 1–28. https://www.pewresearch.org/internet/2020/07/28/parenting-children-in-the-age-of-screens/ (accessed February 2022).Google Scholar
Schaeffer, K (2019) Most U.S. Teens Who use Cellphones do it to Pass Time, Connect with Others, Learn New Things (Internet). Pew Research Center. https://www.pewresearch.org/fact-tank/2019/08/23/most-u-s-teens-who-use-cellphones-do-it-to-pass-time-connect-with-others-learn-new-things/ (accessed February 2022).Google Scholar
Hill, DR & Brunvand, S (2020) Gamification: Taking Your Teaching to the Next Level: A Guide for Gamifying your Classroom. K-12 Educ Technol Handb (Internet). 1–14. https://edtechbooks.org/k12handbook/gamification (accessed February 2022).Google Scholar
Institute of Education Sciences National Center for Education Statistics (1996) Nutrition Education in Public Elementary and Secondary Schools (Internet). https://nces.ed.gov/surveys/frss/publications/96852/index.asp?sectionid=3 (accessed February 2022).Google Scholar
Centers for Disease Control and Prevention CDC (2022) Healthy Schools: Nutrition Education (Internet). https://www.cdc.gov/healthyschools/nutrition/school_nutrition_education.htm (accessed January 2022).Google Scholar
Ghelani, DP, Moran, LJ, Johnson, C et al. (2020) Mobile apps for weight management: a review of the latest evidence to inform practice. Front Endocrinol 11, 412.10.3389/fendo.2020.00412CrossRefGoogle ScholarPubMed
Walsh, JC & Groarke, JM (2019) Integrating behavioral science with mobile (mHealth) technology to optimize health behavior change interventions. Eur Psychol 24, 3848.CrossRefGoogle Scholar
Taj, F, Klein, MCA & van Halteren, A (2019) Digital health behavior change technology: bibliometric and scoping review of two decades of research. JMIR mHealth uHealth 7, e13311.CrossRefGoogle ScholarPubMed
Xu, W & Liu, Y (2015) mHealthApps: a repository and database of mobile health apps. JMIR mHealth uHealth (Internet) 3, e28.CrossRefGoogle ScholarPubMed
Zarnowiecki, D, Mauch, CE, Middleton, G et al. (2020) A systematic evaluation of digital nutrition promotion websites and apps for supporting parents to influence children’s nutrition. Int J Behav Nutr Phys Act 17, 17.10.1186/s12966-020-0915-1CrossRefGoogle ScholarPubMed
Marshall, JM, Dunstan, DA & Bartik, W (2020) Apps with maps-anxiety and depression mobile apps with evidence-based frameworks: systematic search of major app stores. JMIR Ment Heal (Internet) 7, e16525.CrossRefGoogle ScholarPubMed
Shea, BJ, Reeves, BC, Wells, G et al. (2017) AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ (Internet) 358, j4008.10.1136/bmj.j4008CrossRefGoogle ScholarPubMed
Moher, D, Liberati, A, Tetzlaff, J et al. (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ (Internet) 339, 332336.10.1136/bmj.b2535CrossRefGoogle ScholarPubMed
Google Google Advanced Search (Internet). https://www.google.com/advanced_search (accessed October 2020).Google Scholar
Grau-Corral, I, Pantoja, PE, Grajales, FJ III et al. (2021) Assessing Apps for health care workers using the ISYScore-Pro Scale: development and validation study. JMIR Mhealth Uhealth (Internet) 9, e17660.10.2196/17660CrossRefGoogle ScholarPubMed
Su, Z, Figueiredo, MC, Jo, J et al. (2021) Analyzing description, user understanding and expectations of AI in mobile health applications. AMIA. Annu Symp proceedings AMIA Symp (Internet) 2020, 11701179.Google ScholarPubMed
Brouwer, D (2020) A non-discrimination principle for rankings in app stores. Internet Policy Rev 9, 127.CrossRefGoogle Scholar
Zdraveska, S (2022) Apple App Store v. Google Play Store (2022 Comparison) (Internet). Cybercrew. https://cybercrew.uk/software/app-store-vs-play-store/ (accessed February 2022).Google Scholar
Chrome Web Store (2020) Linkclump. (Internet). https://chrome.google.com/webstore/detail/linkclump/lfpjkncokllnfokkgpkobnkbkmelfefj?hl=en (accessed October 2020).Google Scholar
Microsoft Corporation (2018) Microsoft Excel (Internet). https://office.microsoft.com/excel (accessed October 2020).Google Scholar
Lee, G & Raghu, TS (2014) Determinants of mobile apps’ success: evidence from the app store market. J Manag Inf Syst 31, 133170.10.2753/MIS0742-1222310206CrossRefGoogle Scholar
Krebs, P & Duncan, DT (2015) Health app use among us mobile phone owners: a national survey. JMIR mHealth uHealth (Internet) 3, e101.CrossRefGoogle ScholarPubMed
Apple App Store (2021) Age Ratings (Internet). https://help.apple.com/app-store-connect/#/dev269f11291 (accessed October 2020).Google Scholar
Bowman, A, Clemens, J, Friday, J et al. (2019) Added Sugars in American Children’s Diet: What We Eat in America, NHANES 2015–2016 (Internet). Food Surveys Research Group. https://www.ars.usda.gov/ARSUserFiles/80400530/pdf/DBrief/26_SourcesofAddedSugarsinChildren’sDiet_1516.pdf (accessed June 2021).Google Scholar
U.S. Department of Agriculture and U.S. Department of Health and Human Services (2020) Dietary Guidelines for Americans, 2020–2025 (Internet). 9th ed. https://www.dietaryguidelines.gov/sites/default/files/2020-12/Dietary_Guidelines_for_Americans_2020-2025.pdf (accessed June 2021).Google Scholar
United States Department of Agriculture What We Eat in America Food Categories: 2017–2018 (Internet). https://www.ars.usda.gov/ARSUserFiles/80400530/pdf/1718/Food_Category_List.pdf (accessed June 2021).Google Scholar
Ward, D Go NAPSACC: Nutrition and Physical Activity Self-Assessment for Child Care (Internet). pp. 1–8. https://gonapsacc.org/uploads/GoNAPSACC_CN_2020_Copyright.pdf (accessed June 2021).Google Scholar
Hoy, M, Goldman, J, Murayi, T et al. (2011) Sodium Intake of the U.S population. Food Surveys Research Group Dietary Data Brief 8. (8): 1–4. https://www.ars.usda.gov/ARSUserFiles/80400530/pdf/DBrief/8_sodium_intakes_0708.pdf (accessed June 2021).Google Scholar
Huth, PJ, Fulgoni, VL, Keast, DR et al. (2013) Major food sources of calories, added sugars, and saturated fat and their contribution to essential nutrient intakes in the U.S. diet: data from the national health and nutrition examination survey (2003–2006). Nutr J (Internet) 12, 1.CrossRefGoogle ScholarPubMed
Martin, C, Sebastian, R, Wilkinson Enns, C et al. (2020) Sweet Foods Consumption by Children in the U.S.: What We Eat in America, NHANES 2015–2018 (Internet). USDA Food Surveys Research Group Dietary Data Brief No. 34. https://www.ars.usda.gov/ARSUserFiles/80400530/pdf/DBrief/34_Sweet_foods_children_1518.pdf (accessed October 2020).Google Scholar
Qualtrics (2005) Qualtrics (Internet). Provo, Utah. https://www.qualtrics.com (accessed October 2020).Google Scholar
Soni, N, Aloba, A, Morga, KS et al. (2019) A Framework of Touchscreen Interaction Design Recommendations for Children (TIDRC): Characterizing the Gap between Research Evidence and Design Practice. Proceedings of the 18th ACM International Conference on Interaction Design and Children, IDC 2019. pp. 419–31. https://dl.acm.org/doi/pdf/10.1145/3311927.3323149 (accessed June 2021).CrossRefGoogle Scholar
Stoyanov, SR, Hides, L, Kavanagh, DJ et al. (2015) Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR mHealth uHealth 3, 19.10.2196/mhealth.3422CrossRefGoogle Scholar
Stoyanov, SR (2016) MARS Training Video (Internet). Youtube. https://www.youtube.com/watch?v=25vBwJQIOcE (accessed July 2020).Google Scholar
Pradissook, A (2015) Chef Cooking-Baby Cotton Candy Cooking Making and Dessert Make Games for Kids (Internet). https://itunes.apple.com/ca/app/chef-cooking-baby-cotton-candy/id989685685?preserveScrollPosition=true (accessed October 2020).Google Scholar
Gadhiya, A (2017) Cooking Breakfast Maker (Internet). https://apps.apple.com/gb/app/cooking-breakfast-maker/id1254800970 (accessed October 2020).Google Scholar
Haider, K Cooking Court Food Fever (Internet). https://apps.apple.com/us/app/cooking-court-food-fever/id1218143689 (accessed October 2020).Google Scholar
Li, W (2017) Cooking Girl, Amy and Cooking Kids Game (Internet). https://itunes.apple.com/ae/app/cooking-girl-amy-and-cooking-kids-game/id1160580506 (accessed October 2020).Google Scholar
The First Word (2017) Cooking Time 2- Sushi Make and Preschool Kids Game (Internet). https://itunes.apple.com/tt/app/cooking-time-2-sushi-make-preschool-kids-games/id579945087?mt=8 (accessed October 2020).Google Scholar
National Restaurant Association (2016) FoodLeap (Internet). https://apps.apple.com/ae/app/foodleap/id990176084 (accessed October 2020).Google Scholar
Mumtaz, K (2016) Fresh Salad Bar: Healthy Green Food Making Game for Education and Learning (Internet). https://apps.apple.com/lv/app/fresh-salad-bar-healthy-green-food-making-game-for/id1112436952 (accessed October 2020).Google Scholar
Tan, K (2015) Health and Nutrition Quiz for Kids (Internet). https://apps.apple.com/us/app/apple-store/id1033111923?platform=iphone&preserveScrollPosition=true (accessed October 2020).Google Scholar
Zaman, Q (2015) Hot Soup Maker- Crazy Chef with Health Food Kitchen Adventure Spicy Cooking Fever (Internet). https://itunes.apple.com/ca/app/hot-soup-maker-crazy-chef-health-food-kitchen-adventure/id1005133748?preserveScrollPosition=true (accessed October 2020).Google Scholar
Jelani, S (2017) Ice Candy Fever Cooking Game – Cool Kids Food Chef (Internet). https://itunes.apple.com/pl/app/ice-candy-fever-cooking-game-cool-kids-food-chef/id1185874990?mt=8 (accessed October 2020).Google Scholar
Fareed, H (2016) Ice Coffee Maker - Make Creamy Dessert in this Cooking Fever Game for Kids (Internet). https://itunes.apple.com/bm/app/ice-coffee-maker-make-creamy-dessert-in-this-cooking/id1062664939 (accessed October 2020).Google Scholar
Kiatpattaranan, S (2015) Kid Cooking Food: The Funny Restaurant Simulator Free Games (Internet). https://itunes.apple.com/dk/app/kid-cooking-food-funny-restaurant/id1020887653?mt=8 (accessed October 2020).Google Scholar
Frassi, S Kitchen Kids Cooking Chef: Let’s Cook the Most Delicious Food (Internet). https://itunes.apple.com/ch/app/kitchen-kids-cooking-chef-lets-cook-the-most-delicious-food/id1131298302?l=en&mt=8 (accessed October 2020).Google Scholar
Munoz, S Mr J Cooks Food, Free Cooking Kids Game (Internet). https://itunes.apple.com/lv/app/mr-j-cooks-food-free-cooking-kids-game/id1188242217?mt=8 (accessed October 2020).Google Scholar
Zaman, Q (2015) Noodle Maker – Crazy Cooking Adventure for Little Kids Chef Master. https://itunes.apple.com/kr/app/noodle-maker-crazy-cooking-adventure-for-little-kids/id1005171793?l=en&mt=8 (accessed October 2020).Google Scholar
Awais, A & Khan, A (2016) Pasta Maker Kids Cook – Free Crazy Star Chef Adventure Girls Kitchen Cooking Games (Internet). https://itunes.apple.com/tr/app/pasta-maker-kids-cook-free-crazy-star-chef-adventure/id1125059058?mt=8 (accessed October 2020).Google Scholar
Kids Fun Plus (2016) Pasta Maker – Kitchen Cooking Chef and Fast Food Game (Internet). https://itunes.apple.com/kz/app/pasta-maker-kitchen-cooking-chef-and-fast-food-game/id990920870?mt=8 (accessed October 2020).Google Scholar
Zaman, Q (2016) Sky Burger Maker Cooking Fever – Kids Games (Internet). https://itunes.apple.com/in/app/sky-burger-maker-cooking-fever/id1149448278?mt=8 (accessed October 2020).Google Scholar
Fareed, H (2016) Spaghetti Maker – Little Kids Cook Chinese Food in this Cooking Fever Game. https://itunes.apple.com/jo/app/spaghetti-maker-little-kids-cook-chinese-food-in-this/id1073976652 (accessed October 2020).Google Scholar
Mahmood, K Street Food Cooking Mania – Fun Kitchen Management (Internet). https://itunes.apple.com/vn/app/street-food-cooking-mania-fun-kitchen-management/id1160167780?mt=8 (accessed October 2020).Google Scholar
Red Card Studios LLC (2016) Veggie Bottoms (Internet). https://apps.apple.com/dk/app/veggie-bottoms-hd-healthy-eating-made-fun-for-kids/id626569693?l=da (accessed October 2020).Google Scholar
Famobi (2016) Zucchini Spaghetti Bolognese- Vegan Cooking Recipe with Emma: Game for Kids (Internet). https://itunes.apple.com/ae/app/zucchini-spaghetti-bolognese-vegan-cooking-recipe-emma/id983923650?mt=8 (accessed October 2020).Google Scholar
Langarizadeh, M, Sadeghi, M, As’habi, A et al. (2021) Mobile apps for weight management in children and adolescents; An updated systematic review. Patient Educ Couns 104, 21812188.CrossRefGoogle ScholarPubMed
Schoeppe, S, Alley, S, Van Lippevelde, W et al. (2016) Efficacy of interventions that use apps to improve diet, physical activity and sedentary behaviour: a systematic review. Int J Behav Nutr Phys Act (Internet) 13, 126.CrossRefGoogle ScholarPubMed
Suleiman-Martos, N, García-Lara, RA, Martos-Cabrera, MB et al. (2021) Gamification for the improvement of diet, nutritional habits, gamification for the improvement of diet, nutritional habits, and body composition in children and adolescents: a systematic review and meta-analysis. Nutrients 13, 117.CrossRefGoogle ScholarPubMed
Yoshida-Montezuma, Y, Ahmed, M & Ezezika, O (2020) Does gamification improve fruit and vegetable intake in adolescents? a systematic review. Nutr Health 26, 347366.10.1177/0260106020936143CrossRefGoogle ScholarPubMed
Nekitsing, C, Hetherington, MM & Blundell-Birtill, P (2018) Developing healthy food preferences in preschool children through taste exposure, sensory learning, and nutrition education. Curr Obes Rep 7, 6067.CrossRefGoogle ScholarPubMed
Muzaffar, H, Metcalfe, JJ & Fiese, B (2018) Narrative review of culinary interventions with children in schools to promote healthy eating: directions for future research and practice. Curr Dev Nutr 2, nzy016.CrossRefGoogle ScholarPubMed
Li, Y, Ding, J, Wang, Y et al. (2019) Nutrition-related mobile apps in the China app store: assessment of functionality and quality. JMIR mHealth uHealth 7, 111.CrossRefGoogle ScholarPubMed
Altman, M, Huang, TTK & Breland, JY (2018) Design thinking in health care. Prev Chronic Dis (Internet) 15, E117.CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1 Protocol for App Store Systematic Reviews Diagram Depicting the Flow of Apps

Figure 1

Table 1 Summary of App characteristics

Figure 2

Table 2 Individual App characteristics and overall and Subscale mobile App rating scores (n 24)

Supplementary material: File

Francis et al. supplementary material

Table S1

Download Francis et al. supplementary material(File)
File 27.4 KB
Supplementary material: File

Francis et al. supplementary material

Francis et al. supplementary material 2

Download Francis et al. supplementary material(File)
File 46.3 KB