Hostname: page-component-cd9895bd7-lnqnp Total loading time: 0 Render date: 2024-12-22T14:54:16.348Z Has data issue: false hasContentIssue false

Strategies for online personalised nutrition advice employed in the development of the eNutri web app

Published online by Cambridge University Press:  18 December 2018

Rodrigo Zenun Franco
Affiliation:
Biomedical Engineering Section, School of Biological Sciences, University of Reading, Reading RG6 6AY, UK
Rosalind Fallaize
Affiliation:
Hugh Sinclair Unit of Human Nutrition, University of Reading, Reading RG6 6AH, UK
Faustina Hwang
Affiliation:
Biomedical Engineering Section, School of Biological Sciences, University of Reading, Reading RG6 6AY, UK
Julie A. Lovegrove*
Affiliation:
Hugh Sinclair Unit of Human Nutrition, University of Reading, Reading RG6 6AH, UK
*
*Corresponding author: Julie A. Lovegrove, fax +44 1189310080, email [email protected]
Rights & Permissions [Opens in a new window]

Abstract

The internet has considerable potential to improve health-related food choice at low-cost. Online solutions in this field can be deployed quickly and at very low cost, especially if they are not dependent on bespoke devices or offline processes such as the provision and analysis of biological samples. One key challenge is the automated delivery of personalised dietary advice in a replicable, scalable and inexpensive way, using valid nutrition assessment methods and effective recommendations. We have developed a web-based personalised nutrition system (eNutri) which assesses dietary intake using a validated graphical FFQ and provides personalised food-based dietary advice automatically. Its effectiveness was evaluated during an online randomised controlled trial dietary intervention (EatWellUK study) in which personalised dietary advice was compared with general population recommendations (control) delivered online. The present paper presents a review of literature relevant to this work, and describes the strategies used during the development of the eNutri app. Its design and source code have been made publicly available under a permissive open source license, so that other researchers and organisations can benefit from this work. In a context where personalised diet advice has great potential for health promotion and disease prevention at-scale and yet is not currently being offered in the most popular mobile apps, the strategies and approaches described in the present paper can help to inform and advance the design and development of technologies for personalised nutrition.

Type
Conference on ‘Getting energy balance right’
Copyright
Copyright © The Authors 2018 

The general recommendations for addressing non-communicable diseases are related to lifestyle changes, mainly encouraging healthy diets and physical activity(1). The majority of face-to-face nutritional consultation in public services is available only to people with a diagnosed condition such as diabetes or obesity. For people without a diagnosed condition, preventive initiatives are focused on generalised public guidelines only, such as the five-a-day campaign in the UK, which aims to encourage a minimum consumption of five portions of fruit or vegetables daily(Reference Capacci and Mazzocchi2). Internet technologies offer considerable potential for delivering online personalised nutrition advice at-scale, however, they need to fulfil a number of requisites in order to foster wide uptake: reproducibility, scalability, security and usability.

Background

We have developed a web-based personalised nutrition system (eNutri) which assesses dietary intake using a validated graphical FFQ and provides personalised food-based dietary advice automatically(Reference Zenun Franco, Fallaize and Lovegrove3). The next subsections present a review of technologies used for nutrition assessment and recommendation, how they were used in previous online nutrition interventions and the rationale behind the eNutri app development.

Nutrition assessment methods

Valid dietary intake recording is key for nutritional intervention. The methods used for collecting food intake data can be classified in a number of ways. Based on the time of the collection, retrospective methods, such as the 24-h recall (24HR), require memory for recollection of foods eaten. In contrast, prospective methods require diet reporting as food is consumed, acting as food diaries.

An important and long-established retrospective nutrition assessment method is the FFQ. A FFQ is based on a list of popular food items in a specific region, and typically contains about 100 items(Reference Molag4). FFQ have some accuracy limitations (e.g. energy estimation) but are more appropriate for initial dietary assessment for the purposes of personalised nutrition, because this method captures longer-term patterns in the diet. It has been used in epidemiological studies for decades, for example, the European Prospective Investigation into Cancer and Nutrition (EPIC) study, one of the largest cohort studies in the world with more than half a million participants recruited across ten European countries. The UK version of this FFQ is known as the EPIC-Norfolk FFQ(Reference Welch, Luben and Khaw5), which was adapted for use in the Food4me project(Reference Forster, Fallaize and Gallagher6), the largest study (n 1540) on personalised nutrition at the time of writing this review.

Diet quality scores

Most public nutrition campaigns aim to improve diets at population level through qualitative or simplified quantitative approaches, such as the Eatwell guide in the UK(7). Similarly, food pyramid guides have been used to indicate the relative proportions of food groups (e.g. vegetables, salad and fruit v. fats, spreads and oils) that make up a balanced diet(Reference Davis, Britten and Myers8). These tools are important but mainly designed to offer a visualisation of a balanced diet, and do not easily lend themselves to a computational analysis of the diet. In order to propose a more quantitative analysis of a dietary intake, indexes of diet quality have been developed over the past decades. Some focus on local guidelines and others on specific target groups or diseases. A comprehensive report containing existing indexes of diet quality was published in 2005(Reference Waijers and Feskens9).

The Healthy Eating Index (HEI), revised in 2010(Reference Guenther, Casavale and Reedy10), was developed by the United States Department of Agriculture. In some cases, specific indexes have been created to address particular diseases, such as the alternative HEI (AHEI) that predicts the risk of chronic diseases(Reference Chiuve, Fung and Rimm11). The AHEI calculations are clearly defined and quantitative(Reference Chiuve, Fung and Rimm11), making them well-suited for implementation in software. Furthermore, this index can be used with the data derived from different dietary assessment methods such as 24HR or FFQ.

Online personalised nutrition

Tailoring plays an important role in health interventions(Reference Noar, Benac and Harris12, Reference Hawkins, Kreuter and Resnicow13) and there is an interest amongst end-users in receiving personalised nutrition advice(Reference Wendel, Dellaert and Ronteltap14, Reference Livingstone, Celis-Morales and Navas-Carretero15). Some studies are investigating how to personalise nutritional guidance for more effective behaviour change(Reference Celis-Morales, Lara and Mathers16). The Food4Me study was designed to determine the efficacy of different levels of personalised nutrition: based on diet intake alone; diet and phenotypic biomarkers; and diet, phenotype and genotype. Results showed that personalisation of food-based dietary advice based on an individual's dietary intake was more effective than generic public health advice, although in that study, no further benefit resulted from the addition of phenotypic or genetic advice(Reference Celis-Morales, Livingstone and Marsaux17, Reference Ryan, O'Donovan and Forster18). The Food4Me dietary advice was based on a decision tree executed manually by researchers during the study to create a report that was sent via e-mail. This decision tree was subsequently automated(Reference Forster, Walsh and Donovan19), but their details have not been published. The lack of transparency in reporting nutrition interventions makes the reproducibility and comparison between studies more challenging and the improvements in this field slower. This difficulty was reported in 2017 by Warner et al. in a systematic review of telehealth-delivered dietary intervention trials(Reference Warner, Kelly and Reidlinger20).

Technologies for recording dietary intake

Nutrition assessment methods are traditionally paper-based, and their administration and analysis are time consuming and more expensive than digital methods(Reference Bingham, Welch and McTaggart21). Besides the faster and easier processing of data input, computerised methods bring the advantage of immediate results. However, the interest for digitalising the recording of dietary intake is not recent. An overview of computerised dietary assessment programmes published in 2005 discussed twenty-nine programmes designed to be used by health professionals or in research(Reference Probst and Tapsell22). They used one or two of the following nutrition assessment methods: food record (n 13), diet history (n 8), FFQ (n 5) and 24HR (n 5).

Prospective nutrition assessment methods (e.g. estimated food diary), usually offer a feature to search for the food items in a database. Although more convenient for the user than inserting the information manually from paper, these repetitive searches are still time consuming. Besides the fact that a single food diary may contain more than twenty food items, the recording of dietary intake using these methods still require logging of the quantity (e.g. two bananas) and the weight. Depending on the food item, the weight may be derived from typical household portions, for example a teaspoon of sugar. However, some items present greater challenges for weight estimation. The end user (i.e. citizen/patient) normally does not know the weight of a banana and the text-based units (e.g. small, medium, large) may not be enough to accurately assess portion weight without food images. Furthermore, in order to increase the successful response rate during food searches, system designers may want to increase the size of the food database, so that a more specific search may be conducted (e.g. a specific pizza brand), but this may decrease the quality of the food composition database supporting the nutrient analysis (i.e. incomplete or less reliable nutrient data for these very specific items, especially branded foods). This is due to the fact that typical food composition tables do not contain all the food items available in a specific country, but only generic versions (e.g. soft drink) of popular items (e.g. coke)(23).

These systems started to gain popularity in the internet age and are now very popular not only among nutrition professionals(Reference Chen, Lieffers and Bauman24) but also among the general population(Reference Franco, Fallaize and Lovegrove25). Due to this burden of data input and in an attempt to make these systems more acceptable, some emerging technologies have been considered in order to replace the textual search, mainly using image recognition and natural language processing. There are some open challenges in terms of accuracy of these technologies in this field, and the next subsections will discuss some systems using traditional technologies (food selection and search) and also how more advanced technologies can bring improvement, increasing the convenience of dietary intake recording.

Established technologies

In terms of online FFQ, the first online versions presented simple tables with food names in the rows and frequencies in the columns(Reference Forster, Fallaize and Gallagher26), very similar to the paper-based versions(Reference Mulligan, Luben and Bhaniani27). Some paper-based FFQ present images for the participants to select the portion sizes. This same strategy was replicated in the digital domain during the development of the Graphical Food Frequency System(Reference Kristal, Kolar and Fisher28).

The presentation of many frequency options and a few images to the users is challenging on small screen devices such as smartphones. The completion process is very repetitive, which may decrease the user satisfaction with the system. Another potential usability challenge is the presentation of the frequency options, since they do not necessarily all use the same units (e.g. two monthly, three weekly, one daily), making the decision-making process more difficult. The online Food4Me FFQ presented three food images together with seven radio buttons for the user to select the portion size (i.e. very small, small, small/medium, medium, medium/large, large, very large)(Reference Forster, Fallaize and Gallagher6). Both the small radio buttons and the number of options presented simultaneously on the screen are not appropriate for smartphones. In addition, the Food4Me web design was not responsive, that is, it did not adapt to the screen size of the device. The visual design and layout of the FFQ options and their impact on usability was a research gap explored during the current project.

One project using 24HR is the ASA24(Reference Subar, Kirkpatrick and Mittl29), an automated self-administered system developed by the American National Cancer Institute. Three UK-based projects also used the 24HR method: Oxford WebQ(Reference Liu, Young and Crowe30), Intake24(Reference Delve, Simpson and Adamson31) and MyFood24(Reference Carter, Albar and Morris32, Reference Carter, Albar and Morris33). This method is able to capture how a dietary intake is distributed across meals but does not contain much information about food patterns and frequencies over a longer time period. A 24HR system can be adapted to work as a food diary, collecting dietary intake prospectively. For instance, MyFood24 can be used either retrospectively or prospectively.

A number of popular nutrition-related mobile apps, currently available for download, use a nutrition assessment strategy based on food diaries(Reference Franco, Fallaize and Lovegrove25). The aim of collecting detailed information about food consumption sounds promising, but it also demands time and discipline from users(Reference Thompson, Subar and Loria34). In order to simplify this process, some investigators have proposed alternatives such as the POND (pattern-oriented nutrition diary), which is a Food Index-Based Nutrition Diary(Reference Andrew, Borriello and Fogarty35). This study explored some alternatives to the food lookup (text search), using for example the ‘ + 1 button’ for items previously inserted (i.e. common items).

Different nutrition assessment methods can be combined during dietary intake recording, in order to increase the nutrient accuracy and also collect different aspect of the information needed (e.g. time of the meals and consumption patterns). A recent publication (2017) shows a new web-based tool (Foodbook24) which combines a 24HR, a FFQ and a supplementary questionnaire(Reference Timon, Blain and McNulty36). To improve the food and drink search, tags were applied in 484 out of the 751 items, so that brand names and misspellings could be linked to a similar food item. With these searchable tags, a specific food item may return in the search even if its name was not inserted correctly. For instance, the tag ‘Coca-Cola’ could be attached to coke, making both terms indexed in the search.

Inclusivity is another important aspect to be considered in public nutrition strategies. The NANA (Novel Assessment of Nutrition and Ageing) project included older adults in the design of a system specific for this population. The existing version of this system was successfully tested with older adults and validated from a nutritional perspective. It was a custom software app intended to be used off-line, and it involved the use of a camera and was not designed to provide feedback or advice to the users(Reference Astell, Adlam and Hwang37Reference Gilhooly39).

These studies propose some alternatives to established digital methods that still face many usability challenges. Most of the published studies in this field concentrate on the nutritional validity (accuracy against a gold standard method), but there is a lack of studies exploring how to increase the user acceptance of these digital methods. The amount of effort required to use these tools in relation to the perceived benefit from the user (self-monitoring or personalised nutrition advice) is one of the trade-offs that motivates this current work.

Emerging technologies

The need for technological innovation in dietary assessment has been reported in academic publications(Reference Thompson, Subar and Loria34). The main challenges are combining improvement in accuracy of assessment and user acceptance. One possible way to make progress in this trade-off is to propose more pervasive technologies, to improve user acceptability, decreasing the burden for users. A comprehensive review of digital methods was published in 2013 and may serve as a reference for the main emerging technologies applied in this field in recent years(Reference Stumbo40).

Food image recognition is perhaps the most promising technology for bringing convenience to dietary recording in a very scalable way since smartphones with cameras have become widespread. Some studies are focused on food recognition(Reference Probst, Nguyen and Tran41, Reference Martin, Nicklas and Gunturk42) and Google has recently announced a research project named Im2calories in this area(Reference Meyers, Johnston and Rathod43). These experiments train the systems based on limited menus, from restaurants or schools, and try to expand their applicability to new contexts, but they still have unsatisfactory accuracy. To design and develop a system that could recognise foods and estimate their weights in any context, including home-made meals, is still an open challenge.

Some of the difficulties in food recognition are related to hidden foods on the plates as well as depth and volume estimation. Some projects have used laser beams to overcome this difficulty(Reference Stumbo40), although the use of extra hardware makes the scalability of these solutions less promising for the immediate future. Similar scalability challenges occur with solutions proposing to use wearables for automatic dietary monitoring(Reference Schiboni and Amft44).

Natural language processing has also been used(Reference Korpusik and Glass45Reference Lacson and Long47), but still without significant results as a stand-alone input method and without evidence from experiments with end users recording food diaries, for example. This technology could potentially be combined with image recognition in order to increase its accuracy. For instance, a smartphone user could take a food image and record the name of the food items in the meal, perhaps with some estimation of portion sizes. As mentioned in the previous section, new assessment methods have to be validated against independent methods (e.g. weighed food records). No validation study using natural language processing was found in the literature.

Another proposal for addressing the lack of trained professionals for dietary assessment utilised crowdsourcing of untrained workers to estimate energy and macronutrients of photographs(Reference Noronha, Hysen and Zhang48). This strategy could increase the scalability of nutrition assessment solutions, but probably not enough to support free or low-cost applications to the final users due to the number of manual transactions.

Technologies for nutrition recommendation

After collecting information on dietary intake, a system would need to have a basis (e.g. a set of rules or a knowledge base) for a recommendation decision engine. One of the main challenges in this field is how to train these systems without databases of clinical nutrition recommendations being available. This might be the main reason for the scarcity of tools for nutrition recommendations. Because of this, the following subsections present a diversity of tools applied in the nutrition field, not only directly to online personalised nutrition advice.

Menu and meal planning

The use of computational methods for supporting nutritional planning has been investigated for some time. The need of meeting nutritional requirements via a vast number of possible combinations of foods opens an opportunity for the use of computers. Mixed integer linear programming was proposed as a possible solution for this in 1993, based on the Simplex algorithm, considering nutrients and prices(Reference Sklan and Dariel49). Besides meeting the nutritional guidelines, it is imperative to recommend meals that individuals will find acceptable. This challenge was presented by Buisson et al. in 2003(Reference Buisson and Garel50) and further elaborated upon in a paper presenting Nutri-Educ software in 2008(Reference Buisson51). Based on the nutrition literature, they were aware that a solution would need to propose a well-balanced diet that was not very different from a person's current diet. Improvements would need to be introduced gradually, in order to have good user acceptance. With this in mind, they stated that the current meal is linked to similar meals via addition, deletion or portion modifications. Their solution was to consider this state space as a graph, in which nodes were possible meals and edges between nodes the acceptable transformations. The search strategy consisted of finding an acceptable meal, meeting the nutritional recommendations, as close as possible to the initial meal(Reference Buisson51).

Artificial intelligence approaches, such as case-based reasoning, have also been proposed for planning menus(Reference Ravana, Rahman and Chan52Reference Petot, Marling and Sterling54). Some of these systems were designed to be used by dietitians(Reference Ravana, Rahman and Chan52, Reference Khan and Hoffmann53) who predefined the menus to be selected via CBR based on a number of variables such as age and sex. Khan et al. proposed to use ripple-down rules to create the knowledge base through a direct system interaction while the domain expert is accomplishing their tasks of constructing a diet for a given client(Reference Khan and Hoffmann53). However, in consultations between patients/individuals and dietitians/nutritionists the decision-making process for dietary change advice is more complex, with consideration of usual dietary habits in the context of the patient's/individual's preferences are used for optimum advice. Yet, user preference is not necessarily the optimal goal in nutrition recommender systems, as the preferred diets are often unhealthy. That is a limitation of recommender systems which are based on recipes collected from the internet and their reviews(Reference Harvey, Ludwig and Elsweiler55).

The usual nutritional recommendations provided by nutrition professionals take into account a number of important variables, such as age, sex, dietary restrictions and lifestyle. Some specific groups (e.g. older adults, vegans) need to receive specialised advice. Hence, technology based systems also need to have similar levels of personalisation. An example of such a system is described in the paper ‘Nutrition for Elder Care: a nutritional semantic recommender system for the elderly’, whose recommendations take into account participants’ preferences(Reference Espín, Hurtado and Noguera56). This paper, published in April 2016, describes the system design and the ontology supporting the recommender system. The system takes into account demographic data (e.g. sex), physical characteristics (e.g. weight and height), nutritional state (e.g. malnourished) and also some responses from an FFQ without portion sizes. The aim of their system is to recommend variations of pre-defined diet plans, instead of modifications to the person's current diet.

These approaches are very useful when there are pre-defined meals and diets (e.g. hospitals), but they can result in proposed diets that are very different from the current diet, making the goal harder to achieve by users. These techniques applied to tailoring daily menus are not directly applicable to creating personalised nutrition advice that is comparable to a nutritional consultation. The next subsection will present dietary modelling tools, which were closer to the final aim of this project.

Dietary modelling tools

For modelling well-balanced diets, the target is generally to balance the food groups (fruit, vegetables, etc.) and distribution of nutrients. A recent study used nonlinear constraint optimisation techniques to design a tool for standardising the background diet of participants during a dietary randomised controlled trial (RCT)(Reference Probst, Morrison and Sullivan57). A constraint is a function resulting in a Boolean output (i.e. true/false), which is true if the combination of all values is allowed and false otherwise. An objective function results in a set of solutions that are optimal with respect to the objectives, during the constraint optimisation process. The users of this tool (likely dietitians) enter the macronutrients (fat, carbohydrate and protein) and food groups serving targets (e.g. five servings of vegetables) and participant details (height, weight, age and sex) so that the tool can calculate the estimated energy requirement. After this step, using a reference food composition database and also pooled baseline food intake data from completed trials before intervention, the tool solves the optimisation problem and returns to the user their target servings per food group to meet the trial requirements suited to each participant. This solution is possible because the macronutrient energy densities are constant (e.g. fat contains 37·66 kJ/g), such that the tool needs to minimise the difference (i.e. Euclidean distance) between the target and calculated macronutrient values, varying the possible servings per food group(Reference Probst, Morrison and Sullivan57).

The approaches used by most of the existing systems for checking the outputs against the references are discrete. For instance, if the reference nutrient intake for vitamin D in the UK is 10 μg and an individual is consuming 9·9 μg, a system could indicate, based on a specific rule, that this specific target was not met using a binary evaluation. However, the decision-making process for this type of evaluation is not discrete when completed by domain experts (e.g. dietitians). Human intuition would evaluate this hypothetical scenario as something similar to ‘almost meeting the recommendation’ or ‘very close to the recommendation’, but this rationale is not captured using Boolean logic. This fact motivated a number of researchers to investigate the possibility of doing this analysis using fuzzy logic(Reference Buisson51, Reference Lee, Wang and Lan58Reference Wang, Kurozumi and Kawaguchi61), in which the possible values are not only true or false, but a number between 0 and 1.

Fuzzy logic for nutritional analysis

Lee et al. proposed an ‘Adaptive personalized diet linguistic recommendation mechanism based on type-2 fuzzy sets and genetic fuzzy markup language’(Reference Lee, Wang and Lan58) in 2015. Taking into account nutritional guidelines (e.g. recommended percentage of energy from fat in a diet) and knowledge from domain experts, it was possible, for instance, to model the fuzziness of percentage of energy from fat. When combining opinions from different domain experts, it was possible to model how those words (low, medium and high) were perceived differently by each expert.

Using the percentage of macronutrients (fat, carbohydrates and protein), the energy ratio and food group balance obtained from the food pyramid, it was possible to compute the diet health level (i.e. very low, low, etc.) from the domain expert and the fuzzy system, as well as the degree to which they matched. For the whole diet sample (n 160) the matching accuracy was 55 % before training, but after learning using genetic algorithms, it increased to about 75 %. This important study only evaluated one variable (diet health level), but this approach could be expanded to more complex systems as long as evaluation from domain experts could be collected also for other aspects of the diet, including nutrients.

One important aspect of the fuzzy logic approach is that real-life nutrition recommendations are more based on words (linguistic variables) than numbers. It seems more sensible to compute with words than numbers in order to construct a mathematical solution for the nutrition decision-making process(Reference Mendel, Zadeh and Trillas62). That is the main motivation for fuzzy logic in this context. Regarding evolutionary algorithms (e.g. genetic algorithms), an article published in 2014 confirms the small influence of this field on nutrition recommendation systems and indicates how promising this application could be(Reference AlFayoumi, Hegazy and Belal63).

Technologies used in remotely delivered nutrition interventions

There are a variety of systems for diet self-monitoring and for use by nutrition professionals to create tailored feedback, however the use of technology in nutrition interventions is limited, as highlighted by a 2018 systematic review and meta-analysis of remotely delivered interventions using self-monitoring or tailored feedback to change dietary behaviour(Reference Teasdale, Elhussein and Butcher64). This review considered any type of remote method, including printed material, text messages, CD-ROM and phone calls. Its objective was to analyse if remotely delivered standalone (i.e. no human contact) interventions were effective at changing eating behaviours(Reference Teasdale, Elhussein and Butcher64). This systematic review identified twenty-six studies (involving 21 262 participants), between 1990 and 2017. Of these twenty-six interventions, eleven used some type of computer technology for delivering the feedback. Their technological platforms are shown in Table 1.

Table 1. Technologies and general information of remotely delivered nutrition interventions

Source: Adapted from Teasdale et al. (Reference Teasdale, Elhussein and Butcher64). Considering only interventions using computer technology and classifying these systems.

Two interventions used a French online service (Minitel) which is no longer available. Another outdated technology, a personal digital assistant, was used in 2008(Reference Teasdale, Elhussein and Butcher64). The study conducted by Campbell et al. did not have human contact during the nutritional feedback but used software installed in the offices where the study was conducted(Reference Campbell, Honess-Morreale and Farrell65). These technologies are very different to the modern web apps in terms of design and development. Huang et al. investigated the influence of dietary advice during online grocery shopping.

The trial reported by Mummah et al. in 2016 was a pilot (n 17) with iPhone users to encourage vegetable consumption in overweight adults. They developed a fully automated theory driven app (called Vegethon) enabling self-monitoring of vegetable consumption, goal setting, feedback and social comparison(Reference Mummah, Mathur and King66). Subsequent analysis in the literature showed that a larger study (n 135) was conducted after the pilot. They used two nutrition assessment methods (FFQ and 24HR) and the results show a significantly greater daily vegetable consumption in the intervention v. control condition (2·0 servings for FFQ; and 1·0 serving for 24HR). The methodology and outcomes were reported in detail(Reference Mummah, Robinson and Mathur67), but without details of the Vegethon app. It was published in the Apple app store but not made publicly available to other software developers (i.e. open source).

In the study conducted by Alexander et al. in 2010, three arms were used with the following materials: an untailored control website; a tailored website; or the tailored website plus motivational interviewing counselling delivered via e-mail(Reference Alexander, McClure and Calvi68). This RCT was conducted between 2005 and 2006 and the details of the web app were not provided, but there is a publication with the results of a focus group conducted prior to the RCT, in order to collect some features preferred for a web-based educational intervention(Reference Rolnick, Calvi and Heimendinger69). The FFQ used in this RCT contained only two items (fruit and vegetable) and the rationale for tailoring the advice was not detailed.

The intervention conducted in the Netherlands by Springvloet et al.(Reference Springvloet, Lechner and de Vries70) used a sixty-six-item online FFQ to assess the intake of fruit, vegetables, high-energy snacks and saturated fat. Each of these had a specific module in the website, so that participants could read about these food items, check availability and prices in their supermarket, before setting a personal goal and making action plans. Besides the traditional individual cognitive elements (knowledge, awareness, attitude, self-efficacy) used in health interventions, this study tailored the goal setting using additional variables such as self-regulation processes and environmental-level factors (e.g. perception of availability and prices of healthy food products in supermarkets). The treatment effects provided another set of evidence of the better efficacy of tailored advice in comparison with generalised population advice(Reference Springvloet, Lechner and de Vries70). This study may reinforce the importance of using validated behaviour change techniques in health interventions, taking into account that the rationale of the advice was elementary (recommendations) and the users were asked to set their personal targets. Tapper et al. measured the treatment effect of a healthy eating programme on consumption of fruit and vegetables, saturated fat, and added sugar, via a 6-month RCT. The website homepage was presented using a screenshot, but without further details from a technological perspective(Reference Tapper, Jiga-Boy and Maio71).

The Food4Me project(Reference Celis-Morales, Livingstone and Marsaux17) has been used as the main reference of personalised nutrition intervention throughout this project (Table 1). It aimed to improve seven key dietary outcomes (fruit, vegetables, whole grains, oily fish, red meat, salt and total fat), using an online FFQ for nutrition assessment with personalised food-based advice given on the three outcomes which were furthest from the recommended target intake. It was the broadest study in terms of targeting improvements in many food groups simultaneously.

Furthermore, as shown in Table 1, only five interventions used either web or native apps, and the number of interventions conducted in the past 10 years was small (n 6). The analysis of the technologies and methods used in these interventions highlights that there are novel contributions to be made in terms of improving the user acceptance and effectiveness of similar digital nutrition tools. Research studies can contribute significantly to progress in this field, especially if they openly report their methods, material and evidence data.

Challenges in providing online personalised advice at scale

The primary challenge of the eNutri project was to design an online system that could automatically provide personalised nutrition advice that would be effective at changing dietary behaviour favourably. Besides factoring in an individual's dietary intake relative to general recommended dietary guidelines, it was important that the intervention reflected personal information (e.g. sex and dietary intake information) in defining advice. This project proposed to increase the acceptability, effectiveness and adoption of online nutrition services. The basic requirements of the proposed app, described in the following subsections, were defined as aiming to promote a wider uptake of digital nutrition assessment and personalised advice via the internet.

Reproducibility and scalability

The motivations for using the internet for encouraging healthier diets are global. With this in mind, the system deployment should be inexpensive and suitable for many populations, including low income communities. One implication of this requirement is that the proposed solution must not depend on any significant financial investment to be deployed by other institutions or organisations and be built with commercially available technologies that could be replicated in other countries and scenarios. In order to be used in public health campaigns or in similar large-scale initiatives, the solution should be scalable. In other words, it should be able to be used in population interventions with many participants using it simultaneously. Because this digital health solution would collect personal data, information security was mandatory.

User acceptability and usability

As sections of the targeted population may not be familiar with technology (e.g. older adults), the proposed system needed to be easy to use and take into account specific requirements of these individuals, to increase its user acceptance(Reference Fisk, Czaja and Rogers72). Another challenge was to develop an app that was designed to run effectively on mobile devices (smartphones and tablets) as they represent the most common devices used to access the Internet currently(73).

Validity and effectiveness of the treatment

The aim of the project was to develop a system that was a validated offering from the nutritional science's perspective (i.e. a real improvement in the diet quality) that would encourage positive dietary behaviour change via the internet. The validity of the system could be based on existing reliable publications from the nutrition field (e.g. widely referenced by the scientific community) and should be validated by experts (i.e. nutritionists and dietitians) by comparison with their specific knowledge. The effectiveness of the treatment could then be measured with robust controlled nutrition intervention studies, for example via a RCT.

eNutri app

Scope definition

There are many opportunities for using technologies to improve nutrition assessment and advice. Due to these extensive possibilities, it was necessary to limit the scope of this project, considering its requirements and challenges. From a technological perspective, the nutrition assessment stage (i.e. dietary intake recording) only considered technologies which had been validated in the field. In other words, an acceptable level of accuracy was required in order to provide valid advice. Emerging technologies not yet validated in this field, such as image recognition, were not considered in this project, particularly if they did not meet the basic requirements mentioned in the previous section.

In order to increase the reproducibility of the system, it was limited to popular technologies and programming languages, so that it could be improved by other researchers and developers who would potentially have access to its open source code. Furthermore, bespoke devices or specific hardware were not considered as alternatives, and the use of public cloud services was a key aim of the project. eNutri is independent of software requirement or plugin installation.

Nutrition advice via the internet is still at an early stage. For that reason, it was considered important to limit the target population of the EatWellUK study, so that people with specific dietary requirements (e.g. those suffering from coeliac disease or diabetes) did not receive advice that may have conflicted with the recommendations they might be receiving from health professionals or even cause some undesired consequences (e.g. recommending inappropriate foods for individuals with serious food allergies). Since this project also evaluated the effectiveness of the nutrition advice, it did not accept participants receiving face-to-face nutritional consultations, to avoid conflicting messages and potential bias. The more these systems evolve, the wider these eligibility criteria can become.

Nutrition assessment method

This project started without a pre-defined nutrition assessment method to be used during the dietary intake recording. We were aware of the use of commercial food diaries in the app stores, but the complete reliance on this method in the most popular apps was not expected. This might be an indication that due to a small number of usability and intervention studies in this field(Reference Teasdale, Elhussein and Butcher64), the developers have possibly drawn inspiration for their solutions from existing apps, thereby repeating the same assessment method (food diary).

The creation of a database with product barcode information requires time and effort. It is likely that most of the apps have this feature due to the fact that there are barcode databases openly available, such as the Open Food Facts(74). At the time of writing, this database contains 609 621 items registered via a collaborative effort. However, since nutrition content contained in the product labels only presents the main or legally required nutrients, the food composition database of these apps may not contain reliable information for micronutrients.

Although it would be possible to create an online service for personalised nutrition advice using food diaries, this alternative could be risky due to high participant burden and associated risk of dropout. In order to provide nutrition advice, the decision engine would need to consider food diaries for multiple days (baseline), in order to detect a dietary pattern and perform the calculations, and then repeat this process after a designated period in order to measure the treatment effect. This approach could be perceived as too burdensome by the participants. The Food4Me project, which developed and validated an online FFQ for their large population-based intervention study on personalised nutrition, took the decision to use an FFQ as their nutrition assessment. In our current project, we took the same decision, and were also able to benefit from permission to use the Food4Me food list and images.

The eNutri nutrition assessment and advice relied on existing and validated methods in the nutrition field. The assessment method (Food4Me FFQ) had been previously validated in the UK (i.e. it is a representation of people's dietary intake with a certain level of accuracy)(Reference Fallaize, Forster and Macready75). In a similar way, the tool for measuring the quality of the diet (i.e. AHEI) is accepted by the scientific community(Reference Chiuve, Fung and Rimm11), making the measurement of treatment effect reliable.

Design and usability

Most of the usability challenges are more complex in smartphones, as compared with desktops and laptops, due to the smaller screen size. As this proposed app does not use any specific internal hardware (e.g. GPS, accelerometer or camera), it was not necessary to develop a native app (i.e. specific to iOS or Android and requiring the app to be installed) to meet the system requirements and collect usability data. However, the eNutri app can be easily converted into a native app because it takes advantage of responsive JavaScript frameworks and there are commercial tools providing this conversion for running web apps as native apps for the major mobile operating systems(76).

To present the food items as a list on smartphones was very challenging. Although possible, it placed constraints on the font size and required users to scroll the page repetitively. Originally, the whole of the FFQ was presented as a list that appeared on a single screen(Reference Franco, Alawadhi and Fallaize77). After a usability evaluation of this version, a newer version of the app was developed presenting each food item individually on the screen(Reference Zenun Franco, Fallaize and Lovegrove3).

To increase the acceptability by older adults, some design principles were included in the app such as: reduction of the user choices on the screen, appropriate font size, reduction of hidden items, having a help button always visible, individual help links for some items and user journey serialisation(Reference Zenun Franco, Fallaize and Lovegrove3).

Both versions(Reference Zenun Franco, Fallaize and Lovegrove3, Reference Franco, Alawadhi and Fallaize77) resulted in similar completion times and user acceptance but there is evidence from the literature that a serialised design is more appropriate from a usability perspective, especially if the solution is aimed at including older adults(Reference Fisk, Czaja and Rogers72). Based on these results, the serialised FFQ design would appear to be the more appropriate one of these two options.

Reproducibility and scalability

The only back-end service used by eNutri was Google Firebase, which is offered by one of the most popular public cloud providers currently and available for other customers worldwide. Because it is a single page app, the content (i.e. texts, images, etc.) is initially downloaded from the hosting provider (i.e. Google Firebase) and processing occurs mainly in the browsers, making this solution scalable(Reference Franco, Alawadhi and Fallaize77). It also facilitates the reproducibility, because it does not require any server-side installation or maintenance. The app can be deployed using the Google Firebase free plan(78), meeting the low-cost requirement. Regarding security, Google Firebase is compliant with the main global standards and security certifications, including the recent 2018 General Data Protection Regulation from the EU(79, 80). From a software perspective, the security rules, detailed in a previous publication(Reference Franco, Alawadhi and Fallaize77), met the authentication and authorisation requirements needed for processing and storing personal data.

Decision engine

Within this project, a modified version of the AHEI (m-AHEI) was selected as the foundation of the decision engine for tailoring the personalised advice (unpublished results). Indexes of overall quality of diets have previously been used for diet assessment, but not for generating online advice. This novel app of a diet quality score (m-AHEI) was associated with some risk, as there was no prior literature on the suitability of this strategy for personalised advice that effectively changed dietary behaviour. This was tested in the EatWellUK RCT (unpublished).

Future work

The version of the decision engine used in the EatWellUK RCT derived the advice based on dietary intake (FFQ data) and sex information. In alignment with behaviour change theory(Reference Michie, Richardson and Johnston81), the user should take more control of their diet changes. A possible solution is to evaluate the quality of a diet change using the AHEI itself, in order to identify multiple foods that can improve the AHEI score and to let the user choose from the multiple modifications. If the app also allows the users to rate the proposed modifications, that could act as further input to improve the recommendations. This type of approach seems to lend itself well to the use of node graphs, where the nodes represent the dietary intakes and edges the possible changes(Reference Buisson51). Different from basic meal planning, it is important to have different weights (i.e. change acceptability) for the edges, similar to map routing with different traffic conditions.

It is particularly important that future versions of this app are able to consider participants’ actual willingness to change their behaviour. For instance, one could want to improve nutrition and yet be unwilling to increase vegetable consumption, so the cost of the path for increasing the vegetable component would need to be recognised as higher than an alternative method for increasing the diet quality index, such as including more fruit for example. In other words, the system would need to take into account participants’ interactions and propose different paths for increasing their diet quality.

Another key challenge for future work is how to train the decision engine. In a typical recommender system, for example a medical diagnosis system, there is available data on the inputs (e.g. symptoms) and corresponding outputs (i.e. diagnosis/treatment). One of the main differences with a nutrition recommender system is that there is no existing openly available dataset with people's case histories and the corresponding proposed diet modifications from nutrition professionals that could be used for training. Furthermore, differently from many common recommender systems (e.g. online shopping based on previous purchases), the food items that users like and consume the most are not necessarily the healthiest. In other words, the recommender system must consider factors other than users’ preferences and prior consumption.

Based on a recent systematic review(Reference Teasdale, Elhussein and Butcher64), an analysis of the systems used to remotely deliver nutrition interventions confirmed that there is no other publicly available decision engine that provides valid online personalised nutrition advice automatically. This publication also showed that all of these interventions were conducted in high-income countries, reinforcing the need for a reproducible and inexpensive solution for online personalised nutrition advice.

Although the latest version of the eNutri app could be useful and potentially contribute to healthier dietary habits, its decision engine is elementary computationally and deterministic (i.e. if two individuals have the same dietary intake information, they will receive the same advice, even if they have different preferences). In addition, its decision engine does not take into account important data sources, such as population data, historical data or individual's preferences. In other words, the current feedback is driven purely by the diet data and sex, and the question of how best to balance nutritional healthiness against users’ preferences in a way that maximises the likelihood of the user adopting healthier choices remains an open research challenge. The eNutri design and source code have been made publicly available(Reference Franco82) under a permissive open source license, so that other researchers and organisations can benefit from this work.

Acknowledgements

Thanks to the Food4Me consortium for use of their portion size photographs.

Financial Support

Rodrigo Zenun Franco was sponsored by the National Council of Technological and Scientific Development from the Brazilian government.

Conflict of Interest

None.

Authorship

R. Z. F. was responsible for the draft preparation of the manuscript. All authors contributed to the conceptualization, reviewed and edited the manuscript, and approved the final version for publication.

References

1.World Health Organization (2010) Global status report on noncommunicable diseases. http://www.who.int/nmh/publications/ncd_report2010/en/ (accessed August 2018)Google Scholar
2.Capacci, S & Mazzocchi, M (2011) Five-a-day, a price to pay: an evaluation of the UK program impact accounting for market forces. J Health Econ 30, 8798.Google Scholar
3.Zenun Franco, R, Fallaize, R, Lovegrove, JA et al. (2018) Online dietary intake assessment using a graphical food frequency app (eNutri): usability metrics from the EatWellUK study. PLoS ONE 13, e0202006.Google Scholar
4.Molag, ML (2010) Towards transparent development of food frequency questionnaires. PhD thesis, Wageningen University.Google Scholar
5.Welch, AA, Luben, R, Khaw, KT et al. (2005) The CAFE computer program for nutritional analysis of the EPIC-Norfolk food frequency questionnaire and identification of extreme nutrient values. J Hum Nutr Diet 18, 99116.Google Scholar
6.Forster, H, Fallaize, R, Gallagher, C et al. (2014) Online dietary intake estimation: the Food4Me food frequency questionnaire. J Med Internet Res 16, e150.Google Scholar
7.UK Government (2015) The eatwell plate. https://www.gov.uk/government/publications/the-eatwell-guide (accessed August 2018).Google Scholar
8.Davis, CA, Britten, P & Myers, EF (2001) Past, present, and future of the Food Guide Pyramid. J Am Diet Assoc 101, 881885.Google Scholar
9.Waijers, P & Feskens, E (2005) Indexes of overall diet quality. Report 350010003. Bilthoven, The Netherlands. http://rivm.openrepository.com/rivm/handle/10029/7338 (accessed November 2018)Google Scholar
10.Guenther, PM, Casavale, KO, Reedy, J et al. (2013) Update of the healthy eating index: HEI-2010. J Acad Nutr Diet 113, 569580.Google Scholar
11.Chiuve, SE, Fung, TT, Rimm, EB et al. (2012) Alternative dietary indices both strongly predict risk of chronic disease. J Nutr 142, 10091018.Google Scholar
12.Noar, SM, Benac, CN & Harris, MS (2007) Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull 133, 673.Google Scholar
13.Hawkins, RP, Kreuter, M, Resnicow, K et al. (2008)Understanding tailoring in communicating about health. Health Educ Res 23, 454466.Google Scholar
14.Wendel, S, Dellaert, BGC, Ronteltap, A et al. (2013) Consumers’ intention to use health recommendation systems to receive personalized nutrition advice. BMC Health Serv Res 13, 126.Google Scholar
15.Livingstone, KM, Celis-Morales, C, Navas-Carretero, S et al. (2016) Profile of European adults interested in internet-based personalised nutrition: the Food4Me study. Eur J Nutr 55, 759769.Google Scholar
16.Celis-Morales, C, Lara, J & Mathers, JC (2014) Personalising nutritional guidance for more effective behaviour change. Proc Nutr Soc 44, 19.Google Scholar
17.Celis-Morales, C, Livingstone, KM, Marsaux, CFM et al. (2016) Effect of personalized nutrition on health-related behaviour change: evidence from the Food4Me European randomized controlled trial. Int J Epidemiol 46, 578588.Google Scholar
18.Ryan, NM, O'Donovan, CB, Forster, H et al. (2015) New tools for personalised nutrition: the Food4Me project. Nutr Bull 40, 134139.Google Scholar
19.Forster, H, Walsh, MC, Donovan, CBO et al. (2016) A dietary feedback system for the delivery of consistent personalized dietary advice in the web-based multicenter Food4Me study. J Med Internet Res 18, e150.Google Scholar
20.Warner, MM, Kelly, JT, Reidlinger, DP et al. (2017) Reporting of telehealth-delivered dietary intervention trials in chronic disease: systematic review. J Med Internet Res 19, e410.Google Scholar
21.Bingham, SA, Welch, AA, McTaggart, A et al. (2001) Nutritional methods in the European Prospective Investigation of Cancer in Norfolk. Public Health Nutr 4, 847.Google Scholar
22.Probst, YC & Tapsell, LC (2005) Overview of computerized dietary assessment programs for research and practice in nutrition education. J Nutr Educ Behav 37, 2026.Google Scholar
23.GOV.UK (2018) Composition of foods integrated dataset (CoFID) – McCance and Widdowson's. https://www.gov.uk/government/publications/composition-of-foods-integrated-dataset-cofid (accessed August 2018).Google Scholar
24.Chen, J, Lieffers, J, Bauman, A et al. (2017) The use of smartphone health apps and other mobile health (mHealth) technologies in dietetic practice: a three country study. J Hum Nutr Diet 30, 439452.Google Scholar
25.Franco, RZ, Fallaize, R, Lovegrove, JA et al. (2016) Popular nutrition-related mobile apps: a feature assessment. JMIR mHealth uHealth 4, e85.Google Scholar
26.Forster, H, Fallaize, R, Gallagher, C et al. (2014) Online dietary intake estimation: the Food4Me food frequency questionnaire. J Med Internet Res 16, 118.Google Scholar
27.Mulligan, AA, Luben, RN, Bhaniani, A et al. (2014) A new tool for converting food frequency questionnaire data into nutrient and food group values: FETA research methods and availability. BMJ Open 4, e004503.Google Scholar
28.Kristal, AR, Kolar, AS, Fisher, JL et al. (2014) Evaluation of web-based, self-administered, graphical food frequency questionnaire. J Acad Nutr Diet 114, 613621.Google Scholar
29.Subar, AF, Kirkpatrick, SI, Mittl, B et al. (2012) The Automated self-administered 24-h dietary recall (ASA24): a resource for researchers, clinicians, and educators from the National Cancer Institute. J Acad Nutr Diet 112, 11341137.Google Scholar
30.Liu, B, Young, H, Crowe, FL et al. (2011) Development and evaluation of the Oxford WebQ, a low-cost, web-based method for assessment of previous 24 h dietary intakes in large-scale prospective studies. Public Health Nutr 14, 19982005.Google Scholar
31.Delve, J, Simpson, E, Adamson, AJ et al. (2015) Comparison of INTAKE24 (an online 24 h dietary recall tool) with an interviewer-led 24 h recall method in 11–16 year olds. Proc Nutr Soc 74(OCE1), E62.Google Scholar
32.Carter, MC, Albar, SA, Morris, MA et al. (2015)Development and usability of myfood24: an online 24-h dietary assessment tool. Proc Nutr Soc 74(OCE4), E276.Google Scholar
33.Carter, MC, Albar, SA, Morris, MA et al. (2015) Development of a UK Online 24-h dietary assessment tool: myfood24. Nutrients 7, 40164032.Google Scholar
34.Thompson, FE, Subar, AF, Loria, CM et al. (2010) Need for technological innovation in dietary assessment. J Am Diet Assoc 110, 4851.Google Scholar
35.Andrew, AH, Borriello, G & Fogarty, J (2013) Simplifying mobile phone food diaries: design and evaluation of a food index-based nutrition diary. Proceedings of the 7th international conference on pervasive computing technologies for healthcare, pp. 260–263. http://dx.doi.org/10.4108/icst.pervasivehealth.2013.252101.Google Scholar
36.Timon, CM, Blain, RJ, McNulty, B et al. (2017) The development, validation, and user evaluation of Foodbook24: a web-based dietary assessment tool developed for the Irish adult population. J Med Internet Res 19, e158.Google Scholar
37.Astell, AJ, Adlam, TD, Hwang, F et al. (2012) Validating NANA: novel assessment of nutrition and ageing. Gerontechnology 11, 243.Google Scholar
38.Astell, AJ, Brown, L, Hwang, F et al. (2012) Working with older adults to develop NANA: novel assessment of nutrition and ageing. Gerontechnology 11, 4017.Google Scholar
39.Gilhooly, M (2010) The new dynamics of ageing programme: current UK interdisciplinary research on assistive technologies. Gerontechnology 9, 9599.Google Scholar
40.Stumbo, PJ. (2013) New technology in dietary assessment: a review of digital methods in improving food record accuracy. Proc Nutr Soc 72, 7076.Google Scholar
41.Probst, Y, Nguyen, D, Tran, M et al. (2015) Dietary assessment on a mobile phone using image processing and pattern recognition techniques: algorithm design and system prototyping. Nutrients 7, 61286138.Google Scholar
42.Martin, CK, Nicklas, T, Gunturk, B et al. (2014) Measuring food intake with digital photography. J Hum Nutr Diet 27, Suppl. 1, 281.Google Scholar
43.Meyers, A, Johnston, N, Rathod, V et al. (2015) Im2Calories: towards an automated mobile vision food diary. In Proceedings of the IEEE International Conference on Computer Vision, pp. 12331241. https://www.cv-foundation.org/openaccess/content_iccv_2015/html/Meyers_Im2Calories_Towards_an_ICCV_2015_paper.htmlGoogle Scholar
44.Schiboni, G & Amft, O (2018) Automatic dietary monitoring using wearable accessories. In Seamless Healthcare Monitoring, pp. 369412. Cham: Springer.Google Scholar
45.Korpusik, M & Glass, J (2017) Spoken language understanding for a nutrition dialogue system. IEEE/ACM Trans Audio, Speech, Lang Process 25, 14501461.Google Scholar
46.Naphtal, R (2015) Natural language processing based nutritional application. PhD thesis, Massachusetts Institute of Technology.Google Scholar
47.Lacson, R & Long, W (2006) Natural language processing of spoken diet records (SDRs). AMIA Annu Symp Proc 2006, 454458.Google Scholar
48.Noronha, J, Hysen, E, Zhang, H et al. (2011) Platemate: crowdsourcing nutritional analysis from food photographs. Proceedings of the 24th annual ACM symposium on User interface software and technology ACM, New York, NY, USA, pp. 1–12. https://doi.org/10.1145/2047196.2047198Google Scholar
49.Sklan, D & Dariel, I (1993) Diet planning for humans using mixed-integer linear programming. Br J Nutr 70, 2735.Google Scholar
50.Buisson, JC & Garel, A Balancing meals using fuzzy arithmetic and heuristic search algorithms. IEEE Trans Fuzzy Syst 11, 6878.Google Scholar
51.Buisson, J-C (2008) Nutri-Educ, a nutrition software application for balancing meals, using fuzzy arithmetic and heuristic search algorithms. Artif Intell Med 42, 213227.Google Scholar
52.Ravana, SD, Rahman, SA & Chan, HY (2006) Web-based diet information system with case-based reasoning capabilities. Int J Web Inf Syst 2(3/4), 154163.Google Scholar
53.Khan, AS & Hoffmann, A (2003) Building a case-based diet recommendation system without a knowledge engineer. Artif Intell Med 27, 155179.Google Scholar
54.Petot, GJG, Marling, C & Sterling, L (1998) An artificial intelligence system for computer-assisted menu planning. J Am Diet Assoc 98, 10091014.Google Scholar
55.Harvey, M, Ludwig, B & Elsweiler, D (2013) You Are What You Eat: Learning User Tastes for Rating Prediction, pp. 153164. Cham: SpringerGoogle Scholar
56.Espín, V, Hurtado, MV & Noguera, M (2016) Nutrition for Elder Care: a nutritional semantic recommender system for the elderly. Expert Syst 33, 201210.Google Scholar
57.Probst, Y, Morrison, E, Sullivan, E et al. (2016) First-Stage development and validation of a web-based automated dietary modeling tool: using constraint optimization techniques to streamline food group and macronutrient focused dietary prescriptions for clinical trials. J Med Internet Res 18, e190.Google Scholar
58.Lee, C-S, Wang, M-H & Lan, S-T (2014) Adaptive personalized diet linguistic recommendation mechanism based on type-2 fuzzy sets and genetic fuzzy markup language. IEEE Trans Fuzzy Syst 23, 17771802.Google Scholar
59.Hsu, C-Y, Huang, L-C, Chen, TM et al. (2011) A web-based decision support system for dietary analysis and recommendations. Telemed J E Health 17, 6875.Google Scholar
60.Lee, C-S, Wang, M-H, Acampora, G et al. (2010) Diet assessment based on type-2 fuzzy ontology and fuzzy markup language. Int J Intell Syst 25, 11871216.Google Scholar
61.Wang, MMH, Kurozumi, K, Kawaguchi, M et al. (2016) Healthy diet assessment mechanism based on fuzzy markup language for Japanese food. Soft Comput 20, 359376.Google Scholar
62.Mendel, J, Zadeh, L, Trillas, E et al. (2010) What computing with words means to me [Discussion Forum]. IEEE Comput Intell Mag 5, 2026.Google Scholar
63.AlFayoumi, SA, Hegazy, AA & Belal, MA (2014) Influence of evolutionary computing on nutrition recommendation: a survey. J Comput Sci 10, 19171923.Google Scholar
64.Teasdale, N, Elhussein, A, Butcher, F et al. (2018) Systematic review and meta-analysis of remotely delivered interventions using self-monitoring or tailored feedback to change dietary behavior. Am J Clin Nutr 107, 247256.Google Scholar
65.Campbell, MK, Honess-Morreale, L, Farrell, D et al. (1999) A tailored multimedia nutrition education pilot program for low-income women receiving food assistance. Health Educ Res 14, 257267.Google Scholar
66.Mummah, SA, Mathur, M, King, AC et al. (2016) Mobile technology for vegetable consumption: a randomized controlled pilot study in overweight adults. JMIR mHealth uHealth 4, e51.Google Scholar
67.Mummah, S, Robinson, TN, Mathur, M et al. (2017) Effect of a mobile app intervention on vegetable consumption in overweight adults: a randomized controlled trial. Int J Behav Nutr Phys Act 14, 125.Google Scholar
68.Alexander, GL, McClure, JB, Calvi, JH et al. (2010) A randomized clinical trial evaluating online interventions to improve fruit and vegetable consumption. Am J Public Health 100, 319326.Google Scholar
69.Rolnick, SJ, Calvi, J, Heimendinger, J et al. (2009) Focus groups inform a web-based program to increase fruit and vegetable intake. Patient Educ Couns 77, 314318.Google Scholar
70.Springvloet, L, Lechner, L, de Vries, H et al. (2015) Short- and medium-term efficacy of a web-based computer-tailored nutrition education intervention for adults including cognitive and environmental feedback: randomized controlled trial. J Med Internet Res 17, e23.Google Scholar
71.Tapper, K, Jiga-Boy, G, Maio, GR et al. (2014) Development and preliminary evaluation of an internet-based healthy eating program: randomized controlled trial. J Med Internet Res 16, e231.Google Scholar
72.Fisk, AD, Czaja, SJ, Rogers, WA et al. (2009) Designing for older adults: Principles and creative human factors approaches. Boca Raton: CRC Press.Google Scholar
73.NetMarketShare. NetMarketShare. Mark. Share Stat. Internet Technol. https://netmarketshare.com/ (accessed August 2018).Google Scholar
74.Open Food Facts. The Free Food Products Database. 2018; http://openfoodfacts.org/ (accessed August 2018).Google Scholar
75.Fallaize, R, Forster, H, Macready, AL et al. (2014) Online dietary intake estimation: reproducibility and validity of the Food4Me food frequency questionnaire against a 4-day weighed food record. J Med Internet Res 16, e190.Google Scholar
76.Adobe (2018) PhoneGap. http://phonegap.com/ (accessed August 2018).Google Scholar
77.Franco, RZ, Alawadhi, B, Fallaize, R et al. (2017) A web-based graphical food frequency assessment system: design, development and usability metrics. JMIR Hum Factors 4, e13.Google Scholar
78.Google (2018) Pricing plans – Firebase, https://firebase.google.com/pricing/ (accessed August 2018).Google Scholar
79.Google Cloud (2018) Cloud Compliance – Regulations and Certifications, https://cloud.google.com/security/compliance/ (accessed August 2018).Google Scholar
80.Google (2018) Privacy and Security in Firebase, https://firebase.google.com/support/privacy/ (accessed August 2018).Google Scholar
81.Michie, S, Richardson, M, Johnston, M et al. (2013) The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med 46, 8195.Google Scholar
82.Franco, RZ eNutri, Personalised Nutrition Web App. https://doi.org/10.5281/zenodo.1304929 (accessed October 2018)Google Scholar
Figure 0

Table 1. Technologies and general information of remotely delivered nutrition interventions