Poor diet and obesity are associated with serious medical illnesses and place significant strain on health-care systems(1, Reference Finkelstein, Trogdon and Cohen2). One strategy to promote healthier eating is to educate consumers through the provision of nutritional labels on the front of packaged foods. Many countries have already adopted a front-of-package (FOP) labelling system, like the Choices logo in the Netherlands(3) or the Multiple Traffic Light in the UK(4). In the USA, different food manufacturers have created their own logos to appear on packaged foods, which has led to consumer confusion(5).
To address the vexing array of FOP labels in the USA, a group of ‘scientists, academicians, nutrition educators, public health organizations, food manufacturers, retailers and government observers’ formed the Keystone Food and Nutrition Roundtable in 2007(Reference Lupton, Balentine and Black6). The members of the Roundtable included major food manufacturers and the American Society for Nutrition, as well as NSF International, a not-for-profit company(Reference Lupton, Balentine and Black6). The stated goal of the group's discussions was to create science-based nutritional criteria that would enable the classification of products within a food or beverage category as a ‘better-for-you’ choice. The result was the development of the ‘Smart Choices’ labelling programme, which granted products meeting certain nutritional standards a label containing a green checkmark and text that read ‘Smart Choices Program Guiding Good Choices’. The label also included information about energy per serving and servings per package(Reference Lupton, Balentine and Black6).
The Roundtable stated that the nutritional criteria for ‘Smart Choices’ were developed on the basis of the 2005 Dietary Guidelines for Americans(Reference Lupton, Balentine and Black6). In addition, the criteria were guided by reports from the Institute of Medicine (IOM) and nutrition-labelling regulations put forth by the US Department of Agricultures' Food Safety and Inspection Service and the US Food and Drug Administration (FDA)(Reference Lupton, Balentine and Black6). The ‘Smart Choices’ criteria were applied to foods in nineteen product categories, which were evaluated on the basis of amounts of nutrients to limit. These nutrients included energy, total fat, saturated fat, trans fat, cholesterol, added sugars and Na(Reference Lupton, Balentine and Black6). Some product categories were also evaluated on the basis of nutrients to encourage, namely those that included K, fibre, vitamin E, Ca, Mg and vitamins A and C(Reference Lupton, Balentine and Black6). The nutritional criteria also took into account whether a product encouraged consumption of foods belonging to specific food groups, including fruit, vegetables, whole grains and fat-free/low-fat milk products(Reference Lupton, Balentine and Black6).
When the ‘Smart Choices’ programme was launched in the USA in August 2009, it was met with scepticism. The FDA sent a cautionary letter to the general manager of the ‘Smart Choices’ committee indicating that the programme would be monitored(Reference Taylor and Mande7); moreover, news outlets such as the New York Times wondered how sugary cereals like Froot Loops and Cookie Crisp could be considered ‘Smart Choices’(Reference Neuman8). Shortly after a Connecticut Congresswoman and the Connecticut Attorney General called for investigations into the possibly misleading nature of the ‘Smart Choices’ programme(Reference Delauro9, 10), the FDA announced an FOP labelling initiative to work with the food industry, nutrition experts and the IOM to develop nutritional criteria for an FOP labelling system that could be uniformly implemented(11). In response to this announcement, the ‘Smart Choices’ programme declared that it would postpone operations(Reference Metcalfe12).
The goal of the current FDA and IOM efforts is to develop a voluntary FOP system that would provide consumers with easily understandable nutrition information that can be used quickly when making food choices. However, the nutritional criteria that should be used and the extent of the food industry's role in developing these criteria remain the subject of ongoing debates. Therefore, the goal of the present study was to determine how the ‘Smart Choices’ FOP nutritional criteria, which were developed by members of the food industry working together with scientists and government officials, compare with a non-industry-developed nutritional standard that could be used as the basis for an FOP labelling system in the USA and around the world. We believe that the results of such a comparison can provide guidance for government agencies as they consider the role that the food industry should play in creating nutritional standards and the type of nutritional standards that should be used.
The specific aim of the present study was to determine the proportion of ‘Smart Choices’ products deemed healthy by non-industry-developed, validated nutritional criteria(Reference Rayner, Scarborough and Boxer13). The nutritional standard used for comparison was the Nutrient Profile Model (NPM) developed for the UK Food Standards Agency by Rayner et al.(Reference Rayner, Scarborough and Boxer13), which provides a numerical score to rank products on overall nutritional content. The model is used by the UK government to identify healthy foods that can be advertised to children on television(Reference Lobstein and Davies14); the Australian government's Food Standards Code has used a version of this model to determine those products that can carry health claims(15).
Methods
A list of approved ‘Smart Choices’ products across nineteen food and beverage categories was compiled from the ‘Smart Choices’ website (as of 17 October 2009)(16). The following eight food categories were selected for the present study: sauces, dressings and condiments; fats, oils and spreads; cereals; snack foods and sweets; desserts; soups, meal sauces and mixed side dishes; beverages; and bread, grains, pasta and flour. The following food categories did not have products listed on the ‘Smart Choices’ website at the time of our analysis and were therefore excluded: cheese and cheese substitutes; milk, dairy products and dairy substitutes; chewing gum; and water. In addition, the present study focused only on packaged foods; therefore, the meat, fish, poultry and fruit and vegetable categories were excluded. In addition, the NPM requires the percentage of fruit, vegetables and/or nuts in a food to determine a score for foods composed of 40 % or more of these ingredients. Because this information is not listed on the nutritional facts panel in the USA, we did not analyse categories consisting primarily of such products (i.e. tomato sauces, frozen dinners with vegetables).
Once the categories were identified, we extracted the lists of products within each category appearing on the ‘Smart Choices’ website(16). These lists often contained multiple versions of the same item (e.g. the same product in a different packaging size). Given the redundancy of products, we applied the following rules to generate a final list of non-duplicated versions of products to be analysed. (i) When a product and its multiple flavours were listed, we selected ‘the original’ version; if there was no original flavour, we randomly selected a flavour. For example, both original Lucky Charms and Chocolate Lucky Charms were ‘Smart Choices’; therefore, we selected only original Lucky Charms for our analysis. However, we included different versions of the same product if its title indicated a meaningful nutritional difference (e.g. Frosted Flakes and Reduced Sugar Frosted Flakes). (ii) If the identical product was produced by multiple manufacturers, we randomly chose one product (e.g. there were five brands of long-grain brown rice; therefore, we evaluated only one brand). Nutrition information for all selected products was then obtained from the manufacturers’ websites in October 2009. When nutrition information was not available online, we retrieved the information from the actual product label found at a local supermarket. We excluded products that could not be found online or in a nearby supermarket.
The nutrition information was then collected and entered into the NPM program to generate a nutritional score. This method assigns numerical values to the products on the basis of a point system that is reverse scored, with lower scores indicating healthier products(Reference Rayner, Scarborough and Boxer13). Products gain points for negative nutritional attributes (amount of energy, saturated fat, sugar or Na that surpasses specified threshold values) and lose points for positive nutritional attributes (higher-than-threshold amounts of fruit/vegetables/nuts, fibre and protein). Foods are classified as ‘less healthy’ if their score is ≥4 and beverages are classified as ‘less healthy’ if their score is ≥1. The NPM was chosen as the standard of comparison because it is a thoroughly tested approach, has informed policy decisions in the UK and Australia and was validated to reflect nutritionists’ evaluations of healthy and unhealthy foods(Reference Scarborough, Boxer and Rayner17, Reference Arambepola, Scarborough and Rayner18). In addition, unlike ‘Smart Choices’, the NPM does not consider vitamins and minerals that may be added to products of poor nutritional quality to make them appear healthier. The NPM also applies uniform nutritional standards across products, whereas the ‘Smart Choices’ criteria differ across products ;(see Table 1 for a comparison of the NPM and ‘Smart Choices’ criteria).
NPM, Nutrient Profile Model.
Results
A total of 207 products were extracted from the ‘Smart Choices’ website; 112 unique products were selected using the criteria described previously and we were able to retrieve nutrition information for 100 of those products. These products were then analysed using the NPM. Overall, sixty-four (64·00 %) products deemed ‘Smart Choices’ did not meet the NPM standard for a healthy product. The results for each product category are described below (see Table 2 for all results, including product NPM scores).
NPM, Nutrient Profile Model.
*Foods are classified as ‘less healthy’ if their score is ≥4 and beverages are classified as ‘less healthy’ if their score is ≥1.
• Condiments: Of the three analysed condiments, none (0 %) met the NPM standard.
• Fats, oils and spreads: Of the twenty-three analysed fats, oils and spreads, two (8·70 %) met the NPM standard.
• Cereals: Of the thirty-two analysed cereals, five (15·63 %) met the NPM standard.
• Snacks and sweets: Of the nineteen analysed snacks and sweets, six (31·58 %) met the NPM standard.
• Desserts: Five desserts were listed as ‘Smart Choices’ and all represented different flavours of one brand of ice cream. Therefore, only one item was analysed and it met the NPM standard (100 %).
• Soups: All nineteen of the analysed soups met the NPM standard (100 %).
• Beverages: All beverages listed were tea. All seven chosen for analysis met the NPM standard (100 %).
• Bread, grains, pasta and flour: One rice product was analysed and it met the NPM standard (100 %). Nutrition information was unavailable for the eligible bread product.
Discussion
In all, 64 % of the products that qualified for a ‘Smart Choices’ logo did not meet the NPM nutritional standard. Of greater concern was that the majority of ‘Smart Choices’ products for cereals, sweets and snacks, fats, oils and spreads, and condiments did not meet the NPM standard. However, all desserts, soups, beverages and bread and grain products met the NPM standard, suggesting that the criteria applied to these categories were appropriately stringent. Overall, this comparison between the NPM and the ‘Smart Choices’ systems suggests that the ‘Smart Choices’ nutritional criteria were not rigorous enough and were particularly lax for specific product categories. For example, Cocoa Krispies and Froot Loops cereals boasted ‘Smart Choices’ labels despite earning some of the poorest NPM scores.
A standardized FOP nutrition label that quickly alerts customers to healthy choices has the potential to help consumers make better choices when shopping for food. However, these findings provide evidence that there is considerable risk that nutritional criteria developed and implemented by the food industry, even with scientists involved, will lead to misleading labels. These findings are consistent with inadequate food industry self-regulation in other arenas, including child-targeted marketing and guidelines for selling sugar-sweetened beverages in schools(Reference Sharma, Teret and Brownell19). Lessons from the tobacco and alcohol industries also caution against industry self-regulation where public health is concerned(Reference Sharma, Teret and Brownell19).
Furthermore, focus group research on FOP labelling systems has found that consumers want a credible labelling system(Reference van Kleef, van Trijp and Paeps20–Reference Malam, Clegg and Kirwin23). In a series of European studies, systems created and endorsed by the food industry were often perceived as less credible compared with systems endorsed by national or international health organizations(Reference van Kleef, van Trijp and Paeps20–Reference Malam, Clegg and Kirwin23). These findings taken together with the current study on the ‘Smart Choices’ nutritional criteria suggest that it may be important to use caution when involving the industry in the development of FOP label nutritional criteria. The ‘Choices Programme’, an FOP labelling system that might have promise, involves the industry; however, the nutritional criteria are ‘developed by independent, leading scientists’(Reference Dotsch-Klerk and Jansen24), unlike the ‘Smart Choices’ criteria, in the creation of which industry had a role.
The present study is limited because not all ‘Smart Choices’ products were analysed and some categories of products had few possible products for analysis. However, the latter limitation tended to work in favour of the ‘Smart Choices’ criteria (i.e. there was only one dessert listed and it met the NPM standard). In addition, only two possible FOP nutritional criteria were compared.
Future research should compare the NPM standard with other possible FOP nutritional criteria and examine how it might influence consumer behaviour. It will also be important to have non-industry-funded scientists evaluate and validate proposed FOP nutritional criteria, given the potential bias towards industry-funded research confirming favourable hypotheses and downplaying unfavourable results(Reference Vartanian, Schwartz and Brownell25, Reference Montaner, O'Shaughnessy and Schechter26). Overall, the findings indicate that the NPM criteria provide a more rigorous classification of food products and should be considered as an option for FOP labelling system nutritional criteria.
Acknowledgements
The present study was supported in part by funding from the Rudd Foundation and the Robert Wood Johnson Foundation. C.A.R. received support from a federal grant through the National Institute of Diabetes and Digestive and Kidney Diseases. The authors have no conflict of interest to declare. C.A.R. conceived the study idea and design, helped with data acquisition and led the writing; M.A.B. helped with study design and data acquisition and provided critical feedback on drafts of the manuscript; K.A.L., J.M.T and M.J.S. helped with data acquisition and provided critical feedback on drafts of the manuscript; J.L.H. and K.D.B. provided input on study design and critical feedback on drafts of the manuscript.