To compare different statistical methods for assessing the relative validity of a self-administered, 150-item, semi-quantitative food-frequency questionnaire (FFQ) with 4-day weighed diet records (WR).

Subjects completed the Scottish Collaborative Group FFQ and carried out a 4-day WR. Relative agreement between the FFQ and WR for energy-adjusted nutrient intakes was assessed by Pearson and Spearman rank correlation coefficients, the percentages of subjects classified into the same and opposite thirds of intake, and Cohen's weighted kappa.

Forty-one men, mean age 36 (range 21-56) years, and 40 women, mean age 33 (range 19-58) years, recruited from different locations in Aberdeen, Scotland.

Spearman correlation coefficients tended to be lower than Pearson correlation coefficients, and were above 0.5 for 10 of the 27 nutrients in men and 17 of the 27 nutrients in women. For nutrients with Spearman correlation coefficients above 0.5, the percentage of subjects correctly classified into thirds ranged from 39 to 78%, and weighted kappa values ranged from 0.23 to 0.66.

Both Spearman correlation coefficients and weighted kappa values are useful in assessing the relative validity of estimates of nutrient intake by FFQs. Spearman correlation coefficients above 0.5, more than 50% of subjects correctly classified and less than 10% of subjects grossly misclassified into thirds, and weighted kappa values above 0.4 are recommended for nutrients of interest in epidemiological studies.

To assess validity of the Nambour food-frequency questionnaire (FFQ) relative to weighed food records (WFRs), and the extent to which selected demographic, anthropometric and social characteristics explain differences between the two dietary methods.

Inter-method validity study; 129-item FFQ vs. 12 days of WFR over 12 months.

Community-based Nambour Skin Cancer Prevention Trial.

One hundred and fifteen of 168 randomly selected participants in the trial (68% acceptance rate) aged 25–75 years.

Spearman correlations between intakes from the two methods ranged from 0.18 to 0.71 for energy-adjusted values. Differences between FFQ and WFR regressed on personal characteristics were significantly associated with at least one characteristic for 16 of the 21 nutrients. Sex was significantly associated with differences for nine nutrients; body mass index (BMI), presence of any medical condition and age were each significantly associated with differences for three to six nutrients; use of dietary supplements and occupation were associated with differences for one nutrient each. There was no consistency in the direction of the significant associations. Regression models explained from 7% (riboflavin) to 27% (saturated fat) of variation in differences in intakes.

The relative validity of FFQ estimates for many nutrients is quite different for males than for females. Age, BMI, medical condition and level of intake were also associated with relative validity for some nutrients, resulting in the need to adjust intakes estimates for these in modelling diet-disease relationships. Estimates for cholesterol, β-carotene equivalents, retinol equivalents, thiamine, riboflavin and calcium would not benefit from this.