Among food groups with putative benefits for brain structures, dairy products (DP) have been poorly studied. The sample included participants without dementia from the ancillary brain imaging study of the Three-City cohort who were aged 65+ years, had their DP intake assessed with a FFQ at baseline and underwent an anatomical scan 3 years (n 343) or 9 years (n 195) after completing the dietary survey. The frequencies of consumption of total DP, milk and cheese were not associated with brain structure. Compared with the lowest frequency, the highest frequency of fresh DP (F-DP) consumption (< 0·5 v. > 1·5 times/d) was significantly associated with a lower medial temporal lobe volume (MTLV) (β = −1·09 cm3, 95 % CI − 1·83, −0·36) 9 years later. In this population-based study of older adults, the consumption of F-DP more than 1·5 times/d was associated with a lower MTLV, which is considered an early biomarker of Alzheimer’s disease, 9 years later. This original study should be replicated in different settings before conclusions are drawn.