Although beta-amyloid, anxiety and depression have linked cross-sectionally to reduced memory function in healthy older adults without dementia, prospective data evaluating these associations are lacking. Using data an observational cohort study of 178 healthy older adults without dementia followed for 3 years, we found that anxiety symptoms significantly moderated the relationship between beta-amyloid level and decline in verbal (Cohen's d = 0.65) and episodic (Cohen's d = 0.38) memory. Anxiety symptoms were additionally linked to greater decline in executive function, irrespective of beta-amyloid and other risk factors. These findings suggest that interventions to mitigate anxiety symptoms may help delay memory decline in otherwise healthy older adults with elevated beta-amyloid.