PMEL is a pigment cell protein that forms physiological amyloid in melanosomes. Many amyloids and/or their oligomeric precursors are toxic, causing or contributing to severe, incurable diseases including Alzheimer's and prion diseases. Striking similarities in intracellular formation pathways between PMEL and various pathological amyloids including Aβ and PrPSc suggest PMEL is an excellent model system to study endocytic amyloid. Learning how PMEL fibrils assemble without apparent toxicity may help developing novel therapies for amyloid diseases. Here we identify the critical PMEL domain that forms the melanosomal amyloid core (CAF). An unbiased alanine-scanning screen covering the entire region combined with quantitative electron microscopy analysis of the full set of mutants uncovers numerous essential residues. Many of these rely on aromaticity for function suggesting a role for π-stacking in melanosomal amyloid assembly. Various mutants are defective in amyloid nucleation. This extensive data set informs the first structural model of the CAF and provides insights into how the melanosomal amyloid core forms.