The crystal structure of the phosphotyrosine-binding domain (PTB) of the X11 protein has been determined, in complex with unphosphorylated peptides corresponding to a region of beta-amyloid precursor protein (betaAPP) that is required for receptor internalization. The mode of binding to X11 of the unphosphorylated peptides, which contain an NPxY motif, resembles that of phosphorylated peptides bound to the Shc and IRS-1 PTB domains. Eight peptide residues make specific contacts with the X11 PTB domain, and they collectively achieve high affinity (KD = 0.32 microM) and specificity. These results suggest that, in contrast to the SH2 domains, the PTB domains are primarily peptide-binding domains that have, in some cases, acquired specificity for phosphorylated tyrosines.