The SNP of rs964184 in ZPR1 has recently been associated with type 2 diabetes mellitus (T2DM) in Japanese individuals. To comprehensively investigate the association of common variants in ZPR1 with T2DM in Han Chinese individuals, we designed a two-stage case-control study of 3,505 T2DM patients and 6,911 unrelated healthy Han Chinese individuals. A total of 24 single nucleotide polymorphisms (SNPs) were genotyped, and single-SNP association, imputation and gender-specific association analyses were performed. To increase the coverage of genetic markers, we implemented imputation techniques to extend the number of tested makers to 280. A novel SNP, rs2075290, and the previously reported SNP, rs964184, were significantly associated with T2DM in the two independent datasets, and individuals harboring the CC genotype of rs2075290 and GG genotype of rs964184 exhibited higher levels of fasting plasma glucose (FPG) and blood hemoglobin A1c (HbA1c) than individuals of other genotypes. Additionally, haplotype analyses indicated that two haplotype blocks containing rs2075290 or rs964184 were also significantly associated with T2DM. In summary, these results suggest that ZPR1 plays an important role in the etiology of T2DM, and this gene might be involved in abnormal glucose metabolism.