Accumulated evidence shows that OGT-mediated O-GlcNAcylation plays an important role in response to DNA damage repair. However, it is unclear if the "eraser" O-GlcNAcase (OGA) participates in this cellular process. Here, we examined the molecular mechanisms and biological functions of OGA in DNA damage repair, and found that OGA was recruited to the sites of DNA damage and mediated deglycosylation following DNA damage. The recruitment of OGA to DNA lesions is mediated by O-GlcNAcylation events. Moreover, we have dissected OGA using deletion mutants and found that C-terminal truncated OGA including the pseudo HAT domain was required for the recruitment of OGA to DNA lesions. Using unbiased protein affinity purification, we found that the pseudo HAT domain was associated with DNA repair factors including NONO and the Ku70/80 complex. Following DNA damage, both NONO and the Ku70/80 complex were O-GlcNAcylated by OGT. The pseudo HAT domain was required to recognize NONO and the Ku70/80 complex for their deglycosylation. Suppression of the deglycosylation prolonged the retention of NONO at DNA lesions and delayed NONO degradation on the chromatin, which impaired non-homologus end joining (NHEJ). Collectively, our study reveals that OGA-mediated deglycosylation plays a key role in DNA damage repair.