Confidence interval (CI) construction with respect to proportion/rate difference for paired binary data has become a standard procedure in many clinical trials and medical studies. When the sample size is small and incomplete data are present, asymptotic CIs may be dubious and exact CIs are not yet available. In this article, we propose exact and approximate unconditional test-based methods for constructing CI for proportion/rate difference in the presence of incomplete paired binary data. Approaches based on one- and two-sided Wald's tests will be considered. Unlike asymptotic CI estimators, exact unconditional CI estimators always guarantee their coverage probabilities at or above the pre-specified confidence level. Our empirical studies further show that (i) approximate unconditional CI estimators usually yield shorter expected confidence width (ECW) with their coverage probabilities being well controlled around the pre-specified confidence level; and (ii) the ECWs of the unconditional two-sided-test-based CI estimators are generally narrower than those of the unconditional one-sided-test-based CI estimators. Moreover, ECWs of asymptotic CIs may not necessarily be narrower than those of two-sided-based exact unconditional CIs. Two real examples will be used to illustrate our methodologies.