In the study of color digital holography, using the spherical wave as the reconstruction wave, the wave-front reconstruction with the angular spectrum diffraction formula is an effective approach. However, this method is usually accompanied by intense zero-order diffraction interruption. In this paper, based on the theoretical analysis, an important modification of the wave-front reconstruction process has been made. The color digital holography experiment result demonstrated that the quality of reconstructed color image has been improved remarkably with this modified method.