In this paper, a harmonized multi-time difference scheme is established, which can be easily constructed on any numerical difference scheme of ordinary differential equations. A sufficiently stable condition is proved in mathematics. If the memorial coefficients determined by an improved method of least square, it is expected that this new scheme can integrate stably in a longer period, and a better result can be achieved.