In this paper, an improved and simple self-consistent effective-medium theory is developed. The effect of dispersed second phase particle on the ionic conduction of ionic conductors is discussed by the theory. It is found that the theoretical result is consistent with experiments. The theory can perdict the effect of microscopic feature of the material on the macroscopic ionic conduction.