Compared with the lithium-ion battery based on the non-aqueous electrolyte, all-solid-state lithium battery has received much attention and been widely studied due to its superiority in both safety and energy density. The electrochemical window of solid electrolyte determines whether the electrolyte remains stable during the cycling of the high-voltage battery. Current solid electrolytes typically have narrow electrochemical windows, thereby limiting their coupling with high voltage cathodes and lithium metal anode. Therefore, the formation of the stable interphase determines the stabilities of the all-solid-state batteries. Here in this work, both the experimental and theoretical progress of the electrochemical stability window of solid-state electrolytes are summarized. Besides, the experimental achievements in improving the stability of the interphase are also mentioned. On this basis, the strategies of constructing dynamically stable interphase and preventing the lithium dendrite branch crystal from forming are put forward. The future research direction of the interphase construction in all-solid-state batteries is also presented.