Based on the quantum error-correction codes and concatenation, quantum logical gates can be implemented transversally, which is called the fault-tolerant quantum computation. Clifford gates can be directly and fault-tolerantly performed, but they cannot reach universal quantum computation. How to implement the non-Clifford gate fault-tolerantly is a vital technique in fault-tolerant universal quantum computation. Here the magic state is selected to help the implementing of the non-Clifford gate transversally. Based on the non-stabilizer state cos θi|0>+sinθi|1>, circuits which can execute 2θi rotation around X-axis and Z-axis fault-tolerantly are proposed. Then new non-stabilizer states in this form are developed and produced from the distilled magic state. By using these states, a number of non-Clifford gates can be performed transversally, which makes profound implication in fault-tolerant quantum computation. We calculate the number of the non-stabilizer states needed for simulating the desired rotation operations, which is less than that in previous protocols.