In this paper, the lattice vibrational modes of the nonlinear optical crystal BaBPO5 are studied using polarized Raman spectrum and the first-principles calculation. The polarized Raman spectra are obtained in different configurations and recorded in a range of 100-1600 cm-1. Combining the experimental data of the FT-IR spectrum, the lattice vibrational modes of the internal and external vibrations are analyzed by the factor group analysis method. The results indicate that the primary Raman peaks of the BaBPO5 crystal are ascribed to the internal vibrations of the PO4 and BO4 tetrahedrons, and the vibrations of the PO4 tetrahedron show strong Raman- and IR-activity. On the other hand, the first-principles calculation indicates the correlation of the vibrational modes with the atomic activities. Especially, the Raman peak located at 672 cm-1 is ascribed to the vibration of the B-O-P bond, which is the connector between the PO4 and BO4 tetrahedron. These results obtained in this work are important for understanding the micro-structures of the BaBPO5 crystal, and the further study on the crystal growth mechanism.