The optical parameter distribution can be determined when the polarization state and phase difference of the object wave and reference wave are given. Thus, the polarization hologram can be regarded as a complex polarizing element. According to the matrix theory of the polarizing element, the transmission matrix of polarization holograms can be found. The Jones vectors of the reconstructing wave can be found by the product of the Jones vectors of the illumination light and the transmission matrix of polarization holograms.