With the rapid increase of the thermal power density of microelectronic devices and circuits, controlling its temperature has become an urgent need for the development and application of the electronic industry. By virtue of the ultrahigh thermal conductivity of graphene, developing high-performance graphene-based composite thermal interface materials has attracted much research attention and become one of hot research topics. The understanding of phonon transport mechanism in graphene-based composites at atomic scale can be helpful to enhance the heat conductive capability of composites systems. In this review, focused on graphene-based thermal interfaces materials, the heat conduction mechanism and the regulating strategy are introduced on both the internal thermal resistance and interfacial thermal resistance. Finally, the reseach progress and opportunities for future studies are also summarized.