In view of how to accurately evaluate the quality of public physical education in colleges and universities, this paper proposes a new comprehensive evaluation model of teaching quality based on the characteristics of public physical education in colleges and universities. Firstly, this paper introduces the research status of the evaluation of physical education teaching quality in colleges and universities. Then, it studies the object and teaching characteristics of public physical education in colleges and universities. Finally, it proposes a new comprehensive evaluation model of teaching quality for public physical education in colleges and universities. The survey shows that the model proposed in this paper can make a comprehensive evaluation of the teaching quality of public physical education in colleges and universities. The research results of this paper provide a theoretical basis for further improving the teaching quality of public physical education in colleges and universities, provides tools for the specific teaching of public physical education in colleges and universities and some help for the achievement of the overall teaching objective of higher education.