Video packets are discarded during transmission when the network signal attenuation is bad. Intensive study has been performed on the delay and jitter phenomena. Jittering is caused by delaying. It is extracted to establish assessment model with video bit rate. At last, packet loss and jitter are studied together. Several video sequences are used and WAN emulator is used to generate loss and jitter. The experiment of subjective assessment is done strictly. For packet loss, this paper analyzes the packet loss rate, packet loss type and the length which affect the video quality. The linear neural network is used to establish the evaluation metric. The establishment of a transport network simulation platform simulates network packet loss, jitter and bit rate simultaneously for the video transmission quality evaluation model. Finally, for jitter, mainly with the jitter buffer size for the normalization process, and then together with the packet loss and video bit rate as the parameters, the use of BP neural network evaluation is the metric.