In order to improve recognition rate of sports video, a novel sports video recognition method based on multi-features ad neural network was proposed. Firstly, the color, texture, brightness, motion vector features of sports video were extracted, and then the features were input into RBF neural network to learn and got the preliminary classification results which were taken as evidences of evidence theory, finally, evidence theory was used to fuse preliminary classification results and get the final recognition results of sports video, the simulation results show that the proposed method has improved the recognition rate of sports video and it is an effective sports video recognition method, compared with the reference algorithms.