Abstract: Aiming at several problems occurred in multi-object tracking,such as the moving objects interleaving or overlapping, and the object losing momentarily,a new multi-object tracking algorithm is proposed that combines the modified Camshift(continuously adaptive mean shift) algorithm with Kalman filter.In the Camshift algorithm,a back-projection image is obtained from the color histogram model of each image frame,the size of searching window is adjusted adaptively on the object's size,and the center position of window is computed iteratively.By extending the searching window'size adaptively,the issue of the object losing instantaneously from the current window for motion acceleration is solved.Moreover, Kalman filter is used for estimating the position of each moving object to overcome the moving objects interleaving or ovrelapping,and noise disturbance.The experimental results show that the proposed algorithm can improve the performance of multi-object tracking effectively,and realize keeping on multi-object tracking continuously.