Abstract: This paper develops a measurement model of image centroid position and a decoupled Kalman filter consisting of a constant velocity filter and an acceleration one for tracking maneuvering target. The output of acceleration filter is used to correct the output of the velocity filter. The acceleration filter can be turned on and off according to the target maneuvering. The simulation result shows the good performance for the algorithm.