Changhyun Choi

Henrik I. Christensen

We present a 3D model-based visual tracking approach using edge and keypoint features in a particle filtering framework. Recently, particle filtering based approaches have been proposed to integrate multiple pose hypotheses and have shown good performance, but most of the work has made an assumption that an initial pose is given. To ameliorate this limitation, we employ keypoint features for initialization of the filter. Given 2D-3D keypoint correspondences, we randomly choose a set of minimum correspondences to calculate a set of possible pose hypotheses. Based on the inlier ratio of correspondences, the set of poses are drawn to initialize particles. After the initialization, edge points are employed to estimate inter-frame motions. While we follow a standard edge-based tracking, we perform a refinement process to improve the edge correspondences between sampled model edge points and image edge points. For better tracking performance, we employ a first order autoregressive state dynamics, which propagates particles more effectively than Gaussian random walk models. The proposed system re-initializes particles by itself when the tracked object goes out of the field of view or is occluded. The robustness and accuracy of our approach is demonstrated using comparative experiments on synthetic and real image sequences.

Changhyun Choi, Henrik I. Christensen, “Robust 3D visual tracking using particle filtering on the special Euclidean group: A combined approach of keypoint and edge features,” International Journal of Robotics Research (IJRR), vol. 31, no. 4, pp. 498-519, Apr. 2012. [ abstract | pdf ]

Changhyun Choi, Henrik I. Christensen, “Robust 3D Visual Tracking Using Particle Filtering on the SE(3) Group,” in Proceedings of IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 2011. [ pdf ]

Changhyun Choi, Henrik I. Christensen, “Real-time 3D Model-based Tracking Using Edge and Keypoint Features for Robotic Manipulation,” in Proceedings of IEEE International Conference on Robotics and Automation (ICRA), Anchorage, AK, USA, 2010. [ pdf ]