by Simon Hadfield and Richard Bowden
Abstract:
In this paper, an algorithm is presented for estimating scene ?ow, which is a richer, 3D analogue of Optical Flow. The approach operates orders of magnitude faster than alternative techniques, and is well suited to further performance gains through parallelized implementation. The algorithm employs multiple hypothesis to deal with motion ambiguities, rather than the traditional smoothness constraints, removing oversmoothing errors and providing signi?cant performance improvements on benchmark data, over the previous state of the art. The approach is ?exible, and capable of operating with any combination of appearance and/or depth sensors, in any setup, simultaneously estimating the structure and motion if necessary. Additionally, the algorithm propagates information over time to resolve ambiguities, rather than performing an isolated estimation at each frame, as in contemporary approaches. Approaches to smoothing the motion ?eld without sacri?cing the bene?ts of multiple hypotheses are explored, and a probabilistic approach to Occlusion estimation is demonstrated, leading to 10% and 15% improved performance respectively. Finally, a data driven tracking approach is described, and used to estimate the 3D trajectories of hands during sign language, without the need to model complex appearance variations at each viewpoint.
Reference:
Scene Particles: Unregularized Particle Based Scene Flow Estimation (Simon Hadfield and Richard Bowden), In IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI), volume 36, 2014.
Bibtex Entry:
@Article{Hadfield14,
Title = {Scene Particles: Unregularized Particle Based Scene Flow Estimation},
Author = {Simon Hadfield and Richard Bowden},
Journal = {IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI)},
Year = {2014},
Month = {March},
Number = {3},
Pages = {564 -- 576},
Volume = {36},
Abstract = {In this paper, an algorithm is presented for estimating scene ?ow, which is a richer, 3D analogue of Optical Flow. The approach operates orders of magnitude faster than alternative techniques, and is well suited to further performance gains through parallelized implementation. The algorithm employs multiple hypothesis to deal with motion ambiguities, rather than the traditional smoothness constraints, removing oversmoothing errors and providing signi?cant performance improvements on benchmark data, over the previous state of the art. The approach is ?exible, and capable of operating with any combination of appearance and/or depth sensors, in any setup, simultaneously estimating the structure and motion if necessary. Additionally, the algorithm propagates information over time to resolve ambiguities, rather than performing an isolated estimation at each frame, as in contemporary approaches. Approaches to smoothing the motion ?eld without sacri?cing the bene?ts of multiple hypotheses are explored, and a probabilistic approach to Occlusion estimation is demonstrated, leading to 10% and 15% improved performance respectively. Finally, a data driven tracking approach is described, and used to estimate the 3D trajectories of hands during sign language, without the need to model complex appearance variations at each viewpoint.},
Doi = {10.1109/TPAMI.2013.162},
Gsid = {14919569016960892782},
Keywords = {Scene Flow, Scene Particles, Motion Estimation, 3D, 3D Motion, Particle, Particle Filter, Optical Flow, Hand Tracking, Sign Language, Tracking, Occlusion Estimation, Probabilistic Occlusion, Occlusion, Bilateral Filter, 3D Tracking, Motion Segmentation},
Timestamp = {2013.11.05},
Url = {http://personalpages.surrey.ac.uk/s.hadfield/papers/Scene%20particles.pdf}
}