Hostname: page-component-78c5997874-fbnjt Total loading time: 0 Render date: 2024-11-16T17:30:32.318Z Has data issue: false hasContentIssue false
  • English
  • Français

Matching monocular lightweight features using N-gram techniques for topological location identification

Published online by Cambridge University Press:  01 May 2014

Jaime Boal ,
Álvaro Sánchez-Miralles  and
Manuel Alvar
Jaime Boal*
Affiliation:
Institute for Research in Technology (IIT), ICAI School of Engineering, Comillas Pontifical University, Madrid, Spain
Álvaro Sánchez-Miralles
Affiliation:
Institute for Research in Technology (IIT), ICAI School of Engineering, Comillas Pontifical University, Madrid, Spain
Manuel Alvar
Affiliation:
Institute for Research in Technology (IIT), ICAI School of Engineering, Comillas Pontifical University, Madrid, Spain
*
*Corresponding author. E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Summary

In SLAM (simultaneous localization and mapping), the topological paradigm provides a more natural and compact solution that scales better with the size of the environment. Computer vision has always been regarded as the ideal sensor technology for topological feature extraction and description and several methods have been proposed in the literature, but they are either time-consuming, require plenty of different sensors, or are very sensitive to perceptual aliasing, all of which limit their application scope.

This paper presents a fast-to-compute collection of features extracted from monocular images, and an adaptive matching procedure for location identification in structured indoor environments inspired by the natural language processing field. Although only dominant vertical lines, color histograms, and a reduced number of keypoints are employed in this paper, the matching framework introduced allows for the incorporation of almost any other type of feature. The results of the experiments carried out in a home and an office environment suggest that the proposed method could be used for real-time topological scene recognition even if the environment changes moderately over time. Due to the combination of complementary features, high precision can be achieved within reasonable computation time by using weaker but faster descriptors.

Keywords

Computer visionMobile robotsRobot localizationSLAMTopological modeling of robots
Type
Articles
Information
Robotica , Volume 33 , Issue 9 , November 2015 , pp. 1835 - 1849
Copyright
Copyright © Cambridge University Press 2014 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

1. Agrawal, M., Konolige, K. and Blas, M. R., “CenSurE: Center surround Extremas for Realtime Feature Detection and Matching” In: European Conference on Computer Vision Lecture Notes in Computer Science, vol. 5305. (Forsyth, D., Torr, P. and Zisserman, A., eds.) (Springer, 2008) pp. 102–115.Google Scholar
2. Angeli, A., Doncieux, S., Meyer, J.-A. and Filliat, D., “Incremental Vision-Based Topological SLAM”, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice, France (Sep. 22–26, 2008) pp. 1031–036.Google Scholar
3. Bay, H., Ess, A., Tuytelaars, T. and van Gool, L., “SURF: Speeded up robust features”, Comput. Vis. Image Underst. 110 (3), 346–359 (2008).Google Scholar
4. Bologna, G., Deville, B. and Pun, T., “Blind Navigation Along a Sinuous Path by Means of the See ColOr Interface”, In: Proceedings of the International Work–Conference on the Interplay Between Natural and Artificial Computation. Part II: Bioinspired Applications in Artificial and Natural Computation (Mira, J., Álvarez, J. R., de la Paz, F. and Ferrández, J. M., eds.) (Springer-Verlag, Santiago de Compostela, Spain, 2009) pp. 235–243.Google Scholar
5. Booij, O., Terwijn, B., Zivkovic, Z. and Kröse, B., “Navigation Using an Appearance Based Topological Map”, Proceedings of the IEEE International Conference on Robotics and Automation, Rome, Italy (Apr. 10–14, 2007) pp. 3927–3932.Google Scholar
6. Bradski, G., “The OpenCV library”, (2000). http://opencv.willowgarage.com.Google Scholar
7. Brooks, R. A., “Elephants don't play chess”, Robot. Auton. Syst. 6, 3–15 (1990).Google Scholar
8. Cha, S.-H., “Comprehensive survey on distance/similarity measures between probability density functions”, Int. J. Math. Models Methods Appl. Sci. 1 (4), 300–307 (2007).Google Scholar
9. Comaniciu, D., Ramesh, V. and Meer, P., “Kernel-based object tracking”, IEEE Trans. Pattern Anal. Mach. Intell. 25 (5), 564–577 (2003).Google Scholar
10. Cummins, M. and Newman, P., “FAB-MAP: Probabilistic localization and mapping in the space of appearance,” Int. J. Robot. Res. 27 (6), 647–665 (2008).Google Scholar
11. Fraundorfer, F., Engels, C. and Nistér, D., “Topological mapping, localization and navigation using image collections”, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, USA (Oct. 29–Nov. 2, 2007) pp. 3872–3877.Google Scholar
12. Horvath, M., “ShapeGrid macro—Isometricland”, (2008). http://isometricland.net/povray/povray.php; last accessed: Nov. 21, 2013.Google Scholar
13. Jurafsky, D. and Martin, J. H., Speech and Language Processing (Prentice Hall, New Jersey 2009).Google Scholar
14. Kailath, T., “The divergence and Bhattacharyya distance measures in signal selection”, IEEE Trans. Commun. Technol. 15 (1), 52–60 (1967).Google Scholar
15. Lamon, P., Nourbakhsh, I., Jensen, B. and Siegwart, R., “Deriving and Matching Image Fingerprint Sequences for Mobile Robot Localization”, Proceedings of the IEEE International Conference on Robotics and Automation, Seoul, Korea (May 21–26, 2001) pp. 1609–1614.Google Scholar
16. LeCam, L., Asymptotic Methods in Statistical Decision Theory (Springer-Verlag, New York, 1986).Google Scholar
17. Liu, M., Scaramuzza, D., Pradalier, C., Siegwart, R. and Chen, Q., “Scene Recognition with Omnidirectional Vision for Topological Map Using Lightweight Adaptive Descriptors.” Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, St. Louis, USA (Oct. 11–15, 2009) pp. 116–121.Google Scholar
18. Liu, M. and Siegwart, R., “DP-FACT: Towards Topological Mapping and Scene Recognition with Color for Omnidirectional Camera” IEEE International Conference on Robotics and Automation, Saint Paul, USA (May 14–18, 2012) pp. 3503–3508.Google Scholar
19. Lowe, D. G.. “Distinctive image features from scale-invariant keypoints.,” International Journal of Computer Vision, 60 (2), 91–110 (2004).Google Scholar
20. Luo, J., Pronobis, A., Caputo, B. and Jensfelt, P., “Incremental Learning for Place Recognition in Dynamic Environments”, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, USA (Oct. 29–Nov. 2, 2007) pp. 721–728.Google Scholar
21. Magimai-Doss, M., Hakkani-Tür, D., Çetin, Ö., Shriberg, E., Fung, J. and Mirghafori, N., “Entropy Based Classifier Combination for Sentence Segmentation”, IEEE International Conference on Acoustics, Speech and Signal Processing, Honolulu, HI, USA vol. 4 (Apr. 15–20, 2007) pp. IV-189–192.Google Scholar
22. Matas, J., Chum, O., Urban, M. and Pajdla, T., “Robust Wide Baseline Stereo from Maximally Stable Extremal Regions”, Proceedings of the British Machine Vision Conference, Cardiff, UK, vol. 1 (Sep. 2–5, 2002) pp. 384–393.Google Scholar
23. Needleman, S. B. and Wunsch, C. D., “A general method applicable to the search for similarities in the amino acid sequence of two proteins”, J. Mol. Biol. 48, 443–453 (1970).Google Scholar
24. Neubeck, A. and van Gool, L., “Efficient Non-Maximum Suppression”, Proceedings of the International Conference on Pattern Recognition, Hong Kong, China, vol. 3 (Aug. 20–24, 2006) pp. 850–855.Google Scholar
25. Ramos, F. T., Upcroft, B., Kumar, S. and Durrant-Whyte, H. F.. “A Bayesian Approach for Place Recognition.” Proceedings of the IJCAI Workshop Reasoning with Uncertainty in Robotics, Edinburgh, Scotland (Jul. 30, 2005).Google Scholar
26. Rublee, E., Rabaud, V., Konolige, K. and Bradski, G., “ORB: An Efficient Alternative to SIFT or SURF,” Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain (2011) pp. 2564–2571.Google Scholar
27. Russell, S. and Norvig, P., Artificial Intelligence: A Modern Approach, 3rd ed. (Pearson Education, New Jersey, 2010).Google Scholar
28. Sabatta, D. G., “Vision-Based Topological Map Building and Localisation Using Persistent Features”, Robotics and Mechatronics Symposium, Bloemfontein, South Africa (Nov. 11, 2008) pp. 1–6.Google Scholar
29. Stankiewicz, B. J. and Kalia, A. A., “Acquisition of structural versus object landmark knowledge”, J. Exp. Psychol.: Human Perception and Performance 33 (2), 378–390 (2007).Google Scholar
30. Tapus, A., Topological SLAM – Simultaneous Localization and Mapping with Fingerprints of Places PhD thesis (Lausanne, Switzerland: École Polytechnique Fédérale de Lausanne, 2005).Google Scholar
31. Tapus, A. and Siegwart, R., “Incremental Robot Mapping with Fingerprints of Places”, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada (Aug. 2–6, 2005) pp. 2429–2434.Google Scholar
32. Tseng, D.-C. and Chang, C.-H., “Color Segmentation Using Perceptual Attributes”, Proceedings of the IAPR International Conference on Pattern Recognition, The Hage, Netherlands, vol. 3 (Aug. 30–Sep. 3, 1992) pp. 228–231.Google Scholar
33. Ulrich, I. and Nourbakhsh, I., “Appearance-Based Place Recognition for Topological Localization”, Proceedings of the IEEE International Conference on Robotics and Automation, San Francisco, USA (2000) pp. 1023–1029.Google Scholar
34. Werner, F., Sitte, J. and Maire, F., “Topological map induction using neighbourhood information of places”, Auton. Robots 32 (4), 405–418 (2012).Google Scholar