Example of reactive navigation

by using the Curvature-Velocity Method

Example of trajectory tracking

by using Pure Pursuit Controller

Autonomous navigation system based

on GPS and lanelets

Manual navigation assisted

by 3D lidar and camera

 

Object detection and tracking of the point clouds

generated by the fusion of 3D lidar

and the stereo camera

 

Use cases

Adaptative Cruise Control

Simulation

Real

Overtaking

Simulation

Real

Pedestrian Crossing

Simulation


Real

Stop Situation

Simulation

Real

Round about situation

Simulation

 

Real

 

Give away situation

Simulation

 

Real

 

 

 

 

 

JOURNAL PAPERS (included in the ISI-JCR)

2019

  • Kailun Yang, Xinxin Hu, Luis M. Bergasa, Eduardo Romera and Kaiwei Wang, “PASS: Panoramic Annular Semantic Segmentation”, in IEEE Transactions on Intelligent Transportation Systems. September 2019 (Early Access). [PDF].
  • Kailun Yang, Luis M. Bergasa, Eduardo Romera, Kaiwei Wang, “Robustifying Semantic Perception of Traversability across Wearable RGB-Depth Cameras”, in Applied Optics. Vol 58, nº12, 3141-3155. April 2019. [PDF]. Editors’ Pick
  • Álvaro Sáez, Luis M. Bergasa, Elena López-Guillén, Eduardo Romera, Miguel Tradacete, Carlos Gómez-Huélamo and Javier del Egido, “Real-time Semantic Segmentation for Fisheye Urban Driving Images based on ERFNet”, in Sensors. Vol 19(3), nº503, 1-20. January 2019. [PDF]

2018

  • Kailun Yang, Kaiwei Wang, Luis M. Bergasa, Eduardo Romera, Weijian Hu, Dongming Sun, Junwei Sun, Ruiqi Cheng, Tianxue Chen, Elena López, “Unifying Terrain Awareness for the Visually Impaired through Real-time Semantic Segmentation”, in Sensors. Vol 18(5), nº1506, 1-32 (2018). [PDF]
  • R. Arroyo, P.F. Alcantarilla, L.M. Bergasa, E. Romera, “Are You ABLE to Perform a Life-Long Visual Topological Localization?”, Autonomous Robots, 42 (3), 665-685. March 2018. Online version July 2017. [PDF]
  • Qi Wang, Luis M. Bergasa, José M. Álvarez, “Guest Editorial Introduction to the Special Issue on Robust and Efficient Vision Techniques for Intelligent Vehicles”, in IEEE Transactions on Intelligent Transportation Systems, Vol 19, Issue 1, 129-130, January 2018. [PDF]
  • E. Romera, J.M. Álvarez, L.M. Bergasa, R. Arroyo, “ERFNet: Efficient Residual Factorized ConvNet for Real-time Semantic Segmentation”, in IEEE Transactions on Intelligent Transportation Systems. Vol 19, Issue 1, 263-272, January 2018. Online version July 2017. [PDF]. Main publication in GSM (2014-2018).

2017

Autores (p.o. de firma): Sebastián Bronte, Luis M. Bergasa, Daniel Pizarro
Título: “Model-Based Real-time Non-Rigid Tracking”
Ref. revista / Libro: Sensors (ISSN 1424-8220)
Clave:    R            Volumen:    Número:     Páginas, inicial:    final:    Fecha: Submitted May 2017
Editorial (si libro):            MDPI Publishing                                            Lugar de publicación: England
Categoría de la revista en el JCR: Instruments & Instrumentation (2015): 12 de 56 (1º cuartil) 
 
Autores (p.o. de firma): E. Romera, J.M. Álvarez, Luis M. Bergasa, R. Arroyo
Título: “ERFNet: Efficient Residual Factorized ConvNet for Real-time Semantic Segmentation”
Ref. revista / Libro: IEEE Transactions on Intelligent Transportation Systems (ISSN: 1524-9050)
Clave:    R            Volumen:    Número:     Páginas, inicial:    final:    Fecha: Submitted March 2017
Editorial (si libro):            IEEE                                                             Lugar de publicación: USA
Categoría de la revista en el JCR: Transportation Science & Technology (2015): 8 de 33 (1º cuartil)
 

2016

  • R. Arroyo, P.F. Alcantarilla, L.M. Bergasa, E. Romera, “Are You ABLE to Perform a Life-Long Visual Topological Localization?”, Autonomous Robots. Submitted on April 2016
 

CONFERENCES

2019

  • Rafael Barea, Luis M. Bergasa, Eduardo Romera, Elena López-Guillén, Oscar Pérez, Miguel Tradacete and Joaquín López, “Integrating well-known CNNs for Multi-Sensor 3D Vehicle Detection in Real Autonomous Driving Environments”, in IEEE Conference on Intelligent Transportation Systems (ITSC), Auckland, New Zealand, October 2019. Accepted on July 2019.
  • Carlos Gómez-Huelamo, Luis M. Bergasa, Rafael Barea, Elena López-Guillén, Sandra Carrasco, Pablo Sánchez, “Simulating use cases for the UAH Autonomous Electric Car”, in IEEE Conference on Intelligent Transportation Systems (ITSC), Auckland, New Zealand, October 2019. Accepted on July 2019.
  • Luis M. Bergasa, Javier Araluce, Eduardo Romera, Rafael Barea, Elena López-Guillén, Javier del Egido, Sandra Carrasco, “Naturalistic Driving Study for Older Drivers based on the DriveSafe App”, in IEEE Conference on Intelligent Transportation Systems (ITSC), Auckland, New Zealand, October 2019. Accepted on July 2019.
  • Eduardo Romera, Luis M. Bergasa, Kailun Yang, Jose M. Alvarez, Rafael Barea, “Bridging the Day and Night Domain Gap for Semantic Segmentation”, in IEEE Intelligent Vehicles Symposium (IV), Paris, France, June 2019. [PDF].
  •  K. Yang, Xinxin Hu, Luis M. Bergasa, Eduardo Romera, Xiao Huang, Dongming Sun and Kaiwei Wang, “Can we PASS beyond the Field of View? Panoramic Annular Semantic Segmentation for Real-World Surrounding Perception”, in IEEE Intelligent Vehicles Symposium (IV), Paris, France, June 2019. [PDF] [Video]

2018

  • Miguel Tradacete, Álvaro Sáez, Juan F. Arango, Carlos Gómez-Huélamo, P. Revenga, Rafael Barea, Elena López-Guillén, Luis M. Bergasa, “Positioning system for an electric autonomous vehicle based on the fusion of Multi-GNSS RTK and Odometry by using an Extented Kalman Filter”, in International Workshop of Physical Agents (WAF), Madrid, Spain, November 2018. [PDF].
  • Carlos Gómez-Huélamo, Pablo F. Alcantarilla, Luis M. Bergasa and Elena López-Guillén, “Change Detection Tool Based on GSV to Help DNNs Training”, in International Workshop of Physical Agents (WAF), Madrid, Spain, November 2018. [PDF].
  • Esther Murciego, Carlos Gómez-Huélamo, Rafael Barea, Luis M. Bergasa, Eduardo Romera, Juan F. Arango, Miguel Tradacete, and Álvaro Sáez, “Topological road mapping for autonomous driving applications”, in International Workshop of Physical Agents (WAF), Madrid, Spain, November 2018. [PDF].
  • Edwin Enríquez, Nelly Gordillo, Luis M. Bergasa, Eduardo Romera, Carlos Gómez-Huélamo, “Convolutional Neural Networks vs Traditional Methods applied to off-line Recognition of Handwritten Digits”, in International Workshop of Physical Agents (WAF), Madrid, Spain, November 2018. [PDF].
  • Javier del Egido, Luis M. Bergasa, Eduardo Romera, Carlos Gómez-Huélamo, Javier Araluce, Rafael Barea, “Self-Driving a Car in simulation through a CNN”, in International Workshop of Physical Agents (WAF), Madrid, Spain, November 2018. [PDF].
  •  Kailun Yang, Ruiqi Cheng, Luis M. Bergasa, Eduardo Romera, Kaiwei Wang and Ningbo Long, “Intersection perception through real-time semantic segmentation to assist navigation of visually impaired pedestrians”, in International Conference on Robotics and Biomimetics (ROBIO), Kuala Lumpur, Malaysia, December 2018. [PDF].
  • Kailun Yang, Luis M. Bergasa, Eduardo Romera, Juan Wang, Kaiwei Wang, Elena López-Guillén, “Perception framework of water hazards beyond traversability for real-world navigation assistance systems”, in International Conference on Robotics and Biomimetics(ROBIO), Kuala Lumpur, Malaysia, December 2018. [PDF].
  • Kailun Yang, Luis M. Bergasa, Eduardo Romera, Xiao Huang and Kaiwei Wang, “Predicting polarization beyond semantics for wearable robotics”, in International Conference on Humanoid Robots (Humanoids), Beijing, China, November 2018. [PDF].
  • Rafael Barea, Carlos Pérez de Rivas, Luis M. Bergasa, Elena López-Guillén, Eduardo Romera, Eduardo Molinos, Manuel Ocaña, Joaquín López, “Vehicle Detection and Localization using 3D LIDAR Point Cloud and Image Semantic Segmentation”, in IEEE Conference on Intelligent Transportation Systems (ITSC), Maui, Hawaii, USA, November 2018. [PDF] [Video].
  • Kailun Yang, Luis M. Bergasa, Eduardo Romera, Dongming Sun, Kaiwei Wang and Rafael Barea, “Semantic perception of curbs beyond traversability for real-world navigation assistance systems”, in IEEE International Conference on Vehicular Electronics and Safety (ICVES), Madrid, Spain, September 2018. [PDF].
  • Álvaro Sáez, Luis M. Bergasa, Eduardo Romera, Elena López-Guillén, Rafael Barea, “CNN-based Fisheye Image Real-Time Semantic Segmentation”, in IEEE Intelligent Vehicles Symposium (IV), Changshu, Suzhou, China, June 2018. [PDF] [Video]
  • Eduardo Romera, Luis M. Bergasa, José M. Álvarez and Mohan Trivedi, “Train Here, Deploy There: Robust Segmentation in Unseen Domains”, in IEEE Intelligent Vehicles Symposium (IV), Changshu, Suzhou, China, June 2018. [PDF] [Video]
  • K. Yang, L.M. Bergasa, E. Romera, R. Cheng, T. Chen and K. Wang, “Unifying terrain awareness through real-time semantic segmentation”, in IEEE Intelligent Vehicles Symposium (IV), Changshu, Suzhou, China, June 2018. [PDF] [Video]
  • L.M. Bergasa, R. Sanz, J. López, E. Paz, C. Otero, P. Sánchez, R. Barea, E. López-Guillén, P. Revenga, E. Molinos, E. Romera, “Desarrollo de un vehículo eléctrico autónomo de código abierto para personas mayores”, in Actas de las Jornadas Nacionales de Robótica 2018, Valladolid, Spain, June 2018. [PDF]
  • K. Yang, K. Wang, S. Lin, J. Bai, L.M. Bergasa, R. Arroyo, “Long-range Traversability Awareness and Low-lying Obstacle Negotiation with RealSense for the Visually Impaired”, in 2nd International Conference on Frontiers of Image Processing (ICFIP), Barcelona (Spain), March 2018. [PDF]. Best Paper Award at the ICFIP2018.

2017

  • W. Zhou, R. Arroyo, A. Zyner, J. Ward, S. Worrall, E. Nebot, L.M. Bergasa, “Transferring Visual Knowledge based on Deep Learning for a Robust Road Environment Perception in Intelligent Vehicles”, in IEEE Intelligent Vehicles Symposium (IV), California (USA), June 2017. Submitted on January 2017
  • E. Romera, J.Mª. Álvarez, L.M. Bergasa, R. Arroyo, “Efficient ConvNet for Real-time Semantic Segmentation”, in IEEE Intelligent Vehicles Symposium (IV), California (USA), June 2017. [PDF]. Best Student Paper Award at the IV2017.
 

2016

  • R. Arroyo, L. M. Bergasa, E. Romera, OpenABLE: An Open-source Toolbox for Autonomous Vehicles Life-Long Visual Localization”, in 19th International IEEE Conference on Intelligent Transportation Systems (ITSC), Rio de Janeiro, (Brazil), November 2016. [PDF]
  • C. Arroyo, L. M. Bergasa, E. Romera, “Adaptive Fuzzy Classifier to detect Driving Events from the Inertial Sensors of a Smartphone”, in 19th International IEEE Conference on Intelligent Transportation Systems (ITSC), Rio de Janeiro, (Brazil), November 2016. [PDF]
  • E. Romera, L. M. Bergasa, R. Arroyo, A. Lázaro, “Need Data for Driver Behaviour Analysis? Presenting the public UAH-DriveSet”, in 19th International IEEE Conference on Intelligent Transportation Systems (ITSC), Rio de Janeiro, (Brazil), November 2016. [
    " target="_blank" rel="noopener noreferrer">[Video]
  • R. Arroyo, P. F. Alcantarilla, L.M. Bergasa, E. Romera, “Fusion and Binarization of CNN Features for Robust Topological Localization across Seasons”, in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, (Korea), October 2016. [
    " target="_blank" rel="noopener noreferrer">[Video]
  • E. Romera, L. M. Bergasa and R. Arroyo "Can we unify monocular detectors for autonomous driving by using the pixel-wise semantic segmentation of CNNs?", in Workshops of IEEE Intelligent Vehicles Symposium (IV-W), Gothenburg (Sweden), June 2016. [PDF]
  • A. Lázaro, J. Moriano, L.M. Bergasa, R. Barea, E. López, " Grabbing Objects though a Robotic Arm and Hand in a Safety Way", in Open Conference on Future Trends in Robotics (RoboCity16), pp. 357-364, Madrid (Spain), May 2016. [PDF]
  • A. Lázaro, R. Barea, L.M. Bergasa, E. López, "UGV Navigation in ROS using LIDAR 3D", in Open Conference on Future Trends in Robotics (RoboCity16), pp. 301-308, Madrid (Spain), May 2016. [PDF]
  • A. Lázaro, J. Moriano, L.M. Bergasa, R. Barea, E. López, "3D Object Recognition and Pose Estimation using VFH Descriptors", in Open Conference on Future Trends in Robotics (RoboCity16), pp. 113-120, Madrid (Spain), May 2016. [PDF]
  • L. Caramazana, R. Arroyo and L. M. Bergasa, "Visual Odometry Correction based on Loop Closure Detection", in Open Conference on Future Trends in Robotics (RoboCity16), pp. 97-104, Madrid (Spain), May 2016. [PDF]

 

 

 

Institutions

 
Robesafe Group. Department of Electronics. University of Alcalá. Polytechnic School. Campus Universitario Ctra. de Madrid-Barcelona, Km. 33,600 28871 Alcalá de Henares (Madrid) – Spain. (www.robesafe.uah.es/)
 
 
 
 
 
 
 
 
GROBIS Group. Departamento de Ingeniería de Sistemas y Automática. Universidad de Vigo. Industrial Engineering School. Rúa Maxwell, s/n. Campus Universitario Lagoas-Marcosende 36310 Vigo, Pontevedra. Spain. (http://webs.uvigo.es/vigobot/)
 
 
 

Funding

 
Project funding by Ministerio de Economía y Competitividad. Ref: UAH: TRA2015-70501-C2-1-R (2016-2018), UVIGO: TRA2015-70501-C2-2-R (2016-2018)

Brief Description

 
Statistics show that 68% of the population in the European Union (EU), including associated states, is living in urban areas. According to the World Health Organization, nearly one third of the world population will live in cities by 2030. Aware of this problem, the Transport White Paper published by the European Commission in 2011 indicated that new forms of mobility should be proposed to provide sustainable solutions for people and goods safely. Regarding safety, it sets the ambitious goal of halving the overall number of road deaths in the EU between 2010-2020. However, the goal will not be easy, only in 2014 more than 25,700 people died on the roads in the EU (18% reduction). Besides, some studies show that fatal accidents increase with age for people 65 years and older.
Autonomous driving is considered as one of the solutions to the before mentioned problems and one of the great challenges of the automotive industry today. The existence of reliable and economically affordable autonomous vehicles will create a huge impact on society affecting environmental, demographic, social and economic aspects. In particular, it is estimated to cause a reduction in road deaths, improved traffic flow, reduced fuel consumption and harmful emissions associated, as well as an improvement in the overall driver comfort and mobility in groups with impaired faculties, like the elderly or disabled people.
Autonomous driving has attracted much attention recently by the research groups and industry, due to the billboards of various companies on expectations of market entry. However, his predictions seem to be very optimistic. A more scientific organization, such as IEEE, has recently predicted that by 2040 the majority of vehicles traveling on highways will be autonomous. Driving in urban environments will take longer, due to its complexity and uncertainty.
With this background, this project will focus on the research in technologies for the development of an autonomous electric car to assist the elderly population in predominantly urban environments. The proposal is disruptive because it raises new techniques applied on a future electric car, where Spain is an international reference, and targeted to a sector of the population with growing needs. The proposed system is based on the most advanced techniques of sensory perception and in-vehicle mapping, control and path planning in dynamic and changing environments.
A sensor fusion architecture based primarily on computer vision, laser and GPS technologies will be developed. The architecture will allow the mapping of the environment, the semantic classification of the scene and the real-time detection of obstacles in the path. This, together with vehicle positioning technology based on digital maps, will establish the planning and control algorithms to carry out the independent movement of the vehicle from a source to a destination provided by the user. Additionally, a study of the behavior of senior drivers will take place, to identify shortcomings and limitations, and develop a customized HMI.

Members and Collaborators

 

UAH

  • This email address is being protected from spambots. You need JavaScript enabled to view it. (Full Professor). Co-coordinator
  • This email address is being protected from spambots. You need JavaScript enabled to view it. (Associate Professor). Co-coordinator
  • This email address is being protected from spambots. You need JavaScript enabled to view it. (Associate Professor)
  • This email address is being protected from spambots. You need JavaScript enabled to view it. (Lecturer)
  • This email address is being protected from spambots. You need JavaScript enabled to view it. (Recruited Post-doc Researcher)
  • This email address is being protected from spambots. You need JavaScript enabled to view it. (PhD Researcher)
  • This email address is being protected from spambots. You need JavaScript enabled to view it. (Collaborator)
 

UVIGO

  • This email address is being protected from spambots. You need JavaScript enabled to view it. (Full Professor). Co-coordinator
  • This email address is being protected from spambots. You need JavaScript enabled to view it. (Associate Professor). Co-coordinator
  • This email address is being protected from spambots. You need JavaScript enabled to view it. (Associate Professor)
  • This email address is being protected from spambots. You need JavaScript enabled to view it. (Associate Professor)
  • This email address is being protected from spambots. You need JavaScript enabled to view it. (Recruited PhD Researcher)