scientific papers

An architecture for big data processing on intelligent transportation systems. An application scenario on highway traffic flows

September 30, 2016

By: Uninova

The transportation sector, and in particularly intelligent transportation systems, generate large volumes of real-time data that needs to be managed, communicated, interpreted, aggregated, and analyzed. To this end, innovative big data processing and mining as well as optimization techniques, need to be developed and applied in order to support real-time decision-making capabilities. Towards this end, this paper presents an ETL (extract, transform and load) architecture for intelligent transportation systems, addressing an application scenario on dynamic toll charging for highways. The ETL approach presented here, is responsible for preparing the data to be used by traffic prediction services, which will dynamically affect toll prices within different contexts. The proposed architecture relies on the adoption of “big data” technologies, to process and store large volumes of data from heterogeneous sources, provided by different highway operators. The proposed architecture is capable of handling real-time and historical data using big data technologies such as Spark on Hadoop and MongoDB. The DATEX-II data model is adopted, in order to harmonize traffic data provided by the highway operators. The work presented here, is still part of ongoing work currently addressed under the EU H2020 OPTIMUM project. Preliminary results achieved so far do not address the final conclusions of the project, but enabled us to demonstrate considerable gains in performance, when compared to other traditional ETL approaches, and also form the basis for pointing out and discuss future work directions and opportunities in the area of the development of big data processing and mining methods under the ITS domain.


From mobility patterns to behavioural change
Using persuasive technology and reward schemes to promote sustainable travel choices
Behavioural Change Support Intelligent Transportation Applications
Persuasive Technologies for Sustainable Mobility: State of the Art and Emerging Trends
Providing Intermodal Route Alternatives
Making Big Data Real in Upcoming Future: the Dynamic Toll Prices in the Portuguese Highways
Real-Time Monitoring of Road Traffic using Data Stream Mining
How to not be Annoying: Adjusting Persuasive Interventions Intensity when Nudging for Sustainable Travel Choices
Big data proceedings and storage framework for ITS – A case study on dynamic tolling
OPTIMUM Project: Geospatial data analysis for sustainable mobility
Persuasive Interventions for Sustainable Travel Choices Leveraging Users’ Personality and Mobility Type
Understanding Personal Mobility Patterns for Proactive Recommendations
Incident Detection Using Data from Social Media
Curious Cat – Mobile, Context-Aware Conversational Crowdsourcing Knowledge Acquisition
A Big Data Architecture for Traffic Forecasting Using Multi-Source Information
Exploring the Links between Persuasion, Personality and Mobility Types in Personalised Mobility Applications
Towards System-Aware Routes
Proactive Charging Schemes for Freight Transport: Dynamic Toll Discounts as a Tool to Reduce National Road Traffic
Big Data Processing and Storage Framework for ITS: A Case Study on Dynamic Tolling
Personalised Persuasion for Sustainable Mobility
Persuasive Technologies for Sustainable Urban Mobility
Estimating the State of Battery Charge in an Intelligent Mobile Home
Near Real-Time Transportation Mode Detection Based on Accelerometer Readings
Spatio-temporal Clustering Methods
Big Data Harmonization for Intelligent Mobility: a Dynamic Toll-charging Scenario
Memory Priming and User Preferences
Smart Cargo for Multimodal Freight Transport: When “Cloud” becomes “Fog”
Travel Time Prediction on Highways
Curious Cat2 – Conversational Crowd-Based and Context-Aware Knowledge Acquisition Chat Bot
TensiStrength – Stress and Relaxation Magnitude Detection for Social Media Texts
Proactive recommendations for Intelligent Mobility - An approach based on real-time big data processing
Personalized Persuasion Services for Route Planning Applications
Understanding Personal Mobility Patterns for Proactive Recommendations