ベンチャー体験工房3
Developing a Novel Pattern Mining Model to Discover Hidden Patterns in Fukushima Traffic Congestion Big Data
- Japan Road Transportation Information Center (JARTIC) has set up the sensor network to monitor traffic congestion in Fukushima.
- Each road-segment in this network generates data at every 5-minute interval.
- Previous year, we have developed a data warehouse technology that generates data frames at 10 times faster than the state-of-the-art.
- This year, we plan to develop a novel pattern algorithm to discover hidden patterns.
シラバス詳細

2025年4月

4月7日
Introduction to Traffic Information Systems: Understanding JARTIC and TCSS
授業内容:We covered the role of the Japan Road Traffic Information Center (JARTIC) and the Traffic Congestion Statistical System (TCSS). We explored how JARTIC collects and distributes traffic information through 133 centers nationwide. The importance of real-time traffic data for road users was highlighted.

20250407kobo3.jpg

4月14日
Data Collection Techniques: Sensors and Measurement Points
授業内容:We learned about the data collection process using sensors installed at over 40,000 measurement points. The types of sensors, such as ultrasonic vehicle detectors, and the significance of collecting traffic volume and occupancy time every 5 minutes were thoroughly analyzed.

20250414kobo3.jpg

4月21日
Real-Time Traffic Analysis: Interpreting Congestion Data
授業内容:This class focused on the processing and interpretation of live traffic data, including the classification of congestion status into traffic jam, congestion, no congestion, and unknown (sensor abnormality). We practiced accessing this data through the TCSS interface.

20250421kobo3.jpg

2025年5月

5月5日
授業内容: Temporal and Spatial Resolution of TCSS Data :
Analyzes how TCSS offers high-resolution temporal (5-minute intervals) and spatial (road link-level and mesh code) data. This granularity allows researchers to study traffic dynamics over time and space with precision.

kobo3_20250505.jpg

5月12日
授業内容:Congestion Detection and Classification Algorithms in TCSS:
Focuses on the definitions and criteria used to detect and classify congestion. It explains how TCSS uses speed thresholds and vehicle detection data to classify congestion into levels such as "light" or "heavy" across various road types.

kobo3_20250512.jpg

5月19日
授業内容:Visualization Techniques: Mapping and Graphical Representation in TCSS.
Details the system's ability to visualize traffic data through interactive maps, Excel tables, and statistical graphs. It discusses how these visualization features support both operational monitoring and academic research.

kobo3_20250519.jpg

2025年6月

6月2日
授業内容:Traffic Data Normalization and Anomaly Handling:
We removed unnecessary unnamed columns, detected abnormal traffic values, and applied threshold-based normalization to standardize the dataset for modeling.

kobo3_20250602.jpg

6月9日
授業内容:Missing Value Imputation in Traffic Datasets:
We explored multiple imputation techniques--mean, median, mode, KNN, forward fill, and backward fill--to handle missing data. After evaluation, mean imputation was selected as the best method.

kobo3_20250609.jpg

6月16日
授業内容:Deep Learning Models for Traffic Forecasting:
We experimented with various time-series deep learning models including LSTM, Bi-LSTM, GRU, Autoencoders, Transformers, and CNNs to predict traffic patterns.

kobo3_20250616.jpg

6月23日
授業内容:LSTM-Based Traffic Flow Prediction:
We implemented an LSTM model that performed well due to its layered architecture and ability to capture long-term dependencies in traffic data.

kobo3_20250623.jpg

2025年7月

7月7日
授業内容:Conducted an exploration of forecasting models for traffic data. Studied the working mechanisms of various models and how they process traffic information. Analyzed how data flows through multiple layers in deep learning architectures, ocusing on preprocessing, feature extraction, and prediction.

kobo3_20250707.jpg

7月14日
授業内容:Implemented a deep learning model for traffic data prediction using Long Short-Term Memory (LSTM) networks. Designed the architecture of the deep learning model including input, hidden, and output layers. Focused on capturing temporal dependencies in traffic data using sequential modeling.

kobo3_20250714.jpg

7月21日
授業内容:Developed and implemented time-based forecasting techniques. Evaluated the model performance over various time intervals to improve forecasting accuracy. ocused on daily and hourly traffic patterns for better resolution in predictions.

kobo3_20250721.jpg

7月28日
授業内容:Worked on a multi-task learning model to enhance traffic data forecasting. Designed and compared multiple models to handle different forecasting tasks simultaneously. Finalized and selected the best-performing model based on accuracy and generalization performance.

kobo3_20250728.jpg

2025年10月

10月6日
授業内容:
•Learning to use Jartic road traffic software to understand its data acquisition process.
•Collecting traffic data from the platform for further analysis.
•Gaining insights into traffic flow patterns and congestion trends through data exploration.

kobo3_20251006_1.jpg

kobo3_20251006_2.jpg

10月20日
授業内容:
•Learning to use the Macro Recorder software for automating repetitive tasks.
•Collecting all available traffic data for comprehensive analysis.
•Preparing the dataset for further processing and pattern identification.

kobo3_20251020.jpg

10月27日
授業内容:
•Studying pattern mining techniques to analyse traffic congestion trends.
•Exploring algorithms that identify frequent and time-dependent congestion patterns.
•Aiming to uncover insights for improving traffic flow and management.

kobo3_20251027.jpg

2025年11月

11月4日
授業内容:
•Process the traffic dataset to ensure consistency, completeness, and readiness for symbolic conversion.
•Analyze the key attributes of the traffic data to determine which features require symbolic abstraction.
• Design an appropriate symbolic representation schema for transforming raw numerical and categorical traffic values into symbolic forms.

kobo3_20251104.jpg

11月10日
授業内容:
•Implement the transformation process that converts the preprocessed traffic data into a symbolic dataset.
•Identify patterns and relationships in the dataset that guide the learning of symbolic transformation rules.
•Learn and formalize the rules that map raw traffic features into higher-level symbolic constructs.

kobo3_20251110.jpg

11月17日
授業内容:
•Develop symbolic temporal rules that capture dynamic changes and time-dependent behavior within the traffic data.
•Study knowledge graph principles to understand how symbolic and temporal relationships should be modeled in a graph structure.
•Construct a knowledge-graph-ready dataset that aligns with graph database requirements for efficient querying and reasoning.

kobo3_20251117.png