This project is part of Big Data Management Systems elective course in Computer Engineering & Informatics Department of University of Patras for Spring Semester 2024 (Semester 8).
-
Notifications
You must be signed in to change notification settings - Fork 0
This project implements a real-time data pipeline with Kafka, Spark, and MongoDB. It generates vehicle data using UXSIM, streams it to a Kafka broker, processes it with Spark, and stores raw and processed data in MongoDB. Queries analyze vehicle counts, speeds, and routes over specified periods.
License
miltiadiss/CEID_NE4348-Big-Data-Management-Systems
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
This project implements a real-time data pipeline with Kafka, Spark, and MongoDB. It generates vehicle data using UXSIM, streams it to a Kafka broker, processes it with Spark, and stores raw and processed data in MongoDB. Queries analyze vehicle counts, speeds, and routes over specified periods.
Topics
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published