GitHub - rhysc25/RealTimeDataPipeline: A data pipeline using Kafka and Spark to publish and process market pricing data, and making use of a Postgresql database. Containerised with docker, and deployed onto AWS (EC2, RDS, S3).

rhysc25 / RealTimeDataPipeline Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

A data pipeline using Kafka and Spark to publish and process market pricing data, and making use of a Postgresql database. Containerised with docker, and deployed onto AWS (EC2, RDS, S3).

0 stars 0 forks Branches Tags Activity

Star

Notifications

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 18 Commits
__pycache__		__pycache__
consumer		consumer
producer		producer
.gitignore		.gitignore
APIKeys_template.py		APIKeys_template.py
docker-compose.yaml		docker-compose.yaml

About

A data pipeline using Kafka and Spark to publish and process market pricing data, and making use of a Postgresql database. Containerised with docker, and deployed onto AWS (EC2, RDS, S3).