Big Data Pipeline
Big Data Pipeline
Final Project for CSCI E-88: Principles of Big Data Processing
Final Project for CSCI E-88: Principles of Big Data Processing
(Fall 2019)
This is programmed in C# and Python and leverages Microsoft Azure for infrastructure. This course is how I began learning to build various forms of data engineering pipelines. It was originally designed as part of Project Ogre. As I have continued to learn, I have even implemented this and more advanced pipelines on professional projects as you can see reflected on my resume.