Pinned Loading

1. Lake-to-warehouse-batch-pipeline-for-retail-enterprise-data Lake-to-warehouse-batch-pipeline-for-retail-enterprise-data Public

   ETL batch pipeline that moves data from Data lake to Data warehouse. Implemented with Spark, Amazon S3, Postgres, Airflow, Docker Compose. Data on the cloud is processed with local cpu without usin…

   Python

2. customer-behaviour-and-value-analysis-and-ml-clustering customer-behaviour-and-value-analysis-and-ml-clustering Public

   Analysing customers with a variety of methods including cohort analysis of purchase activity, RFM value analysis, and unsupervised machine learning with various metrics calculated from the previous…

   Jupyter Notebook 1

3. real-time-IoT-sensor-data-processing-storage-and-notification-system real-time-IoT-sensor-data-processing-storage-and-notification-system Public

   Real-time IoT sensor data processing, storage, and notification system based on pub-sub architecture. Uses Kafka, Flink, MongoDB, Kafka Connect, Docker.

   Python

4. Credit-risk-predictive-modelling-and-risk-optimisation Credit-risk-predictive-modelling-and-risk-optimisation Public

   A bank has to model the risk of issuing credit and optimise profit for a given risk budget

   Jupyter Notebook