Pinned Loading

1. BUSINESS-DATA-API BUSINESS-DATA-API Public

   API endpoint with functions for scraping data, such as documents (pdf, xd, docs) and json metadata from Polish National Court Registry

   Python 1

2. SPARK-HADOOP-CLUSTER-DOCKER SPARK-HADOOP-CLUSTER-DOCKER Public

   Docker cluster that deploys both Spark Compute Engine and Hadoop File system

   Makefile

3. KRS-API-SPARK-JOB KRS-API-SPARK-JOB Public

   Spark job for extracting and flattening data into SQL schema from Polish National Court Registry

   Python

4. AIRFLOW-LOCAL-ENGINE-DOCKER AIRFLOW-LOCAL-ENGINE-DOCKER Public

   Extended compose file for airflow - running single node locally without Redis/Celery. Uses custom Docker image with additional libraries

   Dockerfile

5. DOMAIN-AVAILABILITY-CHECKER DOMAIN-AVAILABILITY-CHECKER Public

   Lightweight Python toolkit that queries TLD WHOIS servers directly to determine availability. Includes punycode/ASCII normalization, CSV→PostgreSQL dictionary loader, and a batch runner for top-N c…

   Python

6. CAR-MARKET-POLAND-ANALYSIS-STACK CAR-MARKET-POLAND-ANALYSIS-STACK Public

   This project delivers a complete data engineering pipeline for the CEPIK (Centralna Ewidencja Pojazdów i Kierowców) vehicle registration database in Poland. It automates the process of scraping raw…

   Python