Collection of Databricks and Jupyter Notebooks

Using Azure Databricks (Spark) for ML, this is the //build 2019 repository with homework examples, code and notebooks

Azure Databricks - Advent of 2020 Blogposts

Are you like me , a Senior Data Scientist, wanting to learn more about how to approach DevOps, specifically when you using Databricks (workspaces, notebooks, libraries etc) ? Set up using @Azure @databricks

Deploy and Serve Model using Azure Databricks, MLFlow and Azure ML deployment to ACI or AKS

Reusable Python classes that extend open source PySpark capabilities. Examples of implementation is available under notebooks of repo https://github.com/bennyaustin/synapse-dataplatform

A simple pipeline to transform data within Azure Data Factory using Azure Databricks. Although it is written in Scala the same can be replicated in Python.

How to read and write to a database from a Databricks notebook using managed identity and notebook user credentials

Sample notebooks on Azure Databricks for ETL

Azure Databricks notebook sample to connect Blob Storage of Azure Log Analytics

Notebook sample of Exploratory Data Analysis (EDA) for Prudential Life Insurance Sample Data

How to read and write to a database from a Databricks notebook using an Entra service principal

How to read and write to a database from a Databricks notebook using Unity Catalog permissions

Deploy apache spark in client mode on Kubernetes cluster, integrate with Jupyter notebook through Jupyterhub server.

A lightweight toolkit for Azure Data Lake Storage Gen2 operations, featuring AzCopy commands and Databricks integration examples. Includes sample data and notebooks for quick experimentation with data lake architectures.

Databricks ETL Pipeline for retrieving and processing NI TestStand test results, featuring a well-documented notebook for ETL operations, Data Lake for storage, Spark SQL+Python for transformations, and Power BI as the final visualization of factory metrics.

building a real-world data pipeline in Azure Data Factory (ADF) dataset provided by https://www.ecdc.europa.eu/ ingesting data from sources such as HTTP and Azure Blob Storage into Azure Data Lake Gen2 using ADF. transformed data and loaded transformed data using Databricks Notebook Activity in Azure Data Factory (ADF) and load into Azure Data L…