Ash Berlin-Taylor ashb

PMC @ Apache Airflow, Airflow Engineering Director @ Astronomer.io

ashb / create_function_plv8_cuid2.sql

Last active November 19, 2024 09:09 — forked from notakaos/create_function_plv8_cuid.sql

cuid v2 for PostgreSQL with PL/v8

	-- Ported from https://github.com/paralleldrive/cuid2/blob/53e246b0919c8123e492e6b6bbab41fe66f4b462/src/index.js
	-- Adjusted by Ash Berlin to use pgcrypto gen_random_bytes instead of Math.random
	-- Host fingerprint adjusted to include hostname and backend pid
	-- This gist is MIT licensed.


	-- Add the "plv8" extension
	CREATE EXTENSION IF NOT EXISTS "plv8";

	-- Add the "pgcrypto" extension

ashb / test_ti_creation.py

Created January 5, 2022 13:09 — forked from pingzh/test_ti_creation.py

for airflow perf test for ti creation inside the dag_run verify_integrity. The test is against a database without other traffic

	import time
	import logging

	from airflow.utils.db import create_session
	from airflow.utils import timezone
	from airflow.models import TaskInstance, DagRun
	from airflow.models.serialized_dag import SerializedDagModel
	from airflow.utils.types import DagRunType

	logger = logging.getLogger(__name__)

ashb / sqla-merge-integrityerror.py

Created June 16, 2020 14:39

	from sqlalchemy import create_engine, Column, String
	from sqlalchemy.ext.declarative import declarative_base, declared_attr
	from sqlalchemy.orm import sessionmaker, scoped_session

	engine = create_engine(
	'mysql://root@mysql/airflow',
	echo=True
	)

	db_session = scoped_session(

ashb / example.py

Created October 24, 2019 20:29

	from airflow import DAG
	from airflow.operators.bash_operator import BashOperator
	from datetime import datetime, timedelta

	default_args = {
	'owner': 'airflow',
	'depends_on_past': False,
	'start_date': datetime(2018, 1, 1),
	'email_on_failure': False,
	'email_on_retry': False,

ashb / plugins__staticfiles.py

Created September 2, 2019 13:30

Serving custom static files form Airflow Plugin

	from flask import Blueprint

	import os

	"""
	Create this file as ./plugins/staticfiles.py in your ARIFLOW_HOME directory

	It will serve all files under ./static/ available under /a/static/ (The "a" comes from the ``url_prefix`` argument.)
	"""

ashb / proxychains4.rb

Last active February 4, 2019 12:31 — forked from allenhuang/proxychains4_formula.rb

Unofficial brew formula for proxychains 4

	# Unofficial brew formula for proxychains 4
	# Instruction:
	# $ git clone https://gist.github.com/628c1d98fab731d809d883c24eedd9d4.git gist-3792521
	# $ brew install --HEAD gist-3792521/proxychains4.rb
	#
	# The default config file will be located in /usr/local/etc/proxychains.conf
	#
	require 'formula'

	class Proxychains4 < Formula

ashb / tf-plan-diff.sh

Created April 9, 2018 16:38

Show a diff of single line JSON objects (IAM policy docs) in terraform

ashb / policy.json

Created May 16, 2017 13:10

	{
	"Version": "2012-10-17",
	"Statement": [
	{
	"Sid": "AllowListingOfOwnState",
	"Effect": "Allow",
	"Principal": "*",
	"Action": "s3:ListBucket",
	"Resource": "arn:aws:s3:::my-terraform-state",
	"Condition": {

ashb / hacky.sh

Created May 10, 2017 08:50

Update ACS k8s API server to run with OIDC based-auth

	ensure_kube_apiserver_config() {
	local dry_run="$2"
	# If we want to make changes to the apiserver manifest we do it via an
	# Azure CustomLinuxCommand extension
	# https://github.com/Azure/custom-script-extension-linux which will run the
	# command for us without having to log in. The down side to this is that it
	# takes a while to "deploy" the extension, which is espeically a pain if
	# the config is already correct.
	#
	# To speed it up and only deploy the extension if something is changed we

ashb / Dockerfile

Last active November 2, 2016 16:39

	FROM alpine

	RUN ls /etc/profile.d /usr/local/bin /usr

	COPY resources/etc/ /etc
	COPY resources/usr/ /usr

	RUN ls /etc/profile.d/ /usr/local/bin /usr