zosbhai Goto Github PK

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

aws-big-data-blog

azureadflearn

azureadflearning

azureadflearning01

basicsparkexample

Spark scala learn by example

compare_df

A collection of function which can be used to compare two dataframes.

concurrency

container-app-conf

Convenient configuration of containerized applications

dag-factory

Dynamically generate Apache Airflow DAGs from YAML configuration files

databricks_scripts

dbdemos

Demos to implement your Databricks Lakehouse

designpatterncollection

Python implementation of various design pattern

gitsample

jdconfig

Extended Python dict for flexible hyperparameter configuration in Deep Learning

jgitexample

nlp

My explorations in natural language processing

ophelia

Ophelia a PySpark analytics wrapper.

pdfparser

basic pdf parser

py-jsonq

A simple Python package to Query over Json Data

pyspark-anonymizer

Python library which makes it possible to dynamically mask/anonymize data using JSON string or python dict rules in a PySpark environment.

pyspark_cdcframework

pysparkexamples

Sample Pyspark example

pythoncookbook

pythonexamples

Sample Python code

realtimestreams

Realtime streams repo

simple-settings

A simple way to manage your project settings.

spark-1.6.2-bin-hadoop2.6

My Spark setup on HP (Windows 10)

sparkapplicationredshiftexample

Sample Spark application to write to redshift table using the driver provided by Databricks

sparkscalaredshiftwriteriamrole

Spark Application that writes to Reshift table using IAM role