anilktechie Goto Github PK

dbt

dbt (data build tool) enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

dbt-ml-preprocessing

A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.

dbt-snowflake-utils

Snowflake-specific utility macros for dbt projects.

dbt_artifacts

A dbt package for modelling dbt artifact data with Snowflake. https://tailsdotcom.github.io/dbt_artifacts

derricksherrill.com

Collection of Python Scripts for my YouTube channel

design-patterns

Some of the most common design patterns implemented in Python.

developer-roadmap

Roadmap to becoming a developer in 2022

devguide

The Python developer's guide

devops-perl-tools

25+ DevOps CLI Tools - Anonymizer, SQL ReCaser (MySQL, PostgreSQL, AWS Redshift, Snowflake, Apache Drill, Hive, Impala, Cassandra CQL, Microsoft SQL Server, Oracle, Couchbase N1QL, Dockerfiles), Hadoop HDFS & Hive tools, Solr/SolrCloud CLI, Nginx stats & HTTP(S) URL watchers for load-balanced web farms, Linux tools etc.

devops-python-tools

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

dio-curso-etl

Curso oferecido para a DIO sobre ETL utilizando a linguagem Python e as bibliotecas pandas e pandera.

discord-dban

Mass Discord Message Delete Script

django

The Web framework for perfectionists with deadlines.

django-postgres-copy

Quickly import and export delimited data with Django support for PostgreSQL's COPY command

django-simplify

Django simplify provides Ruby on Rails-like command line functionalities, models and helper functions so you can focus on development and removes the pain of repeating frequent actions

dm-data-normalization-ingestion

Python script for normalization of the csv file and ingesting the data into relational database.

docker-airflow

Docker Airflow - Contains a docker compose file for Airflow 2.0

docker-aws-snowflake-layer

using docker to create snowflake lambda layer --required since cypto libraries are different depending on the os.

docker_locker

Collection of useful Docker commands for future reference

dstransfer-e2e

eazy-py

Pythonic photometric redshift tools based on EAZY

eland

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

emigrate

Emigrate is Python MySQL database migration tool

ether-list-keys

Sends a list-keys query to nginx-ether over Serf and prints the result. [Also see Also see nginx-ether]. [Abandoned].

ethereum-etl

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

ethereum2-etl

Python scripts for ETL (extract, transform and load) jobs for Ethereum 2.0 beacon blocks, attestations, deposits, slashings, validators, committees. Data is available in Google BigQuery

etl

etl-analytics-pyspark

etl-demo

Python and AirFlow - Data Pipeline Orchestration

etl-example-in-python

A Data pipeline example (MySQL to MongoDB), used with MovieLens Dataset.