nishk5 Goto Github PK

airflow-pyspark-reddit

Example of using Airflow to schedule downloading data form S3 and launching spark jobs

awesome-crawler

A collection of awesome web crawler,spider in different languages

cookbook

The Data Engineering Cookbook

cp-all-in-one

docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud

envision

flick

flick is a cli-tool written in Go for generating boiler-plate code for Web Scraping projects. I'm beginning with Python boiler-plates and would love to extend it to Go and Rust in a while with idiomatic paradigm of those respective languages.

githubv4

Package githubv4 is a client library for accessing GitHub GraphQL API v4 (https://developer.github.com/v4/).

go-github

Go library for accessing the GitHub API

kops-in-a-tin

ml

Machine Learning Projects and Learning Content

news-graph

Key information extraction from text and graph visualization

nishk5

Config files for my GitHub profile.

nishk5.github.io

prml

PRML algorithms implemented in Python

pyspark-boilerplate

A boilerplate for writing PySpark Jobs

pyspark-cookbook

PySpark Cookbook, published by Packt

pyspark-example-project

Example project implementing best practices for PySpark ETL jobs and applications.

retailrhythm

A dynamic data pipeline for real-time sales metric simulation and analysis for big box retailers. It integrates Kafka, Flink, and DuckDB in a Dockerized environment, enhanced by Metabase for actionable insights and dashboard visualizations.

spacy-course

👩‍🏫 Advanced NLP with spaCy: A free online course

spark-examples

sqlservermetadata

SQL Server Metadata Toolkit

ssis-queries

A set of queries useful to easily extract monitoring and package performance data from SSISDB database

starter