ajbd2106 Goto Github PK

adf-real-world-usecase

airflow-jobs

airport-baggage

as

awesome-recommendation-engine

The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacionhadoop.com The idea is to use spark, kafka,mongo, machine learning algorithms, web sockets and play.

azcopy

azure-databricks-cookbook

Azure Databricks Cookbook, Published by Packt

azurebarplot

Bar plot created with dash to be deployed in Azure

banking-application

A simple banking application written in Java

benchmarking-big-sql-systems

big-data-pipeline

Kafka, Redis, Hive and Spark pipeline segments

bigtool

car-price-prediction-using-regression-models

Building a Machine Learning Model to Predict the Price of the Car By Comparing Performance of Different Regression Techniques (Simple Linear Regression, Multiple Linear Regression, Polynomial Regression)

cdcdemo

Change Data Capture POC using Wordpress, MySQL bin log colletor, Databricks Delta Lake and Apache Spark

charts

Curated applications for Kubernetes

checkpointed-video-stream

A self-contained example that illustrates recovery of Spark Streaming from a checkpoint

complete-python-3-bootcamp

Course Files for Complete Python 3 Bootcamp Course on Udemy

container-project

covid_19_data-analysis

Analysis covid 19 data from https://api.covid19api.com/summary and using Nifi for data retrievel, Kafka and pysparka for streaming data processing and HDFS FOR STAORAGE, hIVE , qUICK SIGHT FOR DATA ANALYSIS

data-engineering-cases

data-engineering-with-apache-spark-and-delta-lake-cookbook

Data Engineering with Apache Spark and Delta Lake Cookbook, published by Packt

data-engineering-with-apache-spark-delta-lake-and-lakehouse

Data Engineering with Spark and Delta Lake

data-quality-rule-engine

databricks-azure-devops

This repo hosts an example of a full data pipeline that shows how to implement CI/CD on Azure DevOps by testing data quality with great_expectations and code quality with SonarQube

databricks-workshops

Azure Databricks Workshops

databrickscontent

Examples surrounding Databricks.

datadevops

dataquality

dataqualityonnb

This framework on JUPYTER allows to validate different columns with the help of resusable rulesets to mark records as PASS , FAIL or REJECT configurable using a DQ Bible which can be used to activate or inactivate a rule without making code changes

datasets

Public datasets to use with the exercises in the book