techtacles Goto Github PK

2022-bigquery-kafka-connect-analtyics

ai-reduction-hackaton

airbyte

Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.

airflow-helm-kubernetes-infra

A repository for deploying data pipelines on apache airflow using terraform and kubernetes

awesome-data-engineering

A curated list of data engineering tools for software developers

aws-cicd-app

aws-cicd-terraform

aws-terraform

This is a repository for building a cloud infrastructure on terraform

batch-streaming-data-pipeline

Building both a batch and streaming data pipeline using Kafka, docker, Terraform and Airflow.

breast_histology

cardiovascular-diseases

Here, I built a model that predicts the likelihood of cardiovascular diseases based on his blood pressure, pulse rate, Body mass index, systolic and diastolic blood pressure and some other factors. This model has a high level of accuracy. It also points the individuals danger zone and profers recommendations.

cookbook

The Data Engineering Cookbook

create-sql-databases

This repository just contains code to create databases and tables. This is for people who want to create a large sql database but do not want to insert the records manually.

data-engineering

Basic projects worked on using Python.

data-engineering-zoomcamp

Free Data Engineering course!

datafest-africa-2023

Project for datafest 2023

dataset

dbt-postgres-connector

Test connection dbt - postgres locally

devops-world

diacheck-web-app

A project about diabetes prediction in a web app using Flask.

fifa-prediction-deployment

fifa-value-prediction

Here, I deployed a model that predicts the value of a player based on some features like his age , potential,overall and wage using Gradient Boosting Regressor with 97% accuracy.I deployed the model using flask and heroku.

github-actions-workflow

Creates a github workflow for a data pipeline

hashtagcashtag-de-project

My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on ​lambda architecture​, that aggregates Twitter and US stock market data for user sentiment analysis using open source tools - ​Apache Kafka ​for data ingestions, Apache Spark ​& ​Spark Streaming ​for batch & real-time processing, ​Apache Cassandra f​ or storage, ​Flask​, ​Bootstrap and ​HighCharts f​ or frontend.

heart-deployment

heart-failure-prediction

indicina-assessment

This is a repository for indicina DE assessment.

kafka-docker

A docker compose file for spinning up Kafka and Zookeeper

kubernetes-de-project

An end to end data pipeline using Terraform, Airflow, Docker , Kubernetes.

music-genre-classification

Here, I built an artificial neural network that can predict the genre of audio files.