emsalcengiz Goto Github PK

apache-beam-examples

liked Apache Beam for streaming data transformations

bash-scripting

A collection of simple Bash scripts.

checkoutmangmentexample

rest calling

clean-code-javascript

:bathtub: Clean Code concepts adapted for JavaScript

data-algorithms-book

MapReduce, Spark, Java, and Scala for Data Algorithms Book

data-normalize-with-etl-procesess

I made various data normalization operations with python scripts. Target data in CSV format

data-science--cheat-sheet

Cheat Sheets

dataengineeringproject

Example end to end data engineering project.

emsalcengiz

etl_processing

I find Apache Airflow very useful for ETL work. Here I transferred data from the source database(mysql) to the target database(postresql) and used the Airflow Bash Operator.

filtering-process

You can do a lot of things with Apache Spark. What I've done here is to work with a static file and create a Batch ETL system.

get_users

After ETL done by reading static data, an API is designed with flask_sqlalchemy, the purpose is to show the top five users

lovestreaming-jobs

my-scala-tutorial

This repository has my learning scala examples

python

All Algorithms implemented in Python

random-data-generation

Generating random data with Apache Kafka

requests-scala

A Scala port of the popular Python Requests HTTP client: flexible, intuitive, and straightforward to use.

shell-cheatsheet

shell komutlarının türkçe açıklamalarını içerir

solutions

spark-stream

A very neat mechanism for setting up data flow through a modularized system with Twitter as initial test case.

trendyol-bootcamp-spark

udacity-data-engineering-projects

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

web-apis

ways to make an HTTP request in JavaScript