Coder Social home page Coder Social logo
Divine Sam photo

divinesamofficial Goto Github PK

followers: 4.0 following: 1.0 repos: 14.0 gists: 0.0

Name: Divine Sam

Type: User

Company: SELF

Bio: Passionate data engineer with expertise in Spark, Kafka, SQL. With hands-on experience in building robust ETL pipelines and real-time data solutions.

Location: Kochi, Kerala, India

Typing SVG

"Torture the data, and it will confess to anything." - Ronald Coase

"Regression to the mean." - Francis Galton



Language and Tools

Computador iuriCode

Programming Languages:

Icone VS-Code Icone VS-Code

Big Data and Databases:

Icone VS-Code Icone VS-Code Icone VS-Code Icone VS-Code Icone VS-Code

Cloud Services:

Icone VS-Code Icone VS-Code Icone VS-Code

Data Engineering Tools:

Icone VS-Code Icone VS-Code Icone VS-Code Icone VS-Code Icone VS-Code

DevOps and Automation Tools:

Icone VS-Code Icone VS-Code

ERP Tools:

Icone VS-Code

Contact me:

Divine Sam's Projects

snowflake-elt-pipeline-with-dbt-and-airflow icon snowflake-elt-pipeline-with-dbt-and-airflow

This project showcases an end-to-end ELT (Extract, Load, Transform) pipeline leveraging the TPCH orders table from Snowflake's sample database. The primary goal is to demonstrate modern data engineering practices using Snowflake, dbt (Data Build Tool), and Apache Airflow.

traffic-and-roads-databricks-etl-pipeline-with-unity-catalog icon traffic-and-roads-databricks-etl-pipeline-with-unity-catalog

An advanced ETL pipeline using Databricks and ADLS Gen 2 to process traffic and roads data. Features dynamic schema creation, incremental data ingestion with Spark Streaming, comprehensive transformations using PySpark, data governance with Unity Catalog, and automated workflows with CI/CD integration via Azure DevOps.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.