Name: Divine Sam
Type: User
Company: SELF
Bio: Passionate data engineer with expertise in Spark, Kafka, SQL. With hands-on experience in building robust ETL pipelines and real-time data solutions.
Location: Kochi, Kerala, India
Divine Sam's Projects
Airbnb Analytics Engineering and Data Warehousing Project
Banking Data Warehouse Pipeline
British Airways Customer Reviews and Consumer buying behaviour Analysis
My portfolio
An ETL pipeline that ingests user data from the RandomUser API, transforms it in Mage AI, and visualises it using Tableau.
Smart City Realtime Data Engineering Project
This project showcases an end-to-end ELT (Extract, Load, Transform) pipeline leveraging the TPCH orders table from Snowflake's sample database. The primary goal is to demonstrate modern data engineering practices using Snowflake, dbt (Data Build Tool), and Apache Airflow.
titan-animated-page
An advanced ETL pipeline using Databricks and ADLS Gen 2 to process traffic and roads data. Features dynamic schema creation, incremental data ingestion with Spark Streaming, comprehensive transformations using PySpark, data governance with Unity Catalog, and automated workflows with CI/CD integration via Azure DevOps.