Coder Social home page Coder Social logo

Sanchit Latawa's Projects

airflow-batch-pipeline-s3-redshift icon airflow-batch-pipeline-s3-redshift

Data pipeline that has been designed to automate the parsing of user search patterns from logs of a property hosting website. The pipeline extracts data from S3 , massages the data and puts the final output into AWS Redshift. From the processed data we would look to derive some Business observations.

autopredict icon autopredict

auto-predict is a python library to automate building of prediciton models,feature selection and some more handy utilities used in building prediction models.

csv_parquet icon csv_parquet

Project showing integration of upstream file into your data lake. we look at handling high volume customized data formats and converting them into parquet.

data-streaming-using-aws-kinesis-lambda-s3 icon data-streaming-using-aws-kinesis-lambda-s3

A production grade data pipeline that streams real time data of an online retailer website into AWS S3 data lake. The pipeline uses AWS Kinesis to receive real time streaming data and a lambda consumer which puts data into S3 data-lake.

dataflowtemplates icon dataflowtemplates

Google-provided Cloud Dataflow template pipelines for solving simple in-Cloud data tasks

forex-currency-processing-airflow-hdfs-hive-spark icon forex-currency-processing-airflow-hdfs-hive-spark

We build a Forex-currency rates pipeline to get currency rates from an external API and load the data into HDFS from where we use pyspark job to massage the data and insert it into a Hive table. The objective of this pipeline is to get the data ready for any downstream machine learning pipeline.

generative-ai icon generative-ai

Sample code and notebooks for Generative AI on Google Cloud

professional-services icon professional-services

Common solutions and tools developed by Google Cloud's Professional Services team. This repository and its contents are not an officially supported Google product.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.