Coder Social home page Coder Social logo

santhosh karuppasamy's Projects

boto--s3-mig icon boto--s3-mig

The Script migrate empty file name data from a Scality S3 cluster to a Ceph S3 cluster using the boto library in Python

etl_sap-hdfs icon etl_sap-hdfs

The Java program uses Apache Spark to connect to a SAP HANA database, retrieve data from a specific table, and then write this data to a Hadoop Distributed File System (HDFS) in CSV format. Here is a brief summary of the changes:

etl_sap_hive icon etl_sap_hive

This Java program leverages the Apache Spark framework to read data from a SAP HANA database and save it to a Hive table in ORC format

incremental-sap_hive icon incremental-sap_hive

Python function fetch data that incrementally fetches data from a SAP HANA database using PySpark and stores the data in an ORC format in a Hive table.

jdbc_sap icon jdbc_sap

The Java code is designed to connect to an SAP HANA database, execute a SQL query, and write the results to a CSV file using the OpenCSV library.

sap-hana__hivedb icon sap-hana__hivedb

The code appears to read configurations from a CSV file (test.csv) and, for each configuration, attempts to read data from an SAP table and then write that data to a Hive table.

sap-hdfs-orc icon sap-hdfs-orc

This code is to read data from a table (PRODELEMENTS) in a HANA database and then save that data to the Hadoop Distributed File System (HDFS) in ORC format.

sap-hive icon sap-hive

Java program that uses Apache Spark to connect to a SAP HANA database, retrieve data from a specific table, and then write this data to a Hive table. This is a common pattern in big data processing pipelines

sap_hive_spark icon sap_hive_spark

The code is designed to read data from an SAP HANA database and store it in a Hive table using PySpark.

sap_postgreql_etl icon sap_postgreql_etl

This Python script connects to a SAP HANA database, retrieves data from a specified table, and then transfers this data to a PostgreSQL database.

spark_jdbc_parallelize icon spark_jdbc_parallelize

This Java code contains two classes, App2 and App, which are used to read data from a SAP database into a Spark DataFrame and then write it to an HDFS (Hadoop Distributed File System) location in ORC (Optimized Row Columnar) format.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.