Coder Social home page Coder Social logo

shuaahvee / sdk Goto Github PK

View Code? Open in Web Editor NEW

This project forked from meltano/sdk

0.0 0.0 0.0 5.89 MB

Write 70% less code by using the SDK to build custom extractors and loaders that adhere to the Singer standard: https://sdk.meltano.com

Home Page: https://sdk.meltano.com

License: Apache License 2.0

Python 100.00%

sdk's Introduction

Meltano Singer SDK

The Tap and Target SDKs are the fastest way to build custom data extractors and loaders! Taps and targets built on the SDK are automatically compliant with the Singer Spec, the de-facto open source standard for extract and load pipelines.



Meltano Singer SDK Logo


Future-proof extractors and loaders, with less code

On average, developers tell us that they write about 70% less code by using the SDK, which makes learning the SDK a great investment. Furthermore, as new features and capabilities are added to the SDK, your taps and targets can always take advantage of the latest capabilities and bug fixes, simply by updating your SDK dependency to the latest version.

Meltano

Not familiar with Meltano? Meltano is your CLI for ELT+ that:

  • Starts simple: Meltano is pip-installable and comes in a prepackaged docker container, you can have your first ELT pipeline running within minutes.
  • Has DataOps out-of-the-box: Meltano provides tools that make DataOps best practices easy to use in every project.
  • Integrates with everything: 300+ natively supported data sources & targets, as well as additional plugins like great expectations or dbt are natively available.
  • Is easily customizable: Meltano isn't just extensible, it's built to be extended! The Singer SDK (for Connectors) & EDK (for Meltano Components) are easy to use. Meltano Hub helps you find all of the connectors and components created across the data community.
  • Is a mature system: Developed since 2018, runs in production at large companies like GitLab, and currently powers over a million pipeline runs monthly.
  • Has first class ELT tooling built-in: Extract data from any data source, load into any target, use inline maps to transform on data on the fly, and test the incoming data, all in one package.

If you want to get started with Meltano, we suggest you:

Documentation

Contributing back to the SDK

Making a new release of the SDK

  1. Trigger a version bump using the GitHub web UI or the cli:

    $ gh workflow run

    The increment: auto option will figure out the most appropriate bump based on commit history.

  2. Follow the checklist in the PR description.

  3. Publish a new release using the GitHub web UI.

sdk's People

Contributors

dependabot[bot] avatar edgarrmondragon avatar aaronsteers avatar pre-commit-ci[bot] avatar willdasilva avatar meltybot avatar douwem avatar github-actions[bot] avatar laurents avatar pnadolny13 avatar visch avatar buzzcutnorman avatar tayloramurphy avatar flexponsive avatar cjohnhanson avatar jack-burnett avatar tombriggsallego avatar ericboucher avatar kgpayne avatar radbrt avatar jlloyd-widen avatar niallrees avatar mkranna avatar sbalnojan avatar stkbailey avatar qbatten avatar spacecowboy avatar elephantum avatar fred-oloughlin avatar jaypeedevlin avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.