Topic: pipelines Goto Github

👇 Here are 985 public repositories matching this topic...

acln0 / zerocopy
pipelines,Zero-copy I/O primitives and pipelines for Go. Linux-specific.
User: acln0
splice tee linux go zero-copy pipelines

agnostiqhq / covalent
pipelines,Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
Organization: agnostiqhq
Home Page: https://www.covalent.xyz
hpc workflow workflow-automation workflow-management quantum-computing hpc-applications python machine-learning pipelines covalent

alan-turing-institute / mlj.jl
pipelines,A Julia machine learning framework
Organization: alan-turing-institute
Home Page: https://alan-turing-institute.github.io/MLJ.jl/dev/
machine-learning julia pipelines tuning data-science tuning-parameters predictive-modeling classification regression statistics

argoproj / argo-events
pipelines,Event-driven Automation Framework for Kubernetes
Organization: argoproj
Home Page: https://argoproj.github.io/argo-events/
kubernetes event-driven cloudevents workflows triggers automation-framework cloud-native argo pipelines event-source

argoproj / argo-workflows
pipelines,Workflow Engine for Kubernetes
Organization: argoproj
Home Page: https://argo-workflows.readthedocs.io/
workflow kubernetes argo dag knative airflow machine-learning argo-workflows workflow-engine hacktoberfest

avaiga / taipy
pipelines,Turns Data and AI algorithms into production-ready web applications in no time.
Organization: avaiga
Home Page: https://www.taipy.io
automation data-engineering data-ops data-visualization datascience developer-tools mlops orchestration pipeline pipelines

azure / azure-devops-cli-extension
pipelines,Azure DevOps Extension for Azure CLI
Organization: azure
Home Page: https://docs.microsoft.com/en-us/cli/azure/ext/azure-devops/?view=azure-cli-latest
cicd agile git command-line command-line-tool azure devops azure-devops azure-devops-extension azure-cli

bob-cd / bob
pipelines,This is what CI/CD should've been.
Organization: bob-cd
Home Page: https://bob-cd.github.io
ci cd ci-cd continuous-integration continuous-delivery continuous-deployment clojure jvm docker hacktoberfest

calebwin / pipelines
pipelines,An experimental programming language for data flow
User: calebwin
pipelines pipeline parallel language nim python compiler

concourse / concourse
pipelines,Concourse is a container-based continuous thing-doer written in Go.
Organization: concourse
Home Page: https://concourse-ci.org
go ci pipelines elm concourse continuous-integration continuous-delivery ci-cd hacktoberfest

cross-platform / dspatch
pipelines,The Refreshingly Simple Cross-Platform C++ Dataflow / Patching / Pipelining / Graph Processing / Stream Processing / Reactive Programming Framework
Organization: cross-platform
Home Page: https://flowbasedprogramming.com/
stream-processing reactive-programming dataflow dataflow-programming pipelines pipelining flow-based-programming data-driven cross-platform patching

cuebook / cuelake
pipelines,Use SQL to build ELT pipelines on a data lakehouse.
Organization: cuebook
Home Page: https://cuelake.cuebook.ai
apache-iceberg delta lakehouse datalake data-lake elt etl data-engineering data-integration data-ingestion

damziobro / gstreamercheatsheet
pipelines,GStreamer pipelines and CLI commands for different GStreamer based features (process MPEG2-TS files, get video from DVB, deinterlace video, capture RTSP stream etc.)
User: damziobro
gstreamer pipelines gst rtsp hls mpegts dvb cheatsheet gstreamer-pipeline youtube

dmmiller612 / sparktorch
pipelines,Train and run Pytorch models on Apache Spark.
User: dmmiller612
pytorch sparktorch deep-learning apache-spark pipelines inference distributed-computing

elyra-ai / elyra
pipelines,Elyra extends JupyterLab with an AI centric approach.
Organization: elyra-ai
Home Page: https://elyra.readthedocs.io/en/stable/
notebooks notebook-jupyter jupyterlab jupyterlab-extensions ai machine-learning pipelines kubeflow-pipelines python elyra

harness / drone-cli
pipelines,Command Line Tools for Drone CI
Organization: harness
Home Page: https://docs.drone.io/cli
continuous-integration continuous-delivery pipelines

hydrospheredata / hydro-serving
pipelines,MLOps Platform
Organization: hydrospheredata
Home Page: http://docs.hydrosphere.io
serving scoring spark tensorflow scikit-learn serverless pipelines realtime machine-learning models

intel / dffml
pipelines,The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.
Organization: intel
Home Page: https://intel.github.io/dffml/main/
machine-learning data-flow asyncio event-based flow-based-programming dag hyperautomation dataflows datasets dffml

ivanpaulovich / fluentmediator
pipelines,:twisted_rightwards_arrows: FluentMediator is an unobtrusive library that allows developers to build custom pipelines for Commands, Queries and Events.
User: ivanpaulovich
Home Page: http://paulovich.net/FluentMediator/
fluent-design mediator-pattern ddd-cqrs message-bus event-sourcing event-driven chain-of-responsibility chain-methods pipelines dotnet-core

jean-njoroge / breast-cancer-risk-prediction
pipelines,Classification of Breast Cancer diagnosis Using Support Vector Machines
User: jean-njoroge
supervised-learning breast-cancer-prediction breast-cancer-tumor breastcancer-classification data-analysis svm exploratory-data-analysis notebook prediction-model dataprocessing

juliankemmerer / pipelinec
pipelines,A C-like hardware description language (HDL) adding high level synthesis(HLS)-like automatic pipelining as a language construct/compiler feature.
User: juliankemmerer
Home Page: https://github.com/JulianKemmerer/PipelineC/wiki
fpga hardware-description-language vhdl pipelines c python hardware hardware-description high-level-synthesis hls

live-keys / livekeys
pipelines,Livekeys - Automation Platform with support for live scripting.
Organization: live-keys
Home Page: https://livekeys.io
image-processing live-coding pipelines video-processing

logrange / logrange
pipelines,High performance data aggregating storage
Organization: logrange
stream-processing streams logging pipelines golang go database log-aggregation

mage-ai / mage-ai
pipelines,🧙 Build, run, and manage data pipelines for integrating and transforming data.
Organization: mage-ai
Home Page: https://www.mage.ai/
machine-learning artificial-intelligence data data-engineering data-science python elt etl pipelines data-pipelines

mdubourg001 / glci
pipelines,🦊 Test your Gitlab CI Pipelines changes locally using Docker.
User: mdubourg001
ci docker gitlab gitlab-ci jobs pipelines

meltano / meltano
pipelines,Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Organization: meltano
Home Page: https://meltano.com/
dataops dataops-platform elt open-source opensource data pipelines extract-data meltano meltano-sdk

microsoft / psi
pipelines,Platform for Situated Intelligence
Organization: microsoft
Home Page: https://github.com/microsoft/psi/wiki
multimodal streaming human-robot-interaction multimodal-interactions perception framework stream-processing component-library artificial-intelligence pipelines

natayadev / dataengineering-roadmap
pipelines,Un repositorio más con conceptos básicos, desafíos técnicos y recursos sobre ingeniería de datos en español 🧙✨
User: natayadev
Home Page: https://natayadev.github.io/dataengineering-roadmap/
ai big-data data data-engineering pipelines ingenieria-de-datos roadmap

nf-core / modules
pipelines,Repository to host tool-specific module files for the Nextflow DSL2 community!
Organization: nf-core
Home Page: https://nf-co.re/modules
nf-core nextflow modules workflows pipelines dsl2 nf-test

onepanelio / onepanel
pipelines,The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.
Organization: onepanelio
Home Page: https://docs.onepanel.ai/
deeplearning pipelines machinelearning jupyterlab tensorflow pytorch tensorboard computer-vision mlops workflows

orchest / orchest
pipelines,Build data pipelines, the easy way 🛠️
Organization: orchest
Home Page: https://orchest.readthedocs.io/en/stable/
data-science machine-learning pipelines ide jupyter cloud self-hosted jupyterlab notebooks docker

ploomber / ploomber
pipelines,The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
Organization: ploomber
Home Page: https://docs.ploomber.io
workflow machine-learning data-science data-engineering mlops papermill jupyter jupyter-notebooks pipelines vscode

polyaxon / polyaxon
pipelines,MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
Organization: polyaxon
Home Page: https://polyaxon.com
deep-learning machine-learning artificial-intelligence data-science reinforcement-learning kubernetes tensorflow pytorch keras mxnet

project-codeflare / codeflare
pipelines,Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.
Organization: project-codeflare
Home Page: https://codeflare.dev
pipelines workflows automl data-science machine-learning ray sklearn hyperparameter-optimization

pypyr / pypyr
pipelines,pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.
Organization: pypyr
Home Page: https://pypyr.io
pipeline pipeline-runner pipeline-processor pipelines-yaml devops task-runner script script-loader taskrunner automation

pytorch / torchx
pipelines,TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
Organization: pytorch
Home Page: https://pytorch.org/torchx
pytorch machine-learning kubernetes slurm distributed-training pipelines components deep-learning python aws-batch

reubenbond / hagar
pipelines,Fast, flexible, and version-tolerant serializer for .NET
User: reubenbond
serializer dotnet-core dotnet serialization-library span pipelines

rosineygp / mkdkr
pipelines,mkdkr = Makefile + Docker
User: rosineygp
Home Page: https://rosineygp.github.io/mkdkr/
makefile docker pipelines bash travis-ci cirleci github-actions jenkins gitlab-ci

salesforce / transmogrifai
pipelines,TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
Organization: salesforce
Home Page: https://transmogrif.ai
ml automl transformations estimators dsl pipelines machine-learning scala salesforce einstein

sharpliner / sharpliner
pipelines,Use C# instead of YAML to define your Azure DevOps pipelines
Organization: sharpliner
Home Page: https://www.nuget.org/packages/Sharpliner/
azure-devops-pipelines pipelines yaml azure-devops csharp dotnet

smooks / smooks
pipelines,Extensible data integration Java framework for building XML and non-XML fragment-based applications
Organization: smooks
Home Page: https://www.smooks.org
java smooks enterprise-integration big-data etl sax pipelines event-driven xml stream-processing analytics

stacksimplify / azure-aks-kubernetes-masterclass
pipelines,Azure AKS Kubernetes Masterclass
User: stacksimplify
Home Page: https://stacksimplify.com/azure-aks/azure-kubernetes-service-introduction/
azure-devops aks azure-container-registry kubernetes pipelines

substantic / rain
pipelines,Framework for large distributed pipelines
Organization: substantic
Home Page: https://substantic.github.io/rain/docs/
pipelines distributed-computing python-api rust workflows

tektoncd / triggers
pipelines,Event triggering with Tekton!
Organization: tektoncd
tekton pipelines triggers hacktoberfest

tenzir / tenzir
pipelines,Open source security data pipelines.
Organization: tenzir
Home Page: https://docs.tenzir.com
incident-response threathunting siem soc security dataops investigation pcap secdataops netflow

timoschwarzer / gitlab-monitor
pipelines,A web-based monitor dashboard for GitLab CI
User: timoschwarzer
Home Page: https://gitlab-monitor.timoschwarzer.com
gitlab dashboard monitor gitlabci pipelines hacktoberfest

toloka / toloka-kit
pipelines,Toloka-Kit is a Python library for working with Toloka API.
Organization: toloka
Home Page: https://toloka.ai
crowd python3 toloka engineers machine-learning label annotation data-mining api data-labeling

tseemann / shovill
pipelines,⚡♠️ Assemble bacterial isolate genomes from Illumina paired-end reads
User: tseemann
genome-assembler illumina-sequencing pipelines

zenml-io / zenml
pipelines,ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
Organization: zenml-io
Home Page: https://zenml.io
mlops machine-learning data-science production-ready devops-tools zenml pipelines metadata-tracking deep-learning pytorch

zorbash / opus
pipelines,A framework for pluggable business logic components
User: zorbash
railway-oriented-programming pipelines dsl elixir