Topic: replication Goto Github

Some thing interesting about replication

👇 Here are 1180 public repositories matching this topic...

seaweedfs / seaweedfs

replication,SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.

Organization: seaweedfs

Home Page: https://seaweedfs.com

distributed-storage distributed-systems s3 hdfs fuse distributed-file-system hadoop-hdfs posix tiered-file-system kubernetes

ceph / ceph

replication,Ceph is a distributed object, block, and file storage platform

Organization: ceph

Home Page: https://ceph.io

storage software-defined-storage distributed-storage s3 block-storage distributed-file-system object-store nfs highly-available iscsi

benbjohnson / litestream

replication,Streaming replication for SQLite.

User: benbjohnson

Home Page: https://litestream.io

sqlite replication s3

electric-sql / electric

replication,The agent platform built on sync.

Organization: electric-sql

Home Page: https://electric.ax

elixir postgres crdts crdt replication sync agent agents data platform

cloudnative-pg / cloudnative-pg

replication,CloudNativePG is a comprehensive platform designed to seamlessly manage PostgreSQL databases within Kubernetes environments, covering the entire operational lifecycle from initial deployment to ongoing maintenance

Organization: cloudnative-pg

Home Page: https://cloudnative-pg.io

postgres postgresql kubernetes k8s database sql operator database-management high-availability self-healing

openark / orchestrator

replication,MySQL replication topology management and HA

Organization: openark

mysql replication high-availability management-system

gluster / glusterfs

replication,Gluster Filesystem : Build your distributed storage in minutes

Organization: gluster

Home Page: https://www.gluster.org

gluster storage c distributed-systems glusterfs libgfapi k8s-sig-storage filesystem fuse-filesystem high-availability

jimsalterjrs / sanoid

replication,These are policy-driven snapshot management and replication tools which use OpenZFS for underlying next-gen storage. (Btrfs support plans are shelved unless and until btrfs becomes reliable.)

User: jimsalterjrs

Home Page: http://www.openoid.net/products/

zfs-filesystem replication snapshot

wal-e / wal-e

replication,Continuous Archiving for Postgres

Organization: wal-e

python backup backups postgresql postgres archiving s3 google-cloud-storage openstack-swift blob-store

mydumper / mydumper

replication,Official MyDumper Project

Organization: mydumper

mysql mariadb database percona tidb multithreading replication

maxpert / marmot

replication,A distributed SQLite server with MySQL wire compatible interface

User: maxpert

Home Page: https://maxpert.github.io/marmot/

database distributed replication sqlite3 mysql

heidihoward / distributed-consensus-reading-list

replication,A list of papers about distributed consensus.

User: heidihoward

Home Page: https://heidihoward.github.io/distributed-consensus-reading-list/

distributed-systems paxos atomic-broadcast-protocol zookeeper fault-tolerance distributed-computing consensus-algorithms quorum-systems state-machine-replication consistency

lealone / lealone

replication,能安全适用于个人助理和氛围编程以及企业应用的全栈自进化通用智能体

Organization: lealone

newsql rdbms database async sharding replication acid orm oltp lealone

vmstan / gravity-sync

replication,💫 The easy way to synchronize the DNS configuration of two Pi-hole 5.x instances.

User: vmstan

Home Page: https://vmstan.com/gravity-sync/

pi-hole raspberry-pi dns replication

apache / gobblin

replication,A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

Organization: apache

Home Page: https://gobblin.apache.org/

data ingestion replication management apache

supabase / etl

replication,Stream your Postgres data anywhere in real-time. Simple Rust building blocks for change data capture (CDC) pipelines.

Organization: supabase

Home Page: https://supabase.github.io/etl/

logical-replication postgres replication rust rust-lang postgresql

ctripcorp / x-pipe

replication,X-Pipe是由携程框架部门研发的Redis多数据中心复制管理系统。基于Redis的Master-Slave复制协议，实现低延时、高可用的Redis多数据中心、跨公网数据复制，并且提供一键机房切换，复制监控、异常报警等功能。开源版本和携程内部生产环境版本一致。

Organization: ctripcorp

redis cross-datacenter psync2 replication long-distance-replication keeper-redis rdb keeper redis-xpipe replication-over-public-network

alibaba / mongoshake

replication,MongoShake is a universal data replication platform based on MongoDB's oplog. Redundant replication and active-active replication are two most important functions. 基于mongodb oplog的集群复制工具，可以满足迁移和同步的需求，进一步实现灾备和多活功能。

Organization: alibaba

mongo-database mongodb-oplog replication active-active mongoshake

enterprisedb / repmgr

replication,A lightweight replication manager for PostgreSQL (Postgres)

Organization: enterprisedb

Home Page: https://repmgr.org/

repmgr replication postgresql postgres ha failover autofailover cluster replication-manager

bakito / adguardhome-sync

replication,🛡️ Synchronize AdGuard Home config to replicas

User: bakito

adguardhome sync replication

lovelaze / nebula-sync

replication,Synchronize configuration of multiple Pi-hole v6.x instances.

User: lovelaze

dns docker golang pi-hole pihole replication sync

eulerto / wal2json

replication,JSON output plugin for changeset extraction

User: eulerto

postgres replication plugin json cdc

zpl-c / librg

replication,🚀 Making multi-player gamedev simpler since 2017

Organization: zpl-c

Home Page: https://zpl-c.github.io/librg/

zpl enet networking gamedev library header-only multiplayer sync lightweight low-level

orbitinghail / graft

replication,Graft is an open-source transactional storage engine optimized for lazy, partial, and strongly consistent replication—perfect for edge, offline-first, and distributed applications.

Organization: orbitinghail

Home Page: https://graft.rs

edge replication storage storage-engine database sqlite

datazip-inc / olake

replication,OLake - Fastest Databases, Kafka & S3 Replication to Apache Iceberg with Table optimization (Called OLake Fusion). ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supported sources : Postgres, MongoDB, MySQL, Oracle, MSSql, DB2, Kafka, S3.

Organization: datazip-inc

Home Page: https://olake.io

cdc change-data-capture data-pipeline database elt lakehouse replication apache-iceberg parquet s3

2ndquadrant / pglogical

replication,Logical Replication extension for PostgreSQL 17, 16, 15, 14, 13, 12, 11, 10, 9.6, 9.5, 9.4 (Postgres), providing much faster replication than Slony, Bucardo or Londiste, as well as cross-version upgrades.

Organization: 2ndquadrant

Home Page: https://www.enterprisedb.com/docs/supported-open-source/pglogical2/

postgresql replication logical-decoding database-replication subscription publish-subscribe data-transformation data-transport etl cdc

skyplane-project / skyplane

replication,🔥 Blazing fast bulk data transfers between any cloud 🔥

Organization: skyplane-project

Home Page: https://skyplane.org

data-transfer multicloud sky skyplane replication aws azure cloud cloud-computing gcp

ebay / nuraft

replication,C++ implementation of Raft core logic as a replication library

Organization: ebay

cpp replication raft consensus network distributed-systems consistency availability raft-cpp raft-cxx

zrepl / zrepl

replication,One-stop ZFS backup & replication solution

Organization: zrepl

Home Page: https://zrepl.github.io

zfs go golang replication snapshot backup bookmark incremental

xataio / pgstream

replication,PostgreSQL replication with DDL changes

Organization: xataio

Home Page: https://xata.io/documentation/opensource/pgstream/overview

golang postgresql replication ddl elasticsearch opensearch webhooks schema snapshots anonymization

mycelial / mycelite

replication,Mycelite is a SQLite extension that allows you to synchronize changes from one instance of SQLite to another.

Organization: mycelial

Home Page: https://mycelial.com

sqlite3 sqlite3-extension database-replication replication

shayonj / pg_easy_replicate

replication,Easily setup logical replication and switchover to new database with minimal downtime

User: shayonj

logical-replication postgres postgresql ruby hacktoberfest high-availability streaming replication

leonchen83 / redis-replicator

replication,A tool that can parse, filter, split, and merge RDB files, as well as analyze memory usage offline. It can also sync data between two Redis instances and allows users to define their own sink services to migrate Redis data to custom destinations.

User: leonchen83

redis rdb replication parser aof psync2 redis-replication

deajan / osync

replication,A robust two way (bidirectional) file sync script based on rsync with fault tolerance, POSIX ACL support, time control and near realtime sync

User: deajan

Home Page: http://www.netpower.fr/osync

synchronization rsync-wrapper file-replication replication sync-files acl-replication time-control posix-acl

lizardfs / lizardfs

replication,LizardFS is an Open Source Distributed File System licensed under GPLv3.

Organization: lizardfs

Home Page: http://lizardfs.com

c-plus-plus gplv3 nas macosx linux posix distributed-systems distributed-computing fault-tolerance high-performance

okhosting / awesome-storage

replication,A curated list of storage open source tools. Backups, redundancy, sharing, distribution, encryption, etc.

User: okhosting

Home Page: https://okhosting.com

curated-lists awesome awesome-list awesome-lists storage backup replication redundancy encription high-availability

mattwebbio / orbital-sync

replication,Synchronize multiple Pi-hole instances

User: mattwebbio

Home Page: http://orbitalsync.com

pi-hole pihole docker node replication sync typescript

moiot / gravity

replication,A Data Replication Center

Organization: moiot

mysql storage replication change-data-capture gravity

jumpmindinc / symmetric-ds

replication,SymmetricDS is database replication and file synchronization software that is platform independent, web enabled, and database agnostic. It is designed to make bi-directional data replication fast, easy, and resilient. It scales to a large number of nodes and works in near real-time across WAN and LAN networks.

Organization: jumpmindinc

synchronization database mysql postgresql sqlserver db2 replication sybase oracle change-data-capture

samrocketman / gitlab-mirrors

replication,A set of scripts adding the ability of managing remote mirrors to GitLab.

User: samrocketman

mirroring gitlab-mirror mirrored-repositories replication gitlab backups github-backups

psy0rz / zfs_autobackup

replication,ZFS autobackup is used to periodicly backup ZFS filesystems to other locations. Easy to use and very reliable.

User: psy0rz

Home Page: https://github.com/psy0rz/zfs_autobackup

backup zfs replication

bakwc / pysyncobj

replication,A library for replicating your python class between multiple servers, based on raft protocol

User: bakwc

raft raft-protocol distributed-systems fault-tolerance replication python

tair-opensource / redisfullcheck

replication,redis-full-check is used to compare whether two redis have the same data. Support redis version from 2.x to 7.x (Don't support Redis Modules).

Organization: tair-opensource

redis data-comparison full-data-check replication redisshake