aiyojun / herding

To solve various problems by creating distributed/cluster application and explore the possibilities of the cluster.

herding

To solve various problems by creating distributed/cluster application and explore the possibilities of the cluster.

Base

zookeeper

Definition: ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services.

mesos - the distributed resource managing

Definition: Mesos is built using the same principles as the Linux kernel, only at a different level of abstraction. The Mesos kernel runs on every machine and provides applications (e.g., Hadoop, Spark, Kafka, Elasticsearch) with API’s for resource management and scheduling across entire datacenter and cloud environments.

Distributed computing

spark

Definition: Apache Spark is a unified analytics engine for big data processing, with built-in modules for streaming, SQL, machine learning and graph processing.

stream data processing

Such as kafka, storm, flink.

Container Tech

docker

Refer to namespace, cgroup of linux.

Concurrent computing

MPI, openMP