Coder Social home page Coder Social logo

Fenn Zheng's Projects

alibaba-mom icon alibaba-mom

2015 ali中间件比赛项目,1. 通信模块: 涉及到了消息架构设计,每一个主题分配1-2个队列,这个是可以横向增加,考虑到了一个主题有多个消费者订阅,而且还有过滤条件,为了负载均衡,对应的队列投递消息是根据随机数对队列数取膜完成的。以上是内存队列。 2. 持久化系统:因为考虑到机器坏掉,broker不可用等等原因导致的消息丢失,就需要每次收到的消息必须及时落盘,这个就是比赛优化的重中之重。为此设计了一个小型的文件系统,借鉴阿里的rocketmq. 用一个大的日志文件,一般1G大小每个,和内存队列的结构映射到实体队列。整个日志文件是顺序文件,每条消息固定大小,里面有对应的队列号,消息号,还有长度等等。这个方便恢复消息到实体队列用的。 同步刷盘,异步刷盘,持久化必须可靠,所以一般是同步刷盘到日志文件,日志文件定时异步刷盘到实体队列,实体队列里面是索引,消息的本体在日志文件里面。为了加快大面积的写入速度,用了内存映射:内存映射文件首先将外存上的文件映射到内存中的一块连续区域,被当成一个字节数组进行处理,读写操作直接对内存进行操作,而后再将内存区域重新映射到外存文件,这就节省了中间频繁的对外存进行读写的时间,大大降低了读写时间

async icon async

Async utilities for node and the browser

atlas icon atlas

A high-performance and stable proxy for MySQL

boot67 icon boot67

2016-2017末尾写的boot项目,里面含有A股交易所行情源解析的核心片段+es客户端的使用,异步持久化的线程模型

byte-buddy icon byte-buddy

Runtime code generation for the Java virtual machine.

cabot icon cabot

Self-hosted, easily-deployable monitoring and alerts service - like a lightweight PagerDuty

cobar icon cobar

基于MySQL的分布式数据库服务中间件

dddlib icon dddlib

A DDD (Domain Driven Design) Library, derived from the idea of Eric Evans' book: 'Domain-Driven Design: Tackling Complexity in the Heart of Software'

dhydra icon dhydra

主要针对多数据源多策略实时计算的量化分析开发框架。提供新浪Level2等数据获取

diamond icon diamond

来自淘宝diamond:http://code.taobao.org/p/diamond/src/

disconf icon disconf

Distributed Configuration Management Platform(分布式配置管理平台)

disruptor icon disruptor

High Performance Inter-Thread Messaging Library

dragon-book-exercise-answers icon dragon-book-exercise-answers

Compilers Principles, Techniques, & Tools (purple dragon book) second edition exercise answers. 编译原理(紫龙书)第2版习题答案。

dubbo icon dubbo

Dubbo is a distributed service framework enpowers applications with service import/export capability with high performance RPC.

etcd icon etcd

A highly-available key value store for shared configuration and service discovery

guano icon guano

zookeeper dump and restore utility

hades-golang icon hades-golang

Configuration center , support service discovery , written by go.

hades-node-client icon hades-node-client

A simple NodeJS client which supports distribute configuration center and services auto-discovery based on zookeeper.

hades-scala icon hades-scala

Configuration center , support service discovery. -- written by scala

hades-web icon hades-web

A smart web management for configuration-center.(hades-node-client:https://github.com/vernonzheng/hades-node-client)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.