giant-stone / gmq Goto Github PK

View Code? Open in Web Editor NEW

3.0 3.0 1.0 136 KB

一个支持自定义消费速率的简单消息队列 Simple, reliable, lightweight and efficient task queue in Go

License: MIT License

Go 99.45% Batchfile 0.11% Makefile 0.44%

crawler message-queue redis task-manager

gmq's People

Contributors

Stargazers

Forkers

cdoutzen

gmq's Issues

私信 dieat err processedat 均为空

processedat 应该记录 handler 从队列取出的时间戳
dieat 记录 handler 放入 failed 的时间戳
err 记录 handler 的返回的 error 上下文

v0.0.10 中 gmqcli -week 输出 processed failed 两列数据对调统计有误

support sqlite3 broker

Enqueue add force option for client

错误消息输出提示逻辑重复

gmq/gmq/middleware_logging_elapsed.go

Line 17 in cdab165

    
           glogging.Sugared.Warnf("ProcessMsg failed %v %v %s", time.Since(start).Round(time.Millisecond), err, shorten)

的错误消息输出逻辑与

gmq/gmq/processor.go

Line 139 in cdab165

func (it *Processor) handleFailedMsg(msg IMsg, errFail error) {

错误消息处理逻辑重复

update queue list while enqueue item

add Enqueue delay option

logging slow threshold

remove processor debug logging

gmq/gmq/processor.go

Line 145 in cdab165

    
           it.logger.Errorf("queue:%s id:%s failed. error(%v)", it.queueName, msg.GetId(), errFail)

CLI tool supports list messages and get message detail

list messages

./gmqcli.bin -listmsg <queueName> -state failed [-limit 10 -offset 10]

options required: -state
options optional: -limit -offset

get message detail

./gmqcli.bin -getmsg -i <msgId> -q <queueName>

options required: -i -q

NOTE: drop old -get option

Use go.uber.org/mock replace github.com/golang/mock

CLI tool print last 7 days stats

https://github.com/giant-stone/gmq/blob/master/gmq/cmd/gmqcli/main.go#L40
cmdStatsWeekly 合并入 cmdPrintStats

CLI tool supports empty specified queue by name

usage

delete all related messages from queue

./gmqcli.bin -delqueue <queueName>

实现内存存储 broker

支持 macOS and Windows 平台
补充文档
执行测试时根据变量控制是否跳过 Redis broker 相关测试

mute gmq/scheduler.go logging error

gmq/gmq/scheduler.go

Line 83 in 687ff6e

    
           it.logger.Errorf("scheduler client.Enqueue message failed, id=%s queue=%s", it.msg.GetId(), it.msg.GetQueue())