Scaling Slack’s Job Queue – Several People Are Coding
Slack uses a job queue system for business logic that is too time-consuming to run in the context of a web request. This system is a critical component of our architecture, used for every Slack message post, push notification, URL unfurl, calendar reminder, and billing calculation. On our busiest days, the system processes over 1.4 billion jobs at a peak rate of 33,000 per second. Job execution ti
GitHub - bogdanovich/siberite: Siberite is a simple, lightweight, leveldb backed message queue written in Go.
Siberite is a simple LevelDB-backed message queue server (twitter/kestrel, wavii/darner rewritten in Go). Siberite is a simple message queue server. Unlike in-memory servers like Redis, Siberite is designed to handle queues much larger than what can fit in RAM. And unlike enterprise-level servers such as RabbitMQ, Siberite stores all messages out of process, using goleveldb for persistent storage.
Building a Message Queue using Redis in Go - Big elephants
Redis is not just a very good in-memory database, it can also double as a message queue. I want to show you our first shot at implementing a queue in Redis that can fulfill all our requirements: reliable, persistent, fast, monitorable. While still being a Gedankenexperiment the basic idea should be a very good starting point. Although we used Go for our implementation, the concept could be transfe
Tuning Redismq - how to use Redis in Go - Big elephants
In my last article I talked about how redismq employs a simple Redis client to describe a message queue. The first iteration was aimed at proof of concept and to satisfy my own curiosity. Since then adeven decided to use it in production and so we developed the initial idea into a full featured queue. On the way we picked up a lot of interesting stuff which I’d like to share with you. Performance
bitly/nsq · GitHub - A realtime distributed messaging platform
Source: https://github.com/nsqio/nsq Issues: https://github.com/nsqio/nsq/issues Mailing List: nsq-users@googlegroups.com IRC: #nsq on freenode Docs: https://nsq.io Twitter: @nsqio NSQ is a realtime distributed messaging platform designed to operate at scale, handling billions of messages per day. It promotes distributed and decentralized topologies without single points of failure, enabling fault
1
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
GitHub - MasslessParticle/GoQ: Lightweight message queue in Golang
GitHub - iamduo/workq: Job server in Go
GitHub - fabiokung/cqueue: Lock-free, non-blocking, concurrent queue on shared memory for Go
GitHub - RichardKnop/machinery: Machinery is an asynchronous task queue/job queue based on distributed message passing.