Benchmarking Apache Kafka: 2 Million Writes Per Second (On Three Cheap Machines)

Benchmarking Apache Kafka: 2 Million Writes Per Second (On Three Cheap Machines) I wrote a blog post about how LinkedIn uses Apache Kafka as a central publish-subscribe log for integrating data between applications, stream processing, and Hadoop data ingestion. To actually make this work, though, this "universal log" has to be a cheap abstraction. If you want to use a system as a central data hub

[kimutansk]

6コアXeon、32GBメモリ、7200rpmHDD*6のマシン3台で3プロセスの非同期レプリケーション状態で200MB/s近いスループット出ますか。Kafka。かつ遅延は99.9パーセンタイル14ms程と。