Apache Kafkaの推奨構成と性能の見積もり方法 - Qiita
初版: 2018/10/12 著者: 伊藤 雅博, 株式会社日立製作所 はじめに この投稿ではオープンソースカンファレンス2017.Enterpriseで発表した「めざせ！Kafkaマスター ～Apache Kafkaで最高の性能を出すには～」の検証時に調査した内容を紹介します（全8回の予定）。本投稿の内容は2017年6月にリリースされたKafka 0.11.0 時点のものです。 第3回目となる今回は、Kafkaの推奨システム構成とネットワーク・ディスク性能の見積もり方法について紹介します。 投稿一覧： 1. Apache Kafkaの概要とアーキテクチャ 2. Apache KafkaのProducer/Broker/Consumerのしくみと設定一覧 3. Apache Kafkaの推奨構成と性能の見積もり方法 (本投稿) 4. Apache Kafkaの性能検証(1): 検証環境とパ
High Available Task Scheduling — Design using Kafka and Kafka Streams
In any Enterprise or Cloud application, Task scheduling is a key requirement. A highly available and fault tolerant task scheduling will help you to improve your business goals. A classic task scheduling infrastructure is typically backed by databases. The instances/service that performs the scheduling, loads the task definitions from the database into memory and performs the task scheduling. This
A Few Notes on Kafka and Jepsen
About I am the co-founder of Confluent and also the co-creator of Apache Kafka as well as various other open source projects. Kyle has a good write-up on replication and partitions in Kafka. I am a big fan of this methodology (empiricism FTW), though it is a bit uncomfortable to watch ones own project strapped to the apparatus. Kyle’s explanation is pretty clear, so I have only a few things to add
Apache Kafka
Documentation Kafka 3.9 Documentation Prior releases: 0.7.x, 0.8.0, 0.8.1.X, 0.8.2.X, 0.9.0.X, 0.10.0.X, 0.10.1.X, 0.10.2.X, 0.11.0.X, 1.0.X, 1.1.X, 2.0.X, 2.1.X, 2.2.X, 2.3.X, 2.4.X, 2.5.X, 2.6.X, 2.7.X, 2.8.X, 3.0.X, 3.1.X, 3.2.X, 3.3.X, 3.4.X, 3.5.X, 3.6.X, 3.7.X, 3.8.X. 1. Getting Started 1.1 Introduction 1.2 Use Cases Here is a description of a few of the popular use cases for Apache Kafka®.
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Jepsen: Kafka
Welcome to Event Streaming Patterns
Kafka raft (KRaft) cluster configuration from dev to prod — part 1
Apache Kafka At the Gates of Mastery – Medium
Minimize local storage usage for Kafka
How to run Apache Kafka without Zookeeper
Apache Kafka® Anti-Patterns and How To Avoid Them
Kafka Connect, Postgres, and Amazon S3 — Part 1
Install Apache Kafka KRaft cluster in docker container
Kafka cluster without Zookeeper
VGA
The Zero Copy Principle With Apache Kafka
Incredible Kafka Integration with AWS S3 using Connectors
Apache Kafka as a centralized state management platform — Part 1
Apache Kafka as a centralized state management platform — Part 2
KRaft — The Next Generation Kafka Architecture