Factors impacting Kafka performance

1. Reads are done sequentially (as in not randomly), therefore make sure you should a disk type that corresponds well to the requirements

2. Format your drives as XFS(easiest, no tuning required)

3. If read/write throughput is your bottleneck

    - it is possible to mount multiple disks in parallel for Kafka

    - The config is log.dirs=/disk1/kafka-logs, /disk2/kafka-logs,/disk3/kafka-logs...

4. Kafka performance is constant with regards to the amount of data stored in Kafka.

    - Make sure you expire data fast enough (default is one week)

    - Make sure you monitor disk performance