Skip to content

Latest commit

 

History

History
executable file
·
21 lines (15 loc) · 1.58 KB

kdg_3_consume.md

File metadata and controls

executable file
·
21 lines (15 loc) · 1.58 KB

Consume

Note

not done

A reason for using Kafka is the rate of producer exceed the rate of consumer, you want some buffer in the middle to avoid overflowing the consumer.

1 Consumer Group 4 Partitions 2 Consumer Group 4 Partitions
image-20240923164325453 image-20240923164411915
4 Consumer Group 4 Partitions 5 Consumer Group 4 Partitions
image-20240923164424201 image-20240923164446993
Multiple Consumer Groups
image-20240923164849123
  • We cant implement fan-out pattern using one consumer group, we need to create multiple of them
  • No point adding more consumers than producers, some consumers will be idle.