Kafka Processing service

Welcome to the Kafka Processing Service

Introduction

Kafka service processing messages from specific topics and writing the data into a Postgres database, using the reactive paradigm. For testing purposes, the KafkaProducerService upon startup produces 100 events. These are processed in the KafkaConsumerService and inserted into the database.

Few considerations regarding the consumer:

• since the requirement did not mention anything about idempotency, that was not insured in the consumer.
• if that had been required, then additional database searches would have been necessary alongside with additional business logic concerning the way the data needs to be updated.

Prerequisites: Java 17, Docker, Postgres, Apache Kafka, Gradle 8.0.1.

• Getting Started
• Help

Getting Started

To run this application, fist download the archive containing the application, unzip it and run the following commands:

cd kafka-service
docker build -t nordcloud/kafka-service:0.0.1-SNAPSHOT .
docker compose up

This example uses the following open source projects:

• Spring Boot
• Spring Data R2DBC
• Project reactor
• Reactor Kafka
• TestContainers

Help

For any questions you might have regarding this project, please email them at: [email protected] .