Clickhouse

[pistoletov1974]

Hi! do you plan to add Clickhouse database support? This is exelent database for data analytics.

[drc-infinyon]

Yes @pistoletov1974 we spoke with ClickHouse folks about this a month back. We have plans to build a ClickHouse connector.

Can you share more about your idea?
Are you looking to write data from Fluvio topics into ClickHouse and you are looking for an outbound sink connector to write to ClickHouse?
Or, do you intend to read from ClickHouse into Fluvio topics?
Or, do you intend to do both?

Let me know.

[pistoletov1974]

I looking for write data from fluvio topic into Clickhouse(outbound connector).
I suggest adding Сlickhouse support to Fluvio SQL Sink connector

[prashis]

Hi, I came across this thread while searching for a way to push data from Fluvio topics to Clickhouse. Is there any solution for this?

[drc-infinyon]

We have a couple of live integrations in ingest into click house. It's not on the InfinyOn hub yet. @prashis can you share more about your use case, and how urgent is your requirement.

[prashis]

I was looking for something similar as https://github.com/ClickHouse/clickhouse-kafka-connect. Not urgent as of now.

[drc-infinyon]

Sounds good @prashis. Let me connect with the team and see what we can do.

Fluvio connectors are built using CDK - https://www.fluvio.io/docs/connectors/developers/overview And published on the Hub.

Created an issue to track this request - #4279

I will work with the team and initialize the repository for a ClickHouse Connector and share.

Community contributions are welcome.

[prashis]

Thank you for creating an issue & sharing relevant documentation. I will go through the documentation & if possible I'll contribute.

[sehz]

We have customers who created their own click house connector and used SDF and InfinyOnCloud's webhook to live feed data. We will share example of how to do that.

Overview of SDF: https://www.fluvio.io/sdf/ and Cloud https://www.fluvio.io/docs/cloud/quickstart.