feat: Add user guide for compaction offload #158
Conversation
| ```toml | ||
| [analytic.compaction_mode] | ||
| compaction_mode = "Offload" | ||
| node_picker = "Remote" |
There was a problem hiding this comment.
endpoint is also required?
| @@ -187,9 +187,27 @@ timeout = "5s" | |||
| server_addrs = ['http://{HoraeMetaAddr}:2379'] | |||
| ``` | |||
|
|
|||
| ### Compaction Offload | |||
|
|
|||
| Compaction offload is also supported in `WithMeta` mode. To enable compaction offload, the compaction mode of HoraeDB Server should be configured as remote compaction: | |||
There was a problem hiding this comment.
IMO, the current implementation doesn't depend on horaemeta?
| [analytic.compaction_mode] | ||
| compaction_mode = "Offload" | ||
| node_picker = "Local" | ||
| endpoint = "{RemoteCompactionServerAddr}:{RemoteCompactionServerGrpcPort}" |
There was a problem hiding this comment.
The remote node picker is not supported without horaemeta. Currently, we need to use local node picker and specify the endpoint.
| endpoint = "{RemoteCompactionServerAddr}:{RemoteCompactionServerGrpcPort}" | ||
| ``` | ||
|
|
||
| A Compaction Server, responsible for executing the compaction task, is also needed. The configuration of Compaction Server is similar to the HoraeDB Server, except that the node type (default `HoraeDB`) should be set to `CompactionServer`: |
There was a problem hiding this comment.
except that the node type (default
HoraeDB) should be set toCompactionServer:
This is required?
In apache/horaedb#1573, you don't configure node_type.
There was a problem hiding this comment.
This is required?
Right. It is not required. It is used to help horaemeta distinguish the horaedb node and compaction node, which is not supported now.
|
@LeslieKid Welcome to join our community, we are implementing a new engine, and lots of work waiting to be done. Or just ping me(id: jiacai2050) if you are already in our Discord/Dingtalk group. |
Close #156