[Feature Request]: LOAD INTO VALUES

[fengttt]

Is there an existing issue for the same feature request?

• I have checked the existing issues.

Is your feature request related to a problem?

SQL has the following syntax, insert into t with many rows.
insert into t values (1, 2), (3, 4), ...

Potentially we can extend sql with our own binary 
insert into t binary values [format] ['protocolbuffer', 'matrixone'] 0x'XXXXXXXX';

format matrixone, the 0x'XXXX' is simply a serialized matrixone batch.
format protocol buffer can use a simple protocol buffer format of batch.

It can be prepared, insert into t binary values format 'protocolbuffer' ?
then people serialize a protocol buffer and execute it.

Describe the feature you'd like

We can either publish protocolbuffer definition and let user serialize it, or, we can publish our own client software and
turn insert into ... values ... into insert into ... binary values ...

Our own client driver is definitely much less intrusive to customer but that means we need to fork/maintain jdbc, python client, etc. And that is intrusive in a different way.

I think protocol buffer has enough language bindings that we can simply use that. Or parquet/arrow. Note that we may need to support parquet/arrow anyway as part of external table work.

But our internal use (logging) can simply use our own batch format

Describe implementation you've considered

No response

Documentation, Adoption, Use Case, Migration Strategy

No response

Additional information

No response

[fengttt]

So far the "format" that comes to mind are,

1. our own batch format
2. CSV
3. Json array or jsonline
4. Other binary formats like a well defined protocol buffer, parquet, arrow, etc.

I think 1, 2, 3 will be great. Doing 4 is even better but optional.

[dengn]

Doc related questions:

1. what's even the priority for this feature?
2. it seems to be such a big feature, needs specification about the real implementation.

[domingozhang]

USE new syntax
LOAD INTO insert into t values [format]

[fengttt]

Current load syntax,

load data infile 'path_to_file.csv' into table t;

We pretty much want an inline file -- that is,

load data ...
inputdata = 'string values'

Or we can even overload current syntax

inputfile {path="inline", data="....", format="csv/json"}

[florashi181]

to clarify the syntax in this week. @domingozhang

[lacrimosaprinz]

related doc：
matrixorigin/matrixorigin.io#540
matrixorigin/matrixorigin.io.cn#744

[nnsgmsone]

Completed by 11633