We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
In optimize.z_order and optimize.compact there is the target_size parameter but at an initial write the target size isn't an available parameter
optimize.z_order
optimize.compact
target_size
Use Case
Related Issue(s)
The text was updated successfully, but these errors were encountered:
@deanm0000 after the fix you can do this also for first writes:
df.write_delta("test_table", mode='overwrite', delta_write_options={"configuration":{'delta.targetFileSize':str(2*104857600)}})
Sorry, something went wrong.
I was thinking this would stand alone from that fix so it'd show up in the docs here https://delta-io.github.io/delta-rs/api/delta_writer/#deltalake.write_deltalake
I can also expose target_file_size as well, will do that tomorrow :)
Successfully merging a pull request may close this issue.
Description
In
optimize.z_order
andoptimize.compact
there is thetarget_size
parameter but at an initial write the target size isn't an available parameterUse Case
Related Issue(s)
The text was updated successfully, but these errors were encountered: