Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement csv file auto detection #1448

Closed
acquamarin opened this issue Apr 6, 2023 · 1 comment · Fixed by #4309 or #4360
Closed

Implement csv file auto detection #1448

acquamarin opened this issue Apr 6, 2023 · 1 comment · Fixed by #4309 or #4360
Assignees
Labels
good-warm-up Good warm up feature usability Issues related to better usability experience, including bad error messages

Comments

@acquamarin
Copy link
Collaborator

acquamarin commented Apr 6, 2023

As described in duckdb's documentation page:
https://duckdb.org/docs/data/csv/auto_detection
We should have a mechanism to detect the csv parsing options:

  1. Detect the dialect of the CSV file (delimiter, quoting rule, escape) (DONE)
  2. Detect the types of each of the columns (REFACTORING)
  3. Detect whether or not the file has a header row (CONSTRUCTING)
@acquamarin acquamarin added usability Issues related to better usability experience, including bad error messages good-warm-up Good warm up feature labels Apr 6, 2023
@SterlingT3485 SterlingT3485 self-assigned this Sep 12, 2024
@SterlingT3485
Copy link
Collaborator

SterlingT3485 commented Oct 7, 2024

The Dialect Detection is merged

The Header Detection may involve in refactoring our previous code from stage 2 CSVNameAndTypeSniff.
As the Sniffing of Names should be done independently from the Sniffing of Types, in stage 3.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good-warm-up Good warm up feature usability Issues related to better usability experience, including bad error messages
Projects
None yet
2 participants