Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Quick search results using csv export option #8

Open
maarten-vermeyen opened this issue Nov 7, 2024 · 0 comments
Open

Quick search results using csv export option #8

maarten-vermeyen opened this issue Nov 7, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@maarten-vermeyen
Copy link
Contributor

For complex queries using a lot of controlled vocabulary combinations, it is imperative to use the services to extract data. Using the JSON REST service requires a lot of queries to get details of the objects. For some simpler use cases, it might be beneficial to use the CSV view, as this offers more data.

While the CSV representation does lose some information on 'kenmerkgroepen', it is sufficient for many use cases. We could quite easily implement a function that takes a query string, fetches the results in CSV and returns a dataframe.

The results of the CSV files are limited to 2000 results and are paginated using the link header. The CSV's do start with a variable length comment section without a comment character. Ideally this would be implemented at the source, but there is no standard comment character for CSV. The amount of lines that should be skipped can be determined by looking at the link headers, as the length varies because of the presence or absence of a previous/next link on the first/last page. This is however not considered a part of the API so there are no guarantees that this would be stable. It might be a (temporary) workaround until the comment character is implemented at the source.

@koenedaele, any thoughts on this?

@maarten-vermeyen maarten-vermeyen added the enhancement New feature or request label Nov 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant