Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: pmtiles stats #70

Closed
bdon opened this issue Sep 5, 2023 · 2 comments
Closed

Feature: pmtiles stats #70

bdon opened this issue Sep 5, 2023 · 2 comments

Comments

@bdon
Copy link
Member

bdon commented Sep 5, 2023

  • coordinate with @msbarry on a rough CSV format that can be quickly turned into DuckDB
  • needs to be produced in a single pass
  • come to consensus on how duplicates are treated

Downstream requirements:

  • joining with ("top 100k statistics")
  • interactive visualization. We could write a very small web server utility that runs off the DuckDB file and spits out vector tiles or raster images: OR, we could create a drag-and-drop UI to run DuckDb in WebAssembly and produce tiles via addProtocol
@msbarry
Copy link
Contributor

msbarry commented Sep 6, 2023

Startin a PR for planetiler tile stats output here: onthegomap/planetiler#656

I think the relevant open questions to both implementations are:

  • what data to emit? Could be:
    • tile-level (z,x,y->tile size)
    • deduped-tile-level (z,x,y->id, id->tile sizes)
    • layer-level (z,x,y,layer->layer sizes)
    • or layer/attribute level (z,x,y,layer,attr->size that attribute contributes to layer)
  • what format to emit it in? (tsv.gz, duckdb, parquet, newline-delimited json)

bdon added a commit that referenced this issue Sep 12, 2023
* Output a .tsv.gz of all non-duplicate ZXY tiles with their compressed length.
bdon added a commit that referenced this issue Sep 12, 2023
* Output a .tsv.gz of all non-duplicate ZXY tiles with their compressed length.
@bdon
Copy link
Member Author

bdon commented Sep 12, 2023

Basic implementation on main now, discuss in onthegomap/planetiler#656 and we'll follow the format in this project

@bdon bdon closed this as completed Sep 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants