Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Easily download data within location or get server connection #144

Open
Nestak2 opened this issue May 31, 2020 · 2 comments
Open

Easily download data within location or get server connection #144

Nestak2 opened this issue May 31, 2020 · 2 comments

Comments

@Nestak2
Copy link

Nestak2 commented May 31, 2020

Hi, I would like to donwnload the all-time data (~200 stations for ~2 years) for the city of Sofia, Bulgaria, and I just don't find an easy way to do this. Is there a way to filter by location or stations ids before downloading? I noticed this issue, but I need to download ~24 such files, each ~13 GB big which is cumbersome. I see that the files contain columns "location", "altitude" and "longitude", so can I filter by them for each day/month in advance before downloading?

It might be easier for me to login into the server hosting the data and download the data I need with terminal commands (I am using Linux 18.04 and know just enough about terminal commands to maybe make this work). Is the connection to the server open and can you give us some instructions on how to connect?

@YaguraStation
Copy link

Maybe this can help you as a start: https://github.com/YaguraStation/luftdaten-scripts

Instead of using get-sensor-ids.sh for the whole of Bulgaria, sanitise the list with only Sofia sensors and pipe to get-csv.sh with according time range.

Gladly provide PRs with improvements. The scripts are rudimentary and only covered my specific use case, but a generalised version could benefit the whole project, I think.

@EdgarMCR
Copy link

I started writing some helper functions a while back. Its in Python but feel free to copy and use if any is useful:
https://github.com/EdgarMCR/luftdaten-plotting-functions

e.g. https://github.com/EdgarMCR/luftdaten-plotting-functions/blob/master/src/get_data.py#L27

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants