Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

V2cloud #19

Merged
merged 14 commits into from
Aug 8, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .gitignore
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
*.ipynb_checkpoints
*.h5*
*.json
*_V002.json
*GranuleList*
*.Rhistory*
16 changes: 16 additions & 0 deletions CHANGE_LOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,22 @@ and this project adheres to [Semantic Versioning](http://semver.org/).

---

## 2024-03-01

- Removed the Harmony API how-to because the subsetting service will not be available for GEDI V2 data stored in the Earthdata Cloud at the moment.
- Updated `how-to-find-and-access-GEDI-data_earthaccess.ipynb` with the expired token issue happening when higher number of granules were requested.
- Updated `how-to-find-and-access-GEDI-data_earthaccess.ipynb` narrative text.


## 2024-02-20

- Updated the current tutorials and scripts to work after GEDI V2 data collections are moved to the NASA Earthdata Cloud.
- Added new how-tos for accessing GEDI V2
- [how-to-access-GEDI-data-Harmony.ipynb](https://github.com/nasa/GEDI-Data-Resources/tree/main/python/how-tos/how-to-access-GEDI-data-Harmony.ipynb)
- [how-to-find-and-access-GEDI-data_earthaccess.ipynb](https://github.com/nasa/GEDI-Data-Resources/tree/main/python/how-tos/how-to-find-and-access-GEDI-data_earthaccess.ipynb)

- Updated the readme.md

## 2023-11-30

- Updated deprecated pandas code in GEDI_Subsetter.py
Expand Down
37 changes: 14 additions & 23 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,14 +1,14 @@
# GEDI-Data-Resources

Welcome! This repository provides guides, short how-tos, and tutorials to help users access and work with data from the Global Ecosystem Dynamics Investigation (GEDI) mission. In the interest of open science this repository has been made public but is still under active development. All Jupyter notebooks and scripts should be functional, however, changes or additions may be made. Contributions from all parties are welcome.
Welcome! This repository provides guides, short how-tos, and tutorials to help users access and work with data from the Global Ecosystem Dynamics Investigation (GEDI) mission. All Jupyter notebooks and scripts should be functional, however, changes or additions may be made. Contributions from all parties are welcome.

---

## GEDI Background

The Global Ecosystem Dynamics Investigation ([GEDI](https://lpdaac.usgs.gov/data/get-started-data/collection-overview/missions/gedi-overview/)) mission aims to characterize ecosystem structure and dynamics to enable radically improved quantification and understanding of the Earth's carbon cycle and biodiversity. [GEDI](https://gedi.umd.edu/mission/mission-overview/) Level 1 and Level 2 Data Products are distributed by the Land Processes Distributed Active Archive Center ([LP DAAC](https://lpdaac.usgs.gov/data/get-started-data/collection-overview/missions/gedi-overview/)) and Level 3 and Level 4 Data Products are distributed by the [ORNL DAAC]([https://daac.ornl.gov/cgi-bin/dataset_lister.pl?p=40]).

Search for and download GEDI _Version 2_ data products via a graphical user interface (GUI) using [NASA EarthData Search](https://search.earthdata.nasa.gov/search?q=%22GEDI%22) or programmatically using NASA's [Common Metadata Repository](https://cmr.earthdata.nasa.gov/search) (CMR).
Search for and download GEDI _Version 2_ data products via a graphical user interface (GUI) using [NASA EarthData Search](https://search.earthdata.nasa.gov/search?ff=Available%20in%20Earthdata%20Cloud&fi=GEDI&as[instrument][0]=GEDI) or programmatically using NASA's [Common Metadata Repository](https://cmr.earthdata.nasa.gov/search) (CMR), earthaccess python package, or Harmony API.

---

Expand All @@ -22,17 +22,6 @@ Search for and download GEDI _Version 2_ data products via a graphical user inte

## Prerequisites/Setup Instructions


### File Downloads

These granules below are used within the tutorials. Click/copy the URLs into a browser to download. Save them into the `./data/` folder within this repository. You will need a [NASA Earth Data Search](https://search.earthdata.nasa.gov/search) login to download the data used in this tutorial. You can create an account at the link provided.

+ L1B Granule - <https://e4ftl01.cr.usgs.gov/GEDI/GEDI01_B.002/2019.06.19/GEDI01_B_2019170155833_O02932_02_T02267_02_005_01_V002.h5>
+ L2A Granule - <https://e4ftl01.cr.usgs.gov/GEDI/GEDI02_A.002/2019.06.19/GEDI02_A_2019170155833_O02932_02_T02267_02_003_01_V002.h5>
+ L2B Granule - <https://e4ftl01.cr.usgs.gov/GEDI/GEDI02_B.002/2019.06.19/GEDI02_B_2019170155833_O02932_02_T02267_02_003_01_V002.h5>

---

### Environment Setup

Instructions for setting up a compatible environment for working with GEDI data are linked to below.
Expand All @@ -52,15 +41,16 @@ Instructions for setting up a compatible environment for working with GEDI data

Content in this repository is divided into Python and R tutorials/scripts. The tutorials walk you through workin with GEDI data step by step while the scripts are command line executables.

| Repository Contents | Summary | Path |
|----|-----|----|
| **[GEDI_L1B_V2_Tutorial.ipynb](https://github.com/nasa/GEDI-Data-Resources/blob/main/python/tutorials/GEDI_L1B_V2_Tutorial.ipynb)** | Jupyter Notebook tutorial demonstrating how to work with the Geolocated Waveform GEDI01_B.002 data product using Python | `python\tutorials` |
| **[GEDI_L2A_V2_Tutorial.ipynb](https://github.com/nasa/GEDI-Data-Resources/blob/main/python/tutorials/GEDI_L2A_V2_Tutorial.ipynb)** | Jupyter Notebook tutorial demonstrating how to work with the Geolocated Waveform GEDI02_A.002 data product using Python | `python\tutorials` |
| **[GEDI_L2B_V2_Tutorial.ipynb](https://github.com/nasa/GEDI-Data-Resources/blob/main/python/tutorials/GEDI_L2B_V2_Tutorial.ipynb)** | Jupyter Notebook tutorial demonstrating how to how to work with the Geolocated Waveform GEDI02_B.002 data product using Python | `python\tutorials` |
| **[GEDI_Finder_Tutorial_Python.ipynb](https://github.com/nasa/GEDI-Data-Resources/blob/main/python/tutorials/GEDI_Finder_Tutorial_Python.ipynb)** | Jupyter Notebook tutorial demonstrating how to perform spatial [bounding box] queries for GEDI V2 L1B, L2A, and L2B data using NASA's CMR, and how to reformat the CMR response into a list of links that will allow users to download the intersecting GEDI V2 sub-orbit granules directly from the LP DAAC Data Pool using Python | `python\tutorials` |
| **[GEDI_Finder_Tutorial_R.Rmd](https://github.com/nasa/GEDI-Data-Resources/blob/main/r/GEDI_Finder_Tutorial_R.rmd)** | R Markdown tutorial demonstrating how to use R to perform spatial [bounding box] queries for GEDI V2 L1B, L2A, and L2B data using NASA's CMR, and how to reformat the CMR response into a list of links that will allow users to download the intersecting GEDI V2 sub-orbit granules directly from the LP DAAC Data Pool | `R` |
| **[GEDI_Finder.py](https://github.com/nasa/GEDI-Data-Resources/tree/main/python/scripts/GEDI_Finder)** | Command line executable performing spatial [bounding box] and temporal queries for GEDI V2 L1B, L2A, and L2B data using NASA's CMR and reformats the CMR response into a list of links that will allow users to download the intersecting GEDI V2 sub-orbit granules directly from the LP DAAC Data Pool. | `python/scripts/GEDI_Finder` |
| **[GEDI_Subsetter.py](https://github.com/nasa/GEDI-Data-Resources/tree/main/python/scripts/GEDI_Subsetter)** | Command line executable converting GEDI data products, stored in Hierarchical Data Format version 5 (HDF5, .h5) into GeoJSON files that can be loaded into GIS and Remote Sensing Software | `python/scripts/GEDI_Subsetter` |
| Name | Type | Summary | Services and Tools |
|----|-----|----|----|
| **GEDI_L1B_V2_Tutorial.ipynb** | [Jupyter Notebook](python/tutorials/GEDI_L1B_V2_Tutorial.ipynb)| Tutorial demonstrating how to work with the Geolocated Waveform GEDI01_B.002 data product using Python | |
| **GEDI_L2A_V2_Tutorial.ipynb** | [Jupyter Notebook](python/tutorials/GEDI_L2A_V2_Tutorial.ipynb) | Tutorial demonstrating how to work with the Geolocated Waveform GEDI02_A.002 data product using Python | |
| **GEDI_L2B_V2_Tutorial.ipynb** | [Jupyter Notebook](python/tutorials/GEDI_L2B_V2_Tutorial.ipynb) | Tutorial demonstrating how to how to work with the Geolocated Waveform GEDI02_B.002 data product using Python | |
| **GEDI_Finder_Tutorial_Python.ipynb** | [Jupyter Notebook](python/tutorials/GEDI_Finder_Tutorial_Python.ipynb) | Tutorial demonstrating how to perform spatial [bounding box] queries for GEDI V2 L1B, L2A, and L2B data using NASA's CMR, and how to reformat the CMR response into a list of links that will allow users to download the intersecting GEDI V2 sub-orbit granules using Python | [CMR API](https://cmr.earthdata.nasa.gov/search/site/docs/search/api.html) |
| **GEDI_Finder_Tutorial_R.Rmd** | [R Markdown](r/GEDI_Finder_Tutorial_R.rmd) | Tutorial demonstrating how to use R to perform spatial [bounding box] queries for GEDI V2 L1B, L2A, and L2B data using NASA's CMR, and how to reformat the CMR response into a list of links that will allow users to download the intersecting GEDI V2 sub-orbit granules | [CMR API](https://cmr.earthdata.nasa.gov/search/site/docs/search/api.html) |
| **GEDI_Finder.py** | [Command line executable](python/scripts/GEDI_Finder) | Script performing spatial [bounding box] and temporal queries for GEDI V2 L1B, L2A, and L2B data using NASA's CMR and reformats the CMR response into a list of links that will allow users to download the intersecting GEDI V2 sub-orbit granules | [CMR API](https://cmr.earthdata.nasa.gov/search/site/docs/search/api.html) |
| **GEDI_Subsetter.py** | [Command line executable](python/scripts/GEDI_Subsetter) | Script converting GEDI data products, stored in Hierarchical Data Format version 5 (HDF5, .h5) into GeoJSON files that can be loaded into GIS and Remote Sensing Software | |
| **how-to-find-and-access-GEDI-data_earthaccess.ipynb** | [Jupyter Notebook](python/how-tos/how-to-find-and-access-GEDI-data_earthaccess.ipynb) | Shows how to access GEDI data using earthaccess Python package locally and directly in the cloud | [earthaccess](https://github.com/nsidc/earthaccess) |


---
Expand All @@ -72,6 +62,7 @@ Content in this repository is divided into Python and R tutorials/scripts. The t
- [LP DAAC Website](https://lpdaac.usgs.gov/)
- [LP DAAC GitHub](https://github.com/nasa/LPDAAC-Data-Resources)
- [NASA Earthdata Search](https://search.earthdata.nasa.gov/search)
- [GEDI at NASA's Scientific Visualization Studio](https://svs.gsfc.nasa.gov/search/?search=GEDI)

---

Expand All @@ -81,6 +72,6 @@ Email: [email protected]
Voice: +1-866-573-3222
Organization: Land Processes Distributed Active Archive Center (LP DAAC)¹
Website: <https://lpdaac.usgs.gov/>
Date last modified: 06-08-2023
Date last modified: 02-20-2024

¹Work performed under USGS contract G15PD00467 for NASA contract NNG14HH33I.
1 change: 1 addition & 0 deletions data/GEDI_Datasets.json

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions data/sequoia.geojson
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"type":"FeatureCollection","features":[{"type":"Feature","properties":{},"geometry":{"type":"Polygon","coordinates":[[[-118.5562008683133,37.054833903438414],[-118.62023689977332,37.052306109907725],[-118.68364361577358,37.044747575631085],[-118.7457982619934,37.03223258018768],[-118.80609112257102,37.014884061658194],[-118.86393183151212,36.992872336414315],[-118.9187554394848,36.96641332980435],[-118.97002816222776,36.93576634013681],[-119.01725274308889,36.901231363963085],[-119.05997336964064,36.86314601570012],[-119.09778009263769,36.82188207903588],[-119.1303127045149,36.77784173126395],[-119.1572640438968,36.73145348466567],[-119.17838270193468,36.6831678912857],[-119.19347511545028,36.63345305893807],[-119.20240704063043,36.58279002706412],[-119.20510440919372,36.53166805118261],[-119.20155357639713,36.48057984418473],[-119.1918009768612,36.430016821695006],[-119.17595220990756,36.38046439721669],[-119.15417058090006,36.33239737087699],[-119.12667512897241,36.28627545335696],[-119.09373817455797,36.24253896410006],[-119.05568242237536,36.201604740205],[-119.01287765705642,36.1638622895781],[-118.96573706952763,36.129670218996594],[-118.9147132526765,36.09935296475546],[-118.86029390485886,36.073197850569485],[-118.80299727953474,36.05145249440219],[-118.74336741885551,36.03432258291131],[-118.68196920845594,36.021970029246155],[-118.61938329010519,36.01451152701098],[-118.5562008683133,36.01201751032007],[-118.4930184465214,36.01451152701098],[-118.43043252817067,36.021970029246155],[-118.3690343177711,36.03432258291131],[-118.30940445709187,36.05145249440219],[-118.25210783176772,36.073197850569485],[-118.1976884839501,36.09935296475546],[-118.14666466709897,36.129670218996594],[-118.09952407957019,36.1638622895781],[-118.05671931425125,36.201604740205],[-118.01866356206864,36.24253896410006],[-117.9857266076542,36.28627545335696],[-117.95823115572655,36.33239737087699],[-117.93644952671904,36.38046439721669],[-117.9206007597654,36.430016821695006],[-117.91084816022946,36.48057984418473],[-117.90729732743289,36.53166805118261],[-117.90999469599618,36.58279002706412],[-117.91892662117633,36.63345305893807],[-117.93401903469193,36.6831678912857],[-117.95513769272979,36.73145348466567],[-117.9820890321117,36.77784173126395],[-118.01462164398892,36.82188207903588],[-118.05242836698596,36.86314601570012],[-118.0951489935377,36.901231363963085],[-118.14237357439885,36.93576634013681],[-118.19364629714181,36.96641332980435],[-118.24846990511449,36.992872336414315],[-118.30631061405559,37.014884061658194],[-118.36660347463321,37.03223258018768],[-118.42875812085302,37.044747575631085],[-118.49216483685329,37.052306109907725],[-118.5562008683133,37.054833903438414]]]}}]}
Loading