-
Notifications
You must be signed in to change notification settings - Fork 113
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge branch 'master' into us_bea_harish
- Loading branch information
Showing
10 changed files
with
765 additions
and
4 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,7 @@ | ||
Copyright 2023 Google LLC | ||
|
||
The non-source code materials in this project are licensed under: | ||
Creative Commons - Attribution CC-BY 4.0 | ||
|
||
For the full license text, please visit: | ||
https://creativecommons.org/licenses/by/4.0/legalcode |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -249,7 +249,6 @@ To disable yapf for some lines, | |
|
||
For general questions or issues about importing data into Data Commons, please | ||
open an issue on our [issues](https://github.com/datacommonsorg/data/issues) | ||
page. For all other questions, please send an email to | ||
`[email protected]`. | ||
page. For all other questions, please [share feedback on this form](https://docs.google.com/forms/d/e/1FAIpQLScJTtNlIItT-uSPXI98WT6yNlavF-kf5JS0jMrCvJ9TPLmelg/viewform). | ||
|
||
**Note** - This is not an officially supported Google product. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -4,7 +4,7 @@ This document summarizes the steps involved in adding a dataset to Data Commons | |
|
||
## Prerequisites | ||
|
||
* Ensure that the DC team ([email protected]) has approved the addition of the dataset. | ||
* Ensure that the Data Commons team has approved the addition of the dataset. Please [suggest a dataset here](https://docs.google.com/forms/d/e/1FAIpQLSf_kZ13bmzXvgEbim0OXeAVsTQYsIhN8_o9ekdbjKoeFjfvRA/viewform). | ||
* Review the following documents to get a background on the data model, format and workflow: | ||
* [Summary of data model](https://schema.org/docs/datamodel.html) (DC inherits schema from schema.org) | ||
* [How statistics is represented in DC](representing_statistics.md) | ||
|
@@ -35,7 +35,7 @@ Once the entity and schema mapping have been finalized, you can now prepare the | |
* Data cleaning code (along with README) checked into [data repo](https://github.com/datacommonsorg/data) | ||
* Validation results for the artifacts (from running [`dc-import`](https://github.com/datacommonsorg/import#using-import-tool) tool) | ||
|
||
Note: you may also use the [DC Import Wizard](datacommons.org/import) to help generate artifacts for common dataset structures | ||
Note: you may also use the [DC Import Wizard](https://datacommons.org/import) to help generate artifacts for common dataset structures | ||
|
||
## Review by DC team | ||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
output/** |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,47 @@ | ||
# Import Scripts for UN Country Boundaries | ||
|
||
### Download URL | ||
|
||
From [UN Geodata | ||
Simplified](https://geoportal.un.org/arcgis/apps/sites/#/geohub/datasets/d7caaff3ef4b4f7c82689b7c4694ad92/about), | ||
the UN team got us the BNDA geojson that is checked into `data/`. | ||
|
||
### Overview | ||
|
||
This script generates both the MCFs as well as the json caches used | ||
in the DC website. | ||
|
||
Since Place geos have a single provenance and we want to use these | ||
boundaries only for UN SDG, we add them as a new `geoJsonCoordinatesUN` | ||
property (plus `DPx` suffixes). | ||
|
||
The following countries in DC do not have boundaries: | ||
* country/ANT | ||
* country/ATB | ||
* country/ATN | ||
* country/CTE | ||
* country/FXX | ||
* country/IOT | ||
* country/UMI | ||
* country/WLF | ||
* country/XKS | ||
* country/YUG | ||
|
||
Among those, the following ones have boundary from World Bank source: | ||
* country/IOT | ||
* country/UMI | ||
* country/WLF | ||
|
||
|
||
### Scripts | ||
|
||
Run the following script to generate Website cache and MCFs ready for import. | ||
|
||
```bash | ||
export MIXER_API_KEY=<autopush_api_key> | ||
./run.sh | ||
``` | ||
|
||
Copy the contents of `output/mcf` over for manifesting. | ||
|
||
Copy the contents of `output/cache` to the website repo. |
Empty file.
Oops, something went wrong.