Skip to content

Commit

Permalink
Merge branch 'master' into us_bea_harish
Browse files Browse the repository at this point in the history
  • Loading branch information
HarishC727 authored Sep 28, 2023
2 parents 9a43b49 + 3612cf1 commit 38ac781
Show file tree
Hide file tree
Showing 10 changed files with 765 additions and 4 deletions.
7 changes: 7 additions & 0 deletions LICENSE-CC4
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
Copyright 2023 Google LLC

The non-source code materials in this project are licensed under:
Creative Commons - Attribution CC-BY 4.0

For the full license text, please visit:
https://creativecommons.org/licenses/by/4.0/legalcode
3 changes: 1 addition & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -249,7 +249,6 @@ To disable yapf for some lines,

For general questions or issues about importing data into Data Commons, please
open an issue on our [issues](https://github.com/datacommonsorg/data/issues)
page. For all other questions, please send an email to
`[email protected]`.
page. For all other questions, please [share feedback on this form](https://docs.google.com/forms/d/e/1FAIpQLScJTtNlIItT-uSPXI98WT6yNlavF-kf5JS0jMrCvJ9TPLmelg/viewform).

**Note** - This is not an officially supported Google product.
4 changes: 2 additions & 2 deletions docs/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ This document summarizes the steps involved in adding a dataset to Data Commons

## Prerequisites

* Ensure that the DC team ([email protected]) has approved the addition of the dataset.
* Ensure that the Data Commons team has approved the addition of the dataset. Please [suggest a dataset here](https://docs.google.com/forms/d/e/1FAIpQLSf_kZ13bmzXvgEbim0OXeAVsTQYsIhN8_o9ekdbjKoeFjfvRA/viewform).
* Review the following documents to get a background on the data model, format and workflow:
* [Summary of data model](https://schema.org/docs/datamodel.html) (DC inherits schema from schema.org)
* [How statistics is represented in DC](representing_statistics.md)
Expand Down Expand Up @@ -35,7 +35,7 @@ Once the entity and schema mapping have been finalized, you can now prepare the
* Data cleaning code (along with README) checked into [data repo](https://github.com/datacommonsorg/data)
* Validation results for the artifacts (from running [`dc-import`](https://github.com/datacommonsorg/import#using-import-tool) tool)

Note: you may also use the [DC Import Wizard](datacommons.org/import) to help generate artifacts for common dataset structures
Note: you may also use the [DC Import Wizard](https://datacommons.org/import) to help generate artifacts for common dataset structures

## Review by DC team

Expand Down
1 change: 1 addition & 0 deletions scripts/un/boundaries/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
output/**
47 changes: 47 additions & 0 deletions scripts/un/boundaries/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,47 @@
# Import Scripts for UN Country Boundaries

### Download URL

From [UN Geodata
Simplified](https://geoportal.un.org/arcgis/apps/sites/#/geohub/datasets/d7caaff3ef4b4f7c82689b7c4694ad92/about),
the UN team got us the BNDA geojson that is checked into `data/`.

### Overview

This script generates both the MCFs as well as the json caches used
in the DC website.

Since Place geos have a single provenance and we want to use these
boundaries only for UN SDG, we add them as a new `geoJsonCoordinatesUN`
property (plus `DPx` suffixes).

The following countries in DC do not have boundaries:
* country/ANT
* country/ATB
* country/ATN
* country/CTE
* country/FXX
* country/IOT
* country/UMI
* country/WLF
* country/XKS
* country/YUG

Among those, the following ones have boundary from World Bank source:
* country/IOT
* country/UMI
* country/WLF


### Scripts

Run the following script to generate Website cache and MCFs ready for import.

```bash
export MIXER_API_KEY=<autopush_api_key>
./run.sh
```

Copy the contents of `output/mcf` over for manifesting.

Copy the contents of `output/cache` to the website repo.
Empty file.
Loading

0 comments on commit 38ac781

Please sign in to comment.