Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add censusfips metadata #4006

Merged
merged 8 commits into from
Jan 17, 2025
Merged

add censusfips metadata #4006

Changes from 3 commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
fcdebb2
add censusfips metadata
cmgosnell Jan 9, 2025
d0b4c0c
Merge branch 'main' into fips-fix
e-belfer Jan 9, 2025
3b14928
change fips dataset name
cmgosnell Jan 9, 2025
e38b422
Update src/pudl/metadata/sources.py
cmgosnell Jan 14, 2025
22c2d50
Merge branch 'main' into fips-fix
cmgosnell Jan 14, 2025
cfa402e
Add extractor - currently using sandbox doi
cmgosnell Jan 14, 2025
6f18f82
Merge branch 'main' into fips-fix
e-belfer Jan 16, 2025
932ab34
remove the extraction step from this pr
cmgosnell Jan 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 18 additions & 0 deletions src/pudl/metadata/sources.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,24 @@
"license_pudl": LICENSES["cc-by-4.0"],
"contributors": [CONTRIBUTORS["catalyst-cooperative"]],
},
"censuspep": {
"title": "Population Estimates Program's (PEP) Federal Information Processing Series (FIPS) Codes",
"path": "https://www.census.gov/geographies/reference-files/2023/demo/popest/2023-fips.html",
"description": (
"Reference files for Federal Information Processing Series (FIPS) Geographic Codes. "
"These FIPS Codes are a subset of a broader Population Estimates dataset."
),
"working_partitions": {"years": sorted(set(range(2011, 2024)))},
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
"working_partitions": {"years": sorted(set(range(2011, 2024)))},
"working_partitions": {"years": sorted(set(2000, range(2011, 2024)))},

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a good flag! but since for now we are only planning on using the one freshest year i think it should only be 2023

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we anticipate updating our fipsification to deal with the time variability of these mappings? There'll definitely be inconsistencies in any individual vintage if we apply it across all years of data.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the plan for this issue rn is to effectively replicate addfips which is to say use one vintage. This vintage will be much more recent (2023 instead of addfips most recent 2015). It should be pretty easy with this overall setup to add the additional vintages as a next step.

"keywords": sorted(
{
"fips",
"census",
cmgosnell marked this conversation as resolved.
Show resolved Hide resolved
}
),
"license_raw": LICENSES["us-govt"],
"license_pudl": LICENSES["cc-by-4.0"],
"contributors": [CONTRIBUTORS["catalyst-cooperative"]],
},
"eia176": {
"title": "EIA Form 176 -- Annual Report of Natural and Supplemental Gas Supply and Disposition",
"path": "https://www.eia.gov/naturalgas/ngqs/",
Expand Down
Loading