Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Final data processing #16

Open
wants to merge 30 commits into
base: main
Choose a base branch
from
Open

Final data processing #16

wants to merge 30 commits into from

Conversation

samgdotson
Copy link
Member

This pull request finalizes the data collection and pre-processing steps.

Important

Please do not review or merge this PR before PR #6 has been merged. This branch extends that branch.

This PR

samgdotson added 27 commits July 17, 2024 15:48
@samgdotson
updates git ignore and zoning map
0166a09
@samgdotson
adds snakefile and the steps required for pulling residential data
be79c90
@samgdotson
adds rule to build the dag file
5d48685
@samgdotson
starts adding utility access feature
bc17302
@samgdotson
adds steps to get relevant utility rates (no processing)
d3383d3
@samgdotson
updates the residential load retrieval
52cce01
@samgdotson
adds rule to download project sunroof data
9ec5bfb
@samgdotson
propagates update to affected rules
0c51a31
@samgdotson
commits local updates
9a962ff
@samgdotson
pep8 fixes for census data retrieval
b772eb6
@samgdotson
pep8 fixes
30b63f8
@samgdotson
merge conf
63a3aea
@samgdotson
adds info about rules to README
3420aa6
@samgdotson
downloads weather data along with load data
a468aef
@samgdotson
downloads total building data
a06a687
@samgdotson
adds rule to retrieve lead data
92fb838
@samgdotson
adds rule to calculate the weighted average energy expenses by buildi…
966fe2c 
…ng type
@samgdotson
adds model options to config
d22b6d2
@samgdotson
adds hplib to environment file
c469860
@samgdotson
adds rule to download several files from wykck gis database
08ce780
@samgdotson
generalizes the community 'name'
7e1d1e2
@samgdotson
propagates name change
88845c6
@samgdotson
adds retail prices to config
49d43f4
@samgdotson
adds rescaling rule to snakefile
c5fc2e2
@samgdotson
adds rule to rescale load from resstock based on LEAD data
e1e730d
@samgdotson
adds rule to retrieve nrel costs
73e8161
@samgdotson
adds costs to targets
34a134a
@samgdotson samgdotson added the enhancement New feature or request label Sep 19, 2024
@samgdotson samgdotson added this to the First model runs completed milestone Sep 19, 2024
@samgdotson samgdotson requested a review from ssattler September 19, 2024 19:27
@samgdotson samgdotson self-assigned this Sep 19, 2024
@pep8speaks
Copy link

pep8speaks commented Sep 19, 2024 •
edited
Loading

Hello @samgdotson! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

Line 5:1: W293 blank line contains whitespace
Line 7:1: W293 blank line contains whitespace
Line 8:31: E231 missing whitespace after ':'
Line 8:57: W291 trailing whitespace
Line 9:17: E128 continuation line under-indented for visual indent
Line 9:29: E231 missing whitespace after ':'
Line 10:17: E128 continuation line under-indented for visual indent
Line 10:25: E231 missing whitespace after ':'
Line 11:17: E128 continuation line under-indented for visual indent
Line 11:27: E231 missing whitespace after ':'
Line 12:17: E128 continuation line under-indented for visual indent
Line 12:27: E231 missing whitespace after ':'
Line 13:17: E128 continuation line under-indented for visual indent
Line 13:33: E231 missing whitespace after ':'
Line 14:1: W293 blank line contains whitespace
Line 16:1: W293 blank line contains whitespace
Line 17:29: E231 missing whitespace after ','
Line 17:42: E231 missing whitespace after ','
Line 17:55: E231 missing whitespace after ','
Line 17:69: E231 missing whitespace after ','
Line 17:80: E501 line too long (101 > 79 characters)
Line 18:1: W293 blank line contains whitespace
Line 20:1: W293 blank line contains whitespace
Line 21:57: W292 no newline at end of file

Line 8:1: W293 blank line contains whitespace
Line 9:1: W293 blank line contains whitespace
Line 10:5: E303 too many blank lines (2)
Line 12:80: E501 line too long (80 > 79 characters)
Line 13:1: W293 blank line contains whitespace
Line 17:21: E127 continuation line over-indented for visual indent
Line 19:39: E231 missing whitespace after ':'

Line 6:1: W293 blank line contains whitespace
Line 10:29: W291 trailing whitespace
Line 12:1: W293 blank line contains whitespace
Line 15:80: E501 line too long (99 > 79 characters)
Line 16:80: E501 line too long (99 > 79 characters)
Line 17:1: W293 blank line contains whitespace
Line 19:80: E501 line too long (80 > 79 characters)
Line 20:1: W293 blank line contains whitespace
Line 21:1: W293 blank line contains whitespace
Line 22:5: E303 too many blank lines (2)
Line 22:64: E231 missing whitespace after ','
Line 22:72: E225 missing whitespace around operator
Line 23:26: E128 continuation line under-indented for visual indent
Line 23:80: E501 line too long (95 > 79 characters)
Line 24:1: W293 blank line contains whitespace
Line 25:64: E231 missing whitespace after ','
Line 25:72: E225 missing whitespace around operator
Line 26:26: E128 continuation line under-indented for visual indent
Line 26:80: E501 line too long (87 > 79 characters)
Line 27:1: W293 blank line contains whitespace
Line 30:1: W293 blank line contains whitespace
Line 33:1: W293 blank line contains whitespace
Line 34:1: W293 blank line contains whitespace
Line 35:1: W293 blank line contains whitespace
Line 36:1: E303 too many blank lines (3)
Line 36:1: W293 blank line contains whitespace
Line 36:1: W391 blank line at end of file

Line 25:77: W292 no newline at end of file

Line 13:1: E402 module level import not at top of file
Line 76:30: E231 missing whitespace after ','
Line 77:61: E231 missing whitespace after ','
Line 78:1: W293 blank line contains whitespace
Line 80:80: E501 line too long (90 > 79 characters)
Line 81:80: E501 line too long (89 > 79 characters)
Line 83:1: W293 blank line contains whitespace

Line 17:32: E231 missing whitespace after ','
Line 17:43: E231 missing whitespace after ','
Line 18:1: W293 blank line contains whitespace
Line 20:1: W391 blank line at end of file

Line 26:5: E303 too many blank lines (2)
Line 28:1: W293 blank line contains whitespace
Line 30:1: W293 blank line contains whitespace
Line 33:1: W293 blank line contains whitespace
Line 34:80: E501 line too long (81 > 79 characters)
Line 35:1: W293 blank line contains whitespace
Line 36:44: E225 missing whitespace around operator
Line 37:1: W293 blank line contains whitespace
Line 38:59: W292 no newline at end of file

Line 10:80: E501 line too long (94 > 79 characters)

Line 11:48: E225 missing whitespace around operator
Line 12:26: E225 missing whitespace around operator
Line 12:38: E225 missing whitespace around operator
Line 13:26: E225 missing whitespace around operator
Line 13:41: E225 missing whitespace around operator
Line 14:26: E225 missing whitespace around operator
Line 14:41: E225 missing whitespace around operator
Line 15:26: E225 missing whitespace around operator
Line 15:53: E225 missing whitespace around operator
Line 16:26: E225 missing whitespace around operator
Line 16:40: E225 missing whitespace around operator
Line 17:26: E225 missing whitespace around operator
Line 17:41: E225 missing whitespace around operator
Line 18:26: E225 missing whitespace around operator
Line 18:80: E501 line too long (81 > 79 characters)
Line 24:1: W293 blank line contains whitespace
Line 25:47: W292 no newline at end of file

Line 4:80: E501 line too long (98 > 79 characters)
Line 24:1: W293 blank line contains whitespace
Line 25:5: E265 block comment should start with '# '
Line 28:1: W293 blank line contains whitespace
Line 28:1: W391 blank line at end of file

Line 7:1: W293 blank line contains whitespace
Line 8:1: W293 blank line contains whitespace
Line 9:5: E303 too many blank lines (2)
Line 14:1: W293 blank line contains whitespace
Line 16:1: W293 blank line contains whitespace
Line 17:1: W293 blank line contains whitespace
Line 18:5: E303 too many blank lines (2)
Line 20:54: E225 missing whitespace around operator
Line 20:67: E502 the backslash is redundant between brackets
Line 21:141: W292 no newline at end of file

Line 30:25: E127 continuation line over-indented for visual indent
Line 31:25: E127 continuation line over-indented for visual indent
Line 32:25: E127 continuation line over-indented for visual indent
Line 33:25: E127 continuation line over-indented for visual indent
Line 34:25: E124 closing bracket does not match visual indentation
Line 52:1: W293 blank line contains whitespace
Line 54:31: W291 trailing whitespace
Line 55:17: E128 continuation line under-indented for visual indent
Line 55:27: W291 trailing whitespace
Line 56:17: E128 continuation line under-indented for visual indent
Line 57:17: E128 continuation line under-indented for visual indent
Line 57:30: W291 trailing whitespace
Line 58:17: E128 continuation line under-indented for visual indent
Line 59:17: E128 continuation line under-indented for visual indent
Line 59:23: W291 trailing whitespace
Line 60:17: E128 continuation line under-indented for visual indent
Line 61:17: E128 continuation line under-indented for visual indent
Line 63:66: W291 trailing whitespace
Line 64:45: W291 trailing whitespace
Line 70:1: W293 blank line contains whitespace
Line 75:1: W293 blank line contains whitespace
Line 79:1: W293 blank line contains whitespace
Line 80:1: W293 blank line contains whitespace
Line 81:5: E303 too many blank lines (2)
Line 91:80: E501 line too long (80 > 79 characters)
Line 93:49: E225 missing whitespace around operator
Line 93:62: W291 trailing whitespace
Line 94:33: E127 continuation line over-indented for visual indent
Line 94:61: E225 missing whitespace around operator
Line 94:80: E501 line too long (110 > 79 characters)
Line 95:35: E231 missing whitespace after ','
Line 96:35: E231 missing whitespace after ','
Line 100:5: E303 too many blank lines (2)
Line 103:1: W293 blank line contains whitespace
Line 106:1: W293 blank line contains whitespace
Line 113:1: W293 blank line contains whitespace
Line 118:66: W291 trailing whitespace
Line 119:41: E128 continuation line under-indented for visual indent
Line 119:65: W291 trailing whitespace
Line 120:41: E128 continuation line under-indented for visual indent
Line 121:44: W291 trailing whitespace
Line 125:1: W293 blank line contains whitespace
Line 129:1: W293 blank line contains whitespace
Line 130:55: E231 missing whitespace after ':'
Line 131:1: W293 blank line contains whitespace
Line 132:55: E231 missing whitespace after ':'
Line 133:1: W293 blank line contains whitespace
Line 136:1: W293 blank line contains whitespace
Line 139:1: W293 blank line contains whitespace
Line 142:1: W293 blank line contains whitespace
Line 142:1: W391 blank line at end of file

Line 7:26: E231 missing whitespace after ':'
Line 7:80: E501 line too long (84 > 79 characters)
Line 8:13: E231 missing whitespace after ':'
Line 9:21: E231 missing whitespace after ':'
Line 10:14: E231 missing whitespace after ':'
Line 11:28: E231 missing whitespace after ':'
Line 11:80: E501 line too long (97 > 79 characters)
Line 12:24: E231 missing whitespace after ':'
Line 12:80: E501 line too long (81 > 79 characters)
Line 13:1: W293 blank line contains whitespace
Line 17:1: W293 blank line contains whitespace
Line 19:1: W293 blank line contains whitespace
Line 23:1: W293 blank line contains whitespace
Line 26:1: W293 blank line contains whitespace
Line 28:1: W293 blank line contains whitespace
Line 28:1: W391 blank line at end of file

Line 118:80: E501 line too long (93 > 79 characters)
Line 161:80: E501 line too long (82 > 79 characters)

Comment last updated at 2024-09-20 14:17:12 UTC

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ssattler ssattler Awaiting requested review from ssattler

At least 1 approving review is required to merge this pull request.

Assignees

@samgdotson samgdotson

Labels
enhancement New feature or request
Projects
None yet
Milestone
First model runs completed
2 participants
@samgdotson @pep8speaks