Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Syncing to latest updates. #1

Merged
merged 121 commits into from
Feb 4, 2020
Merged

Syncing to latest updates. #1

merged 121 commits into from
Feb 4, 2020

Conversation

JRHutson
Copy link
Owner

@JRHutson JRHutson commented Feb 4, 2020

No description provided.

ryanmswan and others added 30 commits December 9, 2019 19:22
Bring up to date with Dev
Bring up to date with master
--sqlIngest:DataHandler now has dumpCsvFile method
--returns string buffer object for download
Added CSV stream to sqlIngest.py
added dataAnalysis onboarding document draft
Added first iteration of onboarding script, does not auto-install
Reporting endpoint for biggest offenders
--Amended docker onboarding information
--Grammar corrections
further updates to onboarding doc
…eter of the DataHandler().dumpCsvFile method
…; querying for json results successful; also joined ../ to filepath in DataHandler.loadData method
…pt utils.py as it's referenced by other files
sellnat77 and others added 29 commits January 19, 2020 12:23
Updated webpack to support the CD scripts
Added sodapy to requirements.txt
Making sure CI runs on all PRs
Update master with latest version of dev
Bring dev up to date with upstream
Sanity checked all existing functionality

Trying to add postgres utils to action

Trying standalone installer

Switching to on_push for testing

Switching to on_push for testing

Eureka, libpq on linux will fix the backend build
Added linting and correctly implemented the backend github action
No Flake errors/warnings allowed
--orm configuration files now in databaseOrm.py package
--updateDatabase method of DataHandler now allows partial updates of records in database
  --runs roughly 90 seconds per 1000 records
  --around 5000 new records can be expected per day
--fixed fetchSocrata method of DataHandler to correctly grab number of records specified in querySize parameter
Bringing up to date with main repo
--documented updateDatabase method
--added a couple syntax/linting fixes to sqlIngest file
added changed in local fork to feature modules
Added partial update capability to sqlIngest
Updating master with lastest dev
@JRHutson JRHutson merged commit c61acd8 into JRHutson:master Feb 4, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants