Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Postgres #187

Merged
merged 81 commits into from
Aug 24, 2016
Merged

Postgres #187

merged 81 commits into from
Aug 24, 2016

Commits on Jul 3, 2016

  1. beginning to set up infrastructure for postgres

    @bkatiemills
    bkatiemills committed Jul 3, 2016
    Configuration menu
    Copy the full SHA
    2e2e525 View commit details
    Browse the repository at this point in the history

  2. dockerfile support for postgres infrastructure

    @bkatiemills
    bkatiemills committed Jul 3, 2016
    Configuration menu
    Copy the full SHA
    be7f4d0 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2016

  1. parallel experiments

    @bkatiemills
    bkatiemills committed Jul 4, 2016
    Configuration menu
    Copy the full SHA
    d6d0e8b View commit details
    Browse the repository at this point in the history

  2. tentative new parallelization scheme

    @bkatiemills
    bkatiemills committed Jul 4, 2016
    Configuration menu
    Copy the full SHA
    64a0e4b View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2016

  1. added truth, variable table name to postgres db builder; start postgr… 

    …es automatically on container launch
    @bkatiemills
    bkatiemills committed Jul 5, 2016
    Configuration menu
    Copy the full SHA
    db12571 View commit details
    Browse the repository at this point in the history

  2. corrections to previous

    @bkatiemills
    bkatiemills committed Jul 5, 2016
    Configuration menu
    Copy the full SHA
    47282bb View commit details
    Browse the repository at this point in the history

  3. incremental process to async postgres row processing

    @bkatiemills
    bkatiemills committed Jul 5, 2016
    Configuration menu
    Copy the full SHA
    24976b2 View commit details
    Browse the repository at this point in the history

  4. remove a couple of hacks

    @bkatiemills
    bkatiemills committed Jul 5, 2016
    Configuration menu
    Copy the full SHA
    80c6c98 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2016

  1. moving towards full testing

    @bkatiemills
    bkatiemills committed Jul 12, 2016
    Configuration menu
    Copy the full SHA
    ce4d0a7 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2016

  1. fixed loop over postgres rows

    @bkatiemills
    bkatiemills committed Jul 13, 2016
    Configuration menu
    Copy the full SHA
    e8213cd View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2016

  1. began building summary from postgres table

    @bkatiemills
    bkatiemills committed Jul 14, 2016
    Configuration menu
    Copy the full SHA
    06bc390 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2016

  1. rethinking on-the-fly data presence checking for new db backend

    @bkatiemills
    bkatiemills committed Jul 21, 2016
    Configuration menu
    Copy the full SHA
    d90aa64 View commit details
    Browse the repository at this point in the history

  2. fix for csiro short gradient divide by 0 problems

    @bkatiemills
    bkatiemills committed Jul 21, 2016
    Configuration menu
    Copy the full SHA
    063e440 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2016

  1. began translating argo tests

    @bkatiemills
    bkatiemills committed Jul 22, 2016
    Configuration menu
    Copy the full SHA
    1bb1168 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2016

  1. trying full profile in db

    root committed Jul 30, 2016
    Configuration menu
    Copy the full SHA
    487f709 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2016

  1. continuing to implement and validate full-profile db

    @bkatiemills
    bkatiemills committed Jul 31, 2016
    Configuration menu
    Copy the full SHA
    bc51dd2 View commit details
    Browse the repository at this point in the history

  2. continuing to implement and validate full-profile db

    @bkatiemills
    bkatiemills committed Jul 31, 2016
    Configuration menu
    Copy the full SHA
    f62fbdc View commit details
    Browse the repository at this point in the history

  3. nominally functioning database backend

    @bkatiemills
    bkatiemills committed Jul 31, 2016
    Configuration menu
    Copy the full SHA
    f2409dd View commit details
    Browse the repository at this point in the history

  4. cleanups to new database method before final debug & validation

    @bkatiemills
    bkatiemills committed Jul 31, 2016
    Configuration menu
    Copy the full SHA
    e3494e7 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2016

  1. Added functionality to use sqlite database plus tidied up setting tab… 

    …le name, added usage instructions.
    @s-good
    s-good authored and root committed Aug 2, 2016
    Configuration menu
    Copy the full SHA
    0f68b97 View commit details
    Browse the repository at this point in the history

  2. Version with EN std level check and tests working with the database.

    @s-good
    s-good authored and root committed Aug 2, 2016
    Configuration menu
    Copy the full SHA
    a55665e View commit details
    Browse the repository at this point in the history

  3. Catch problem with missing data when creating the database.

    @s-good
    s-good authored and root committed Aug 2, 2016
    Configuration menu
    Copy the full SHA
    243b229 View commit details
    Browse the repository at this point in the history

  4. consolidating standard level updates

    @bkatiemills
    bkatiemills committed Aug 2, 2016
    Configuration menu
    Copy the full SHA
    425fa45 View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2016

  1. nominal port of track check to database backend

    @bkatiemills
    bkatiemills committed Aug 3, 2016
    Configuration menu
    Copy the full SHA
    42ba1dc View commit details
    Browse the repository at this point in the history

  2. all tests running quickly under new database scheme

    @bkatiemills
    bkatiemills committed Aug 3, 2016
    Configuration menu
    Copy the full SHA
    65c4375 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2016

  1. order of operations fix for ICDC-9

    @bkatiemills
    bkatiemills committed Aug 4, 2016
    Configuration menu
    Copy the full SHA
    b692082 View commit details
    Browse the repository at this point in the history

  2. remove redundant unpacking from en_track

    @bkatiemills
    bkatiemills committed Aug 4, 2016
    Configuration menu
    Copy the full SHA
    da9967f View commit details
    Browse the repository at this point in the history

  3. suppress en_track integration testing until dummy wod ascii generatio… 

    …n is available
    @bkatiemills
    bkatiemills committed Aug 4, 2016
    Configuration menu
    Copy the full SHA
    95d190a View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2016

  1. moved loose location test back to original location

    @bkatiemills
    bkatiemills committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    5d6a9c4 View commit details
    Browse the repository at this point in the history

  2. Update cotede_test.py to handle pre-1900 profiles 

    woa_normbias can't handle pre-1900 profiles because it uses datetime.datetime.strftime which fails if given a date before 1900. Profiles from before 1900 are set to have year=1900. This should not have an impact on QC results but will prevent an error.
    @s-good
    s-good authored Aug 5, 2016
    Configuration menu
    Copy the full SHA
    75fc2eb View commit details
    Browse the repository at this point in the history

  3. beginning to set up infrastructure for postgres

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    4b82f3e View commit details
    Browse the repository at this point in the history

  4. dockerfile support for postgres infrastructure

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    13d0ca1 View commit details
    Browse the repository at this point in the history

  5. parallel experiments

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    be9b27f View commit details
    Browse the repository at this point in the history

  6. tentative new parallelization scheme

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    5a8ac19 View commit details
    Browse the repository at this point in the history

  7. added truth, variable table name to postgres db builder; start postgr… 

    …es automatically on container launch
    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    0a1a4ee View commit details
    Browse the repository at this point in the history

  8. corrections to previous

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    1eb8077 View commit details
    Browse the repository at this point in the history

  9. incremental process to async postgres row processing

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    5277e6f View commit details
    Browse the repository at this point in the history

  10. remove a couple of hacks

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    2d150e4 View commit details
    Browse the repository at this point in the history

  11. moving towards full testing

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    a38e4dd View commit details
    Browse the repository at this point in the history

  12. fixed loop over postgres rows

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    14cbbae View commit details
    Browse the repository at this point in the history

  13. began building summary from postgres table

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    3733375 View commit details
    Browse the repository at this point in the history

  14. rethinking on-the-fly data presence checking for new db backend

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    e6f8c82 View commit details
    Browse the repository at this point in the history

  15. fix for csiro short gradient divide by 0 problems

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    ebee3da View commit details
    Browse the repository at this point in the history

  16. began translating argo tests

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    ecef132 View commit details
    Browse the repository at this point in the history

  17. trying full profile in db

    root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    e68dfaa View commit details
    Browse the repository at this point in the history

  18. continuing to implement and validate full-profile db

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    0766ea3 View commit details
    Browse the repository at this point in the history

  19. continuing to implement and validate full-profile db

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    7f02a9f View commit details
    Browse the repository at this point in the history

  20. nominally functioning database backend

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    83fec0a View commit details
    Browse the repository at this point in the history

  21. cleanups to new database method before final debug & validation

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    461eae8 View commit details
    Browse the repository at this point in the history

  22. Added functionality to use sqlite database plus tidied up setting tab… 

    …le name, added usage instructions.
    @s-good
    s-good authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    59d60b3 View commit details
    Browse the repository at this point in the history

  23. Version with EN std level check and tests working with the database.

    @s-good
    s-good authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    e2f883e View commit details
    Browse the repository at this point in the history

  24. Catch problem with missing data when creating the database.

    @s-good
    s-good authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    8161d7e View commit details
    Browse the repository at this point in the history

  25. consolidating standard level updates

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    374b94d View commit details
    Browse the repository at this point in the history

  26. nominal port of track check to database backend

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    25264ce View commit details
    Browse the repository at this point in the history

  27. all tests running quickly under new database scheme

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    d96f542 View commit details
    Browse the repository at this point in the history

  28. order of operations fix for ICDC-9

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    9bb5b69 View commit details
    Browse the repository at this point in the history

  29. remove redundant unpacking from en_track

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    94444b9 View commit details
    Browse the repository at this point in the history

  30. suppress en_track integration testing until dummy wod ascii generatio… 

    …n is available
    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    5a4ca7c View commit details
    Browse the repository at this point in the history

  31. moved loose location test back to original location

    @bkatiemills
    bkatiemills authored and root committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    7881e68 View commit details
    Browse the repository at this point in the history

  32. postgres and master mostly matching

    @bkatiemills
    bkatiemills committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    847a3c7 View commit details
    Browse the repository at this point in the history

  33. fix conflicts

    @bkatiemills
    bkatiemills committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    da497fb View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2016

  1. attempting en_track speedup

    @bkatiemills
    bkatiemills committed Aug 7, 2016
    Configuration menu
    Copy the full SHA
    1a5e864 View commit details
    Browse the repository at this point in the history

  2. skip en_track for profiles already done

    @bkatiemills
    bkatiemills committed Aug 7, 2016
    Configuration menu
    Copy the full SHA
    a81f669 View commit details
    Browse the repository at this point in the history

  3. cleanup

    @bkatiemills
    bkatiemills committed Aug 7, 2016
    Configuration menu
    Copy the full SHA
    49f5240 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2016

  1. corrections to en_track

    @bkatiemills
    bkatiemills committed Aug 10, 2016
    Configuration menu
    Copy the full SHA
    620ff07 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2016

  1. fiddling with EN_track

    @bkatiemills
    bkatiemills committed Aug 11, 2016
    Configuration menu
    Copy the full SHA
    9bacbee View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2016

  1. implement global parameter store upstream of parallelization

    @bkatiemills
    bkatiemills committed Aug 12, 2016
    Configuration menu
    Copy the full SHA
    ac59201 View commit details
    Browse the repository at this point in the history

  2. icdc-9 working as expected

    @bkatiemills
    bkatiemills committed Aug 12, 2016
    Configuration menu
    Copy the full SHA
    495bcc4 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2016

  1. un-broke all the tests that recent changes broke

    @bkatiemills
    bkatiemills committed Aug 13, 2016
    Configuration menu
    Copy the full SHA
    5d78a98 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2016

  1. docs update

    @bkatiemills
    bkatiemills committed Aug 14, 2016
    Configuration menu
    Copy the full SHA
    69135df View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2016

  1. remove unneccessary parameter slices from ICDC-9

    Bill Mills committed Aug 15, 2016
    Configuration menu
    Copy the full SHA
    cd480a4 View commit details
    Browse the repository at this point in the history

  2. speeds up ICDC-9, validates correctly

    @bkatiemills
    bkatiemills committed Aug 15, 2016
    Configuration menu
    Copy the full SHA
    60534ca View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2016

  1. Updated expected QC for CoTeDe anomaly detection test.

    @s-good
    s-good committed Aug 16, 2016
    Configuration menu
    Copy the full SHA
    93a3eeb View commit details
    Browse the repository at this point in the history

  2. Updated expected QC results for CoTeDe WOA norm bias test.

    @s-good
    s-good committed Aug 16, 2016
    Configuration menu
    Copy the full SHA
    e02f9a0 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #183 from IQuOD/Pre-1900-profiles---fix-in-CoTeDe-… 

    …check

Update cotede_test.py to handle pre-1900 profiles
    @bkatiemills
    bkatiemills authored Aug 16, 2016
    Configuration menu
    Copy the full SHA
    870c749 View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2016

  1. fix en_track bug

    @bkatiemills
    bkatiemills committed Aug 18, 2016
    Configuration menu
    Copy the full SHA
    ae8401f View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2016

  1. address en_track memory issue

    @bkatiemills
    bkatiemills committed Aug 19, 2016
    Configuration menu
    Copy the full SHA
    946eff6 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2016

  1. en_track consumes database columns instead of raw profile text

    @bkatiemills
    bkatiemills committed Aug 20, 2016
    Configuration menu
    Copy the full SHA
    7ef6fa4 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2016

  1. cleanup

    @bkatiemills
    bkatiemills committed Aug 23, 2016
    Configuration menu
    Copy the full SHA
    dbe4243 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2016

  1. update recommended docker run command to not delete container on exit… 

    …, in case of connection loss
    @bkatiemills
    bkatiemills committed Aug 24, 2016
    Configuration menu
    Copy the full SHA
    9ff0e98 View commit details
    Browse the repository at this point in the history

  2. docs update

    @bkatiemills
    bkatiemills committed Aug 24, 2016
    Configuration menu
    Copy the full SHA
    30d47e1 View commit details
    Browse the repository at this point in the history