Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DP Powerset Test and Pytest stochastic tests #71

Merged
merged 16 commits into from
Jan 12, 2020

Conversation

ankit-oss
Copy link
Contributor

@ankit-oss ankit-oss commented Jan 10, 2020

Currently, DP Predicate test ran by removing a random record. In this PR, we implement the loop above DP predicate test that generates 12 neighbor pairs by exhaustively doing DFS on database search graph of size 3 i.e. 3 records in database.

Powerset currently runs for 1 database of size 3. In next check-in, we shall run it for many such databases of size 3 diversely generated via Halton sequences.

We uncovered some issues while running this test -

  1. NULL values returned by SDK intermittently on a dataset of size 3
  2. SUM or COUNT querying not supported on empty dataset

We workaround first issue by filling null values with previous noisy response or actual value if previous noisy non-null response does not exist.
We workaround second issue by not running the powertest on empty databases

Jupyter notebook has the results of the DP predicate test applied on the powerset.

@ankit-oss ankit-oss changed the title DP Powerset Test DP Powerset Test and Pytest stochastic tests Jan 12, 2020
@joshua-oss
Copy link
Contributor

FYI, this appears to be a PR from your personal GitHub to your feature branch in burdock. I am approving everything in this PR, since it will go into your feature branch. Then I will pull down the feature branch and test.

@joshua-oss joshua-oss merged commit d00044c into opendp:powerset_test Jan 12, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants