Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

increase confidence on results by adding statistical tests on different class partitions #34

Open
oreparaz opened this issue Jan 15, 2024 · 0 comments

Comments

@oreparaz
Copy link
Owner

oreparaz commented Jan 15, 2024

We could do some sanity checks to make sure we're not catching (statistical) ghosts:

  • statistical test on a random partition of one group (all corresponding to the same input). should not yield any statistical difference
  • idem, for the second group
  • idem, for a random partition of the set of all traces.

These tests should all return "no leakage detected". I'd say this isn't super high priority, please check-in here before if you're interested in working on this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant