-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add test vector for select credentials #74
Conversation
@nitro-neal what's the rationale behind the renaming? |
We decided on underscores everywhere to create the function naming easier across languages We wanted to add Web5TestVectors to the class name for knowing which tests are SPEC vc normal unit test Example: in Web5-SDK-Development: in JS => Web5TestVectorsPresentationExchangeSpec.select_credentials |
gotcha. is this something we're trying out to see if it works or something we've decided to commit to? if the latter, can we document the rationale and instructions others should follow? |
Yup was an initial decision, not 100% in love with it. Once we all check off on the naming convention we will definitely add to documentation / readme |
I just want to clarify a little bit about how we intend on using these test vectors: I'm currently under the impression that we should be comparing the output defined within the test vectors as the source of truth. In the PR description, you have the following line doing the expectation:
Would this be comparing against the actual strings that are present in the test vector output? Or would this be comparing against the representation of the JWTs against their language's representation of them? |
can you provide a bit more context here? trying to understand how all of the PRs related to a test harness prototype spread across 3 repos intend to come together. it's hard to see right now. would appreciate a write-up of what y'all have in mind! It's difficult to provide actual feedback for something we intend to land in
based on the limited amount i understand right now, instinctively feel like expecting all languages to have the exact same function names is a bit rigid but again, not sure what you mean here by "function naming" |
Yup happy to create a full fledged README / documentation for this. Here is the tdlr of what it would be for you understanding. Step 1. the class name for the unit test in Web5-JS and Web5-KT algorithm goes as follows
which equals the class name - Web5TestVectorsPresentationExchangeTest we do this so that the golang test runner can easily find all the test it cares about by grepping the prefix - Step 2.
Step 3.
|
thanks for all of the info @nitro-neal! question for you: what is the "go test runner". do we have something that's running the actual tests? |
Web5-JS and Web5-KT run the tests locally and then use a local github action to upload the .xml files to their local repos as an artifact. The Web5-SDK-Development has a github action that runs when web5-kt or web5-js merge to main This Web5-SDK-Development github action will download and parse the xml artifact, and create the checkmark report I guess by go runner I mean the Web5-SDK-Development code that downloads and parses children xml files |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the extra details in comments - will be great to see the documented e2e and iterate on the process.
Will look something like this: