Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fully semantically valid biolink 3.5.0 + TRAPI 1.4.0 from all actors #379

Closed
3 of 18 tasks
sierra-moxon opened this issue Jun 30, 2023 · 10 comments
Closed
3 of 18 tasks
Labels
bug Something isn't working

Comments

@sierra-moxon
Copy link
Member

sierra-moxon commented Jun 30, 2023

Check each of these off when the validation is passing (for example, this test shows an arax interface with red x's that show validation issues ) for your resource.

  • Expander
  • Exploring
  • imProve
  • Ranking
  • Unsecret
  • Clinical Data Svcs
  • Connection Hypo
  • Exposures (ICEES KG)
  • Exposures (CAM)
  • Genetics
  • MolePro
  • Multiomics
  • Service
  • RTX-KG2
  • Text Mining / Service
  • Text Mining Cooccurrence
  • MediKanren graph
  • SPOKE
@codewarrior2000
Copy link

codewarrior2000 commented Jul 5, 2023

What is the implication of checking off for "Fully semantically valid biolink 3.5.0 + TRAPI 1.4.0 from all actors"?
Do we just check off if that given example has no red X for our actor?
Or is there a set of standard tests on ARAX that we should be running before we can check off for our actor?
Should we be continuously testing and then uncheck our actor if, at a later time, validation doesn't pass?

@edeutsch
Copy link

edeutsch commented Jul 6, 2023

I have updated the ARAX GUI to use version 3.6.5 of the TRAPI validator and Biolink 3.5.0. Therefore all displayed validation is against our target.

There is now also a distinction between critical errors (red X) and ordinary errors (orange !)
image

Perhaps this is useful for reaching our goals.
https://arax.ci.transltr.io/?r=704b6fac-c47c-420e-b6e5-8be46ea9bf35

@colleenXu
Copy link

colleenXu commented Jul 24, 2023

I think the Exploring / Service team tools (BTE / Service Provider TRAPI) have almost reached this goal.

The current (as-of late last Friday) orange errors + warnings are being addressed with changes to other tools:

So...we may not show up as "passing validation" until these changes are fully deployed. I'm not sure of everything that's involved in this deployment (biolink-model release? -> reasoner-validator / biolink-model toolkit updates? -> ARAX UI update? and maybe BTE/Service Provider tools need to update which biolink-model version they advertise using?)

@sierra-moxon
Copy link
Member Author

We will need a BMT release as well. I’d like to see if there are more attributes that need to be added to the model (as people go through the validation warnings) before doing that. For example, will a property for “semmed novelty score” need to be added?

@andrewsu
Copy link

will a property for “semmed novelty score” need to be added?

I do not think this is necessary -- I think the plan is to do filtering at ETL/query time, rather than passing this info back to the user.

@colleenXu
Copy link

colleenXu commented Aug 10, 2023

Going to check us off as "done", since we show up with a "green check" in ARAX CI - which is using reasoner-validator 3.8.0 configured to validate against Biolink model 3.5.3 (but may have TRAPI validation warnings sometimes), based on two quick checks.

Regarding Multiomics + Text-Mining KPs that go through Service Provider @gglusman @edgargaticaCU, careful testing of the TRAPI responses for your KP should allow to see if your edge-attributes / sources info (which may be different for different x-bte operations / data) passes TRAPI validation. If you feel confident that all your KPs pass, then you can check it off.

@codewarrior2000
Copy link

codewarrior2000 commented Aug 11, 2023

All righty!
On August 11, 2023 at 1145 EDT, MolePro is also now showing green status in the ARAX GUI (the latest validator version 3.8.0 configured to validate against Biolink model 3.5.3 )
image

@sstemann
Copy link

sstemann commented Apr 8, 2024

@sierra-moxon what say you on this? are we still working on it?

@codewarrior2000
Copy link

@sierra-moxon and @sstemann
For what it's worth:

  1. This Issue's test criterion (https://arax.test.transltr.io/?r=e4420d32-65c1-4b43-9cb9-ff55564978e9) no longer provides results to validate for biolink 3.5.0 + TRAPI 1.4.0.
  2. Translator is moving to TRAPI 1.5.0.

Therefore, it seems that this Issue serves no more purpose.

@gglusman gglusman removed their assignment Jul 12, 2024
@sstemann
Copy link

sstemann commented Aug 7, 2024

agree with @codewarrior2000

@sstemann sstemann closed this as completed Aug 7, 2024
@sstemann sstemann removed this from the D: Fall - 2023 milestone Aug 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests