Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TRAPI 1.4 validation error: gain / loss of function qualifiers for Gene -> Disease #699

Closed
colleenXu opened this issue Aug 17, 2023 · 4 comments
Labels
external Requires fixes to an external service On Test Related changes are deployed to Test server trapi 1.4

Comments

@colleenXu
Copy link
Collaborator

colleenXu commented Aug 17, 2023

I was doing a quick performance review of the new BTE "treats" templates, and I used my notebook to run TRAPI validation on some responses (attached below):

For all 4 of these responses, the reasoner-validator raises the error: error.knowledge_graph.edge.qualifiers.qualifier.value.unresolved. Note that "errors" are "orange" in the ARAX UI, vs the red for "critical" errors.

This occurs on KG Edges from Text-Mining Targeted like these:

  • (subject_form_or_variant_qualifier: loss_of_function_variant_form) Gene -> affects -> Disease
  • (subject_form_or_variant_qualifier: gain_of_function_variant_form) Gene -> affects -> Disease

Example error code and object from my notebook (python):

error.knowledge_graph.edge.qualifiers.qualifier.value.unresolved

{'infores:text-mining-provider-targeted -> infores:biothings-explorer': {'gain_of_function_variant_form': [{'edge_id': 'NCBIGene:775[biolink:Gene]--biolink:affects->MONDO:0010979[biolink:Disease]',
    'qualifier_type_id': 'biolink:subject_form_or_variant_qualifier'},
   {'edge_id': 'NCBIGene:6330[biolink:Gene]--biolink:affects->MONDO:0010979[biolink:Disease]',
    'qualifier_type_id': 'biolink:subject_form_or_variant_qualifier'},
   {'edge_id': 'NCBIGene:857[biolink:Gene]--biolink:affects->MONDO:0010979[biolink:Disease]',
    'qualifier_type_id': 'biolink:subject_form_or_variant_qualifier'}]}}

As far as I can tell, this error has to do with the reasoner-validator and data-modeling (biolink-model + text-mining KP).

Reasoner-validator may depend on biolink-model having an association object that matches these Edges AND sets the values for its "subject form or variant qualifier".

@colleenXu colleenXu added this to the 2023-08-18 Code Freeze milestone Aug 17, 2023
@colleenXu
Copy link
Collaborator Author

colleenXu commented Aug 17, 2023

@tokebe @andrewsu

These edges are occurring because of the templates intended to make the directionality of m4-Chem-Gene-DoP.json more specific.

What do you think we should do?

  • I'd prefer to keep these templates, since users have been asking for info like this for a long time. However, I'm not sure if this TRAPI validation error is a hint of any issues downstream...
  • I think this should be brought up with Text-Mining Provider and that they should take the lead on data-modeling / reasoner-validator discussions.

@colleenXu colleenXu added external Requires fixes to an external service trapi 1.4 labels Aug 17, 2023
@andrewsu
Copy link
Member

Based on the discussion in this slack thread, we should undo our roll out of templates that take advantage of "directionality" in Gene/Variant -> Disease edges. Unfortunately, it's just not ready from a data modeling perspective...

@colleenXu colleenXu added On CI Related changes are deployed to CI server On Test Related changes are deployed to Test server and removed On CI Related changes are deployed to CI server labels Aug 17, 2023
@colleenXu
Copy link
Collaborator Author

colleenXu commented Aug 17, 2023

We decided to remove the two templates with "more specific directionality with qualifiers" from the "treats" template group, because of TRAPI validation / data-modeling concerns. This leaves us w/ 3 templates.

I confirmed that removal of the templates addresses this issue. When all 4 of the example diseases were reran, their responses didn't trigger any validation errors.

Example: rerun timothy syndrome response: new_timothy.txt


Done editing the linked comment. No TRAPI errors (critical or normal) encountered at all!

@tokebe
Copy link
Member

tokebe commented Aug 23, 2023

Closing this one as complete -- future tracking of the potential change that was rolled back can be done from #704

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
external Requires fixes to an external service On Test Related changes are deployed to Test server trapi 1.4
Projects
None yet
Development

No branches or pull requests

3 participants