Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create Transformer to combine coordinates from different experiments in the same studies #728

Open
1 task
tsalo opened this issue Jul 22, 2022 · 1 comment
Assignees
Labels
cbma Issues/PRs pertaining to coordinate-based meta-analysis diagnostics Issues/PRs related to the diagnostics module. enhancement New feature or request

Comments

@tsalo
Copy link
Member

tsalo commented Jul 22, 2022

Summary

Per Turkeltaub et al. (2012), treating separate experiments from the same subject group as independent introduces bias. We haven't really tackled this problem in NiMARE, because we don't have any identifier for individual subject groups. However, what we do have are study and experiment IDs. Different experiments from the same study can easily be (1) from different subject groups or (2) from incompatible contrasts, so I don't think it's a good idea to automatically merge these coordinates within, say, the ALE Estimator.

What I am proposing is a new Transformer, that would identify any studies with multiple experiments in a Dataset, and merge them into a single experiment (if they have matching metadata, such as sample size). Users would then have to elect to do this prior to their meta-analysis.

Additional details

This would reduce the influence of studies with multiple experiments on coordinate-based meta-analyses.

Next steps

  1. Create a new Transformer, perhaps in nimare.diagnostics.
  2. Identify any crucial metadata for differentiating subject groups in a study. The only thing that comes to mind at the moment is sample size, but there may be other relevant info.
  3. Add information about the Transformer to the documentation (e.g., an example).

Open questions

  • I'm not sure what to do with other fields, like texts, annotations, and images.
@tsalo tsalo added enhancement New feature or request cbma Issues/PRs pertaining to coordinate-based meta-analysis labels Jul 22, 2022
@tsalo
Copy link
Member Author

tsalo commented Jul 22, 2022

One minor thing- I believe that Sleuth automatically combines experiments within studies, so Sleuth users wouldn't have to worry about this. It would mostly impact folks using NIMADS-based Datasets.

@tsalo tsalo added the diagnostics Issues/PRs related to the diagnostics module. label Jul 24, 2022
@JulioAPeraza JulioAPeraza self-assigned this May 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cbma Issues/PRs pertaining to coordinate-based meta-analysis diagnostics Issues/PRs related to the diagnostics module. enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants