We are delighted to announce the official launch of the EEGManyPipelines project! This project is inspired by other recent projects involving many independent analysis teams to investigate how different analysts approach a given data set and how analysis approaches affect the obtained results (e.g., 12). The aim of this project is to extend this novel initiative to EEG research. We believe this to be particularly important in the case of EEG data, as compared to other neuroimaging research, analysis pipelines are less standardized3 and have more degrees of freedom. EEG is the most widespread tool in human neuroscience research with significant impact on research in all fields of psychology and cognitive neuroscience, which, we believe, makes the EEGManyPipelines project a timely and crucial endeavor that we hope will benefit a large part of the cognitive neuroscience community.
Participants in this project will get access to an EEG dataset and are invited to analyze the data with an analysis pipeline they deem sensible and representative of their own research. Participants will then report their results and a detailed description of the analysis pipeline back to us. We will use these reports to map the diversity of analysis pipelines and the effect of pipeline parameters on obtained results.
Position_paper
: Summary figures of demographics and representiveness of the analysts participating in the EEGManyPipelines project. Used in the poistion paper (Trübutschek et al., 2022).
- Trübutschek, D., Yang, Y.-F., Gianelli, C., Cesnaite, E., Fischer, N. L., Vinding, M. C., Marshall, T. R., Algermissen, J., Pascarella, A., Puoliväli, T., Vitale, A., Busch, N. A., & Nilsonne, G. (2023). EEGManyPipelines: A Large-scale, Grassroot Multi-analyst Study of EEG Analysis Practices in the Wild. Journal of Cognitive Neuroscience, 36, 217–224. https://doi.org/10.1162/jocn_a_02087
- Algermissen, J., Busch, N., Cesnaite, E., Fischer, N., Gianelli, C., Koen, J., Marshall, T., Navid, M. S., Nilsonne, G., Pascarella, A., Puoliväli, T., Senoussi, M., Trubutschek, D., Vinding, M. C., Vitale, A., Yang, Y.-F., & Yeaton, J. (2022). EEGManyPipelines: Robustness of EEG results across analysis pipelines. Open Science Framework. https://doi.org/10.17605/OSF.IO/42K5H
For more information about the steering comittee and people involved in the project, please visit our offical website: http://eegmanypipelines.org
For questions or comments, please write email to [email protected].
Follow EEGManyPipelines on Twitter @EegManyPipes and Mastodon neuromatch.social/@EEGManyPipes.
The project is supported by research grants from the German Research Foundation (DFG) and the DFG priority program "META-REP: A Meta-scientific Programme to Analyse and Optimise Replicability in the Behavioural, Social, and Cognitive Sciences" to Niko Busch and a research grant from Riksbankens Jubileumsfond to Gustav Nilsonne.
Footnotes
-
Botvinik-Nezer R, Holzmeister F, ..., Schonerg T (2020). Variability in the analysis of a single neuroimaging dataset by many teams. Nature 582:84–88. ↩
-
Silberzahn R, Uhlmann EL, ..., Nosek BA (2018). Many analysts, one dataset: making transparent how variations in analytic choices affect results. Advances in Methods and Practices in Psychological Science 1(3):337–356. ↩
-
Cohen, MX (2017). [Rigor and replication in time-frequency analyses of cognitive electrophysiology data.(https://www.sciencedirect.com/science/article/abs/pii/S0167876016300095) International Journal of Psychophysiology 111:80–87. ↩