Guide to choosing an FMRI dataset

July 5-23, 2021

HCP task datasets

The HCP task datasets (youtube-2021, youtube-2020) are a great overall choice, because many of the behaviors are interesting (gambling, emotion, language, social, working memory etc), and the data is already preprocessed and averaged across voxels to make brain regions. This dataset is appropriate for all levels.

Credit for data curation: John Murray, Saad Jbabdi

Run

View

HCP 2021 + behavior

Open In Colab

View the notebook

HCP 2021

Open In Colab

View the notebook

HCP 2020

Open In Colab

View the notebook

References:

  • Barch, D. M., Burgess, G. C., Harms, M. P., Petersen, S. E., Schlaggar, B. L., Corbetta, M., … and Van Essen, D. C. (2013). Function in the human connectome: task-fMRI and individual differences in behavior. Neuroimage, 80: 169-189. doi: 10.1016/j.neuroimage.2013.05.033

FSL course task

The FSL course task dataset (youtube) complements the HCP one, with two additional language tasks. These data are brainwide and at the voxel level.

Credit for data curation: Saad Jbabdi

Run

View

FSL course task

Open In Colab

View the notebook

References:

none, this dataset only has one subject per task and was never used in a paper, just was used in another summer course

HCP retinotopy

HCP retinotopy (youtube) is a specific kind of project that can be used to do population receptive field modelling. This might be interesting to ML-savy groups because it doesn’t require a lot of neuroscience or FMRI background, and one can visualize the hierarchy of brain areas and their responses.

Credit for data curation: Saad Jbabdi

Run

View

HCP retinotopy

Open In Colab

View the notebook

References:

  • Benson, N. C., Jamison, K. W., Arcaro, M. J., Vu, A. T., Glasser, M. F., Coalson, T. S., … and Kay, K. (2018). The Human Connectome Project 7 Tesla retinotopy dataset: Description and population receptive field analysis. Journal of vision, 18(13), 23. doi: 10.1167/18.13.23

Kay natural images

Credit for data curation: Michael Waskom, Marius Pachitariu

The Kay dataset (youtube) of visual responses to natural images is intermediate, as it has many voxels in V1/V2/V3/V4 and many images annotated with object label information.

Run

View

Kay natural images

Open In Colab

View the notebook

References:

  • Kay, K. N., Naselaris, T., Prenger, R. J., and Gallant, J. L. (2008). Identifying natural images from human brain activity. Nature, 452(7185): 352-355. doi: 10.1038/nature06713

  • Naselaris, T., Prenger, R. J., Kay, K. N., Oliver, M., and Gallant, J. L. (2009). Bayesian reconstruction of natural images from human brain activity. Neuron, 63(6): 902-915. doi: 10.1016/j.neuron.2009.09.006

Bonner/Algonauts/Cichy

Bonner (youtube) / Cichy (youtube) / Algonauts (youtube) are the most advanced datasets which can be used to do representational (di)similarity analyses on visual response data (static images, videos, or navigation-related images). Specifically designed to go with the two project templates comparing FMRI responses to deep neural networks.

Credit for data curation: Kshitij Dwivedi

Run

View

Bonner navigation

Open In Colab

View the notebook

Cichy objects/animals

Open In Colab

View the notebook

Algonauts video clips

Open In Colab

View the notebook

References:

  • Kriegeskorte, N., Mur, M., and Bandettini, P. A. (2008). Representational similarity analysis-connecting the branches of systems neuroscience. Frontiers in systems neuroscience, 2:4. doi: 10.3389/neuro.06.004.2008

  • Bonner, M. F., and Epstein, R. A. (2017). Coding of navigational affordances in the human visual system. Proceedings of the National Academy of Sciences, 114(18): 4793-4798. doi: 10.1073/pnas.1618228114

  • Cichy, R. M., Pantazis, D., and Oliva, A. (2014). Resolving human object recognition in space and time. Nature neuroscience, 17(3): 455-462. doi: 10.1038/nn.3635

  • url: algonauts.csail.mit.edu/challenge.html