Competition

The goal of the 2025 challenge is to provide a platform for biological and artificial intelligence scientists to cooperate and compete in developing cutting-edge brain encoding models. Specifically, these models should predict whole brain response to multimodal naturalistic stimulation, and generalize outside their training distribution.

The Challenge data is based on the CNeuroMod dataset which, as of now, most intensively samples single subject neural responses to a variety of naturalistic tasks, including movie watching. The CNeuroMod dataset’s unprecedented size, combined with the multimodal nature and diversity of its stimuli and tasks, makes it an ideal training and testing ground to build robust encoding models of fMRI responses to multimodal stimuli that generalize outside of their training distribution. Learn more about the stimuli and fMRI dataset used in the 2025 Challenge.

We provide:

• a set of movie stimuli, and
• the corresponding brain responses recorded while four human subjects viewed those movies.

With that, challenge participants are expected to build computational models to predict brain responses to in-distribution (ID) and out-of-distribution (OOD) movies for which the brain data are withheld.

Challenge participants submit predicted responses in the format described in the development kit. We score the submission by measuring the predictivity for each brain parcel for all the subjects and display on the leaderboard the overall mean predictivity over all parcels and subjects.

Challenge Phases

The challenge is hosted on Codabench, and consists of two main serial phases:

• a 6-months model building phase during which encoding models are trained and tested, followed by
• a 1-week model selection phase during which the winning models are selected based on their performance on a withheld out-of-distribution (OOD) test set.

To enforce strict tests of OOD generalization during the model selection phase, the two phases are based on data from different distributions, and have separate leaderboards. The challenge will be followed by an indefinite post-challenge phase, which will serve as a public benchmark for anyone wishing to test brain encoding models on multimodal movie data (Figure 1).

Development Kit

To facilitate participation, we provide a development kit in Python which accompanies users through the challenge process, following four steps:

1. Familiarizing with the challenge data.
2. Extracting the stimulus features used to train and validate an fMRI encoding model.
3. Training and validating an fMRI encoding model.
4. Preparing the predicted fMRI responses for the test stimuli in the correct format for submission to Codabench.

How to Predict Brain Data Using Computational Models?

There are different ways to predict brain data using computational models. We put close to no restrictions on how you do so (see Challenge Rules). However, a commonly used approach is to use linearizing encoding models, and we provide a development kit to implement such a model.

Challenge Rules

1. Challenge participants can use any encoding model derived from any source and trained on any type of data. However, using recorded brain responses for Friends season 7 or the OOD movie stimuli is prohibited.

2. The winning models will be determined based on their performance in predicting fMRI responses for the OOD movie stimuli during the model selection phase.

3. Challenge participants can make an unlimited number of submissions during the model building phase, and a maximum of ten submissions during the model selection phase. Each challenge participant can only compete using one account. Creating multiple accounts to increase the number of possible submissions will result in disqualification to the challenge.

4. To promote open science, challenge participants who wish to be considered for the winners selection will need to submit a short report (~4-8 pages) describing their encoding algorithm to a preprint server (e.g. arXiv, bioRxiv), and send the PDF or preprint link to the Organizers by filling out this form. You must submit the challenge report by the challenge report submission deadline to be considered for the evaluation of the challenge outcome. Furthermore, while all reports are encouraged to link to their code (e.g. GitHub), the top-3 performing teams are required to make their code openly available. Participants that do not make their approach open and transparent cannot be considered. Along with monetary prizes, the top-3 performing teams will be invited to present their encoding models during a talk at the Cognitive Computational Neuroscience (CCN) conference held in Amsterdam (Netherlands) in August 2025.

Papers

Click here to read the papers and for guidance on citation

Important Dates

Acknowledgements

The Algonauts Project 2025 challenge is supported by German Research Council (DFG) grants (CI 241/1-3, CI 241/1-7, INST 272/297-1), the European Research Council (ERC) starting grant (ERC-StG-2018-803370), the German Research Foundation (DFG Research Unit FOR 5368 ARENA), Unifying Neuroscience and Artificial Intelligence - Québec (UNIQUE), and The Hessian Center for Artificial Intelligence. The Courtois project on neural modelling was made possible by a generous donation from the Courtois foundation, administered by the Fondation Institut Gériatrie Montréal at CIUSSS du Centre-Sud-de-l’île-de-Montréal and University of Montreal. The CNeuroMod data used in the Algonauts 2025 Challenge has been openly shared under a Creative Commons CC0 license by a subset of CNeuroMod participants through the Canadian Open Neuroscience Platform (CONP), funded by Brain Canada and based at McGill University, Canada.