The Stanford Digital Brain Project

Building a predictive model of the human brain

Who We Are

An interdisciplinary consortium of Stanford neuroscientists, computer scientists, and clinicians working towards a holistic computational model of the human brain.

Our Mission

We're leveraging advances in neuroscience and machine learning to create a uniquely rich and holistic portrait of the human brain in action: data which will form the backbone for the world’s most detailed, high-resolution digital model of the human brain. 

Our Goal

The data we gather and the models we build will accelerate neuroscience research and clinical care; deepening our fundamental understanding of the human brain and guiding personalized interventions for brain disorders.

The Project

Ten research campaigns. One integrated model.

Our Approach

Naturalistic human brain imaging and modeling at scale

A series of large-scale experimental campaigns leveraging next generation brain imaging technologies will produce a rich and unprecedented portrait of how our brains’ many functional networks work together in everyday life. 

Each campaign will add a new domain of mental function to a holistic digital model of how our brains allow us to perceive and act in the world. 

Campaign 01

Audio-Visual Scene Descriptions

The first experimental campaign combines natural audiovisual scenes with tasks involving attention, memory, and language. Participants watch and listen, direct their attention, make memory judgments, and describe what they experienced, while neural activity is recorded sequentially by 7T MRI and OPM-MEG.

Enabling technologies

Seeing the brain across space and time

Cutting-edge non-invasive brain imaging techniques — available at only a few institutions in the world — record both where activity occurs in the brain and how it unfolds over time, resulting in a uniquely rich portrait of the brain activity underlying human cognition and behavior.

Image
Language activation visualization

7T FMRI

Millimeter Spatial Resolution

Next-generation, ultra-high-field 7-Tesla MRI can measure patterns of brain activity across the entire brain at much finer scales than conventional MRI.

Learn More

Image
OPM-MEG data showing brain activation in the left temporal lobe

OPM-MEG

Millisecond Temporal Resolution

Magnetoencephalography with optically pumped magnetometers (OPM-MEG) allows precise recording of brain activity as it unfolds with wearable sensors that support more natural movement than conventional MEG.

Learn More

Image

Counterfactual World Modeling

Training Brain-Scale Neural Networks

Frontier techniques in machine learning and foundation model development will allow predictive world modeling of key human brain systems, using continuous refinement and validation to ensure accuracy and relevance.

Learn More

The model

A digital observatory for the human brain

We propose to create the most detailed and accurate foundation models of the human brain ever attempted: trained on large-scale neural and behavioral datasets, and capable of extrapolating to reverse engineer fundamental principles of neural circuit connectivity and function.

Step 01

Design

Combine several interacting cognitive and behavioral capacities in carefully designed experimental task structure.

Step 02

Measure

Record spatial, temporal, and behavioral signals associated with experimental tasks.

Step 03

Model

Determine scaling curves and progressively train a predictive model across multiple subjects, instruments, and experimental tasks. 

Step 04

Validate

Evaluate model performance against held-out conditions, third-party datasets, and simpler baselines.

Step 05

Refine

Results refine the model and inform the next experiments.

Super-Resolution Modeling Hypothesis

We propose that constraining a model to match high spatial and temporal resolution non-invasive brain recordings as well as rich behavioral outputs will produce an even higher resolution model of brain activity — rivaling what would be possible with invasive recordings.

Open Science

Our commitment to the research community

In keeping with Stanford's commitment to open science, the datasets and models developed by the project will be made freely available to researchers worldwide. 

Validated datasets

Data products with appropriate public or controlled access.

Shared tasks and protocols

Experimental designs and implementations that other groups can use and extend.

Open-source models and code

Reusable model releases, training tools, and documented software.

Benchmarks

Common tests for comparing predictions across models and datasets.

Impact

A transformative tool for neuroscience and brain health

Today, it is impossible to predict in detail how the human brain will respond to any given sensory input, cognitive task, disease state or clinical intervention. We aim to change that.

A new model for neuroscience research

In the near term, we are building a predictive model of brain function that can be tested, challenged, and improved in order to advance our fundamental understanding of our brains and ourselves. 

A foundation for future clinical research

Longer term, the same foundation model could help researchers better understand brain disorders, identify meaningful differences between patients, and test targeted interventions to improve brain health.

The Team

Stanford Digital Brain Project Consortium

Image
Ehsan Adeli

Ehsan Adeli

Assistant Professor (Research) of Psychiatry and Behavioral Sciences (Public Mental Health and Populations Sciences) and, by courtesy, of Computer Science and of Biomedical Data Science

Image
Laura Gwilliams

Laura Gwilliams

Wu Tsai Neurosciences Institute Faculty Scholar; Assistant Professor of Psychology and, by courtesy, of Linguistics

Image
Russell Poldrack

Russell Poldrack

Albert Ray Lang Professor of Psychology and, by courtesy, of Psychiatry and Behavioral Science

Image
Brian A. Wandell

Brian A. Wandell

Isaac and Madeline Stein Family Professor and Professor, by courtesy, of Electrical Engineering, of Ophthalmology and of Education

Image
Dan Yamins at the Stanford Neurosciences Building

Daniel Yamins

Associate Professor of Psychology and of Computer Science

External collaborators and advisors

Image
Martin Schrimpf

Martin Schrimpf

École Polytechnique Fédérale de Lausanne

Image
Kay

Kendrick Kay

Assistant Professor, Department of Radiology, University of Minnesota Twin Cities

 

Image
Tomas

Tomas Knapen

Assistant Professor, Faculty of Behavioural and Movement Sciences, Cognitive Psychology and IBBA, Vrije U Amsterdam

 

Image
Greta Tuckute

Greta Tuckute

Kempner Research Fellow, The Kempner Institute for the Study of Natural and Artificial Intelligence at Harvard University

 

Interested in contributing to the project or becoming a collaborator?

Get in touch

Please note: Participant recruitment for research studies is not yet open. To hear when approved participation information becomes available, join our general mailing list.

Project Updates

Follow our ongoing work

Image
Stanford Digital Brain Project research team in the neurosciences building courtyard

Announcement

Stanford Digital Brain Project to measure and model the human brain

Foundational support from Mark and Mary Stevens and an additional gift from Clara Wu Tsai launches a University-wide project to predict brain dynamics and accelerate treatments for brain disorders

Read the announcement

Image
ç

Substack

Dan's Theory Blog

Read about the theory behind the modeling effort on Dan Yamins' Substack, "The Principle Investigator".

Follow the blog

Image
From Our Neurons to Yours Wu Tsai Neuro Podcast

Podcast

Predicting the Brain

Dan Yamins and Russ Poldrack, explain the vision behind the effort to build a digital brain and the experimental campaign that will bring them to fruition

 


 

Listen to the episode

For more updates, subscribe to our mailing list.

Click "Stanford Digital Brain Project" under subscription preferences.

Subscribe

Acknowledgements

Made possible through generosity and collaboration

This project was made possible by foundational philanthropic support, Stanford’s long-standing investments in interdisciplinary science and shared research infrastructure, and critical strategic partnerships.

Benefactors

We are grateful for lead support from philanthropists Mark and Mary Stevens and additional support from Clara Wu Tsai, which made possible the launch of this ambitious initiative. 


Image
Mark and Mary Stevens

Mark & Mary Stevens

Mark and Mary Stevens have been core supporters of the Wu Tsai Neurosciences Institute since its inception. Mark is a venture capitalist and managing partner of S-Cubed Capital, as well as a board member of Nvidia and member of the Board of Trustees of University of Southern California. At Stanford he has served on the Interdisciplinary Life Sciences Council and the Hoover Board of Overseers. Mary is a member of the Board of Trustees at Santa Clara University. The couple serve on the U.S. Olympic & Paralympic Foundation Board of Directors and are parents of a Stanford student who graduated in 2020.


Image
Headshot of Clara Wu Tsai

Clara Wu Tsai

Clara Wu Tsai was the foundational supporter of the Wu Tsai Neurosciences Institute and the Wu Tsai Human Performance Alliance at Stanford, both designed to operate at interfaces of diverse fields to create transformational advances in human health and cognitive and physical performance. She is a member of the Stanford Board of Trustees, governor of the WNBA’s New York Liberty, owner of the NBA’s Brooklyn Nets, vice chair of Brooklyn Sports and Entertainment, and a trustee of Lincoln Center for the Performing Arts. 


Stanford Institutes, Shared Facilities, and Research Partners

This project is anchored at the Wu Tsai Neurosciences Institute, an interdisciplinary life-sciences institute under the auspices of Stanford's Vice Provost & Dean of Research, and builds on the university's long-standing strategic investments in shared research infrastructure and data.