1. Neuroscience

Likelihood approximation networks (LANs) for fast inference of simulation models in cognitive neuroscience

  1. Alexander Fengler  Is a corresponding author
  2. Lakshmi N Govindarajan
  3. Tony Chen
  4. Michael J Frank  Is a corresponding author
  1. Brown University, United States
  2. Boston College, United States
https://doi.org/10.7554/eLife.65074
Share this article
Cite this article
  1. Alexander Fengler
  2. Lakshmi N Govindarajan
  3. Tony Chen
  4. Michael J Frank
(2021)
Likelihood approximation networks (LANs) for fast inference of simulation models in cognitive neuroscience
eLife 10:e65074.
https://doi.org/10.7554/eLife.65074
  2. Download BibTeX
  3. Download .RIS

Abstract

In cognitive neuroscience, computational modeling can formally adjudicate between theories and affords quantitative fits to behavioral/brain data. Pragmatically, however, the space of plausible generative models considered is dramatically limited by the set of models with known likelihood functions. For many models, the lack of a closed-form likelihood typically impedes Bayesian inference methods. As a result, standard models are evaluated for convenience, even when other models might be superior. Likelihood-free methods exist but are limited by their computational cost or their restriction to particular inference scenarios. Here, we propose neural networks that learn approximate likelihoods for arbitrary generative models, allowing fast posterior sampling with only a one-off cost for model simulations that is amortized for future inference. We show that these methods can accurately recover posterior parameter distributions for a variety of neurocognitive process models. We provide code allowing users to deploy these methods for arbitrary hierarchical model instantiations without further training.

Data availability

All code is provided freely and is available at the following links: https://github.com/lnccbrown/lans/tree/master/hddmnn-tutorial, https://github.com/lnccbrown/lans/tree/master/al-mlp and https://github.com/lnccbrown/lans/tree/master/al-cnn.

Article and author information

Author details

  1. Alexander Fengler

    Robert J and Nancy D Carney Institute for Brain Science; Cognitive, Linguistic & Psychological Sciences, Brown University, Providence, United States
    For correspondence
    alexander_fengler@brown.edu
    Competing interests
    No competing interests declared.

  2. Lakshmi N Govindarajan

    Robert J and Nancy D Carney Institute for Brain Science; Cognitive, Linguistic & Psychological Sciences, Brown University, Providence, United States
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-0936-2919

  3. Tony Chen

    Psychology and Neuroscience, Boston College, Boston, United States
    Competing interests
    No competing interests declared.

  4. Michael J Frank

    Robert J and Nancy D Carney Institute for Brain Science; Cognitive, Linguistic & Psychological Sciences, Brown University, Providence, United States
    For correspondence
    Michael_Frank@brown.edu
    Competing interests
    Michael J Frank, Senior editor, eLife.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-8451-0523

Funding

National Institute of Mental Health (P50 MH119467-01)

  • Michael J Frank

National Institute of Mental Health (R01 MH084840-08A1)

  • Michael J Frank

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Reviewing Editor

  1. Valentin Wyart, École normale supérieure, PSL University, INSERM, France

Version history

  1. Received: November 21, 2020
  2. Accepted: April 1, 2021
  3. Accepted Manuscript published: April 6, 2021 (version 1)
  4. Version of Record published: May 6, 2021 (version 2)
  5. Version of Record updated: May 21, 2021 (version 3)

Copyright

© 2021, Fengler et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 3,776
    views
  • 544
    downloads
  • 32
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Alexander Fengler
  2. Lakshmi N Govindarajan
  3. Tony Chen
  4. Michael J Frank
(2021)
Likelihood approximation networks (LANs) for fast inference of simulation models in cognitive neuroscience
eLife 10:e65074.
https://doi.org/10.7554/eLife.65074

Share this article

https://doi.org/10.7554/eLife.65074

Categories and tags

Research organisms

Further reading

    1. Neuroscience

    Flexible and efficient simulation-based inference for models of decision-making

    Jan Boelts, Jan-Matthis Lueckmann ... Jakob H Macke
    Research Advance Updated

    Inferring parameters of computational models that capture experimental data is a central task in cognitive neuroscience. Bayesian statistical inference methods usually require the ability to evaluate the likelihood of the model—however, for many models of interest in cognitive neuroscience, the associated likelihoods cannot be computed efficiently. Simulation-based inference (SBI) offers a solution to this problem by only requiring access to simulations produced by the model. Previously, Fengler et al. introduced likelihood approximation networks (LANs, Fengler et al., 2021) which make it possible to apply SBI to models of decision-making but require billions of simulations for training. Here, we provide a new SBI method that is substantially more simulation efficient. Our approach, mixed neural likelihood estimation (MNLE), trains neural density estimators on model simulations to emulate the simulator and is designed to capture both the continuous (e.g., reaction times) and discrete (choices) data of decision-making models. The likelihoods of the emulator can then be used to perform Bayesian parameter inference on experimental data using standard approximate inference methods like Markov Chain Monte Carlo sampling. We demonstrate MNLE on two variants of the drift-diffusion model and show that it is substantially more efficient than LANs: MNLE achieves similar likelihood accuracy with six orders of magnitude fewer training simulations and is significantly more accurate than LANs when both are trained with the same budget. Our approach enables researchers to perform SBI on custom-tailored models of decision-making, leading to fast iteration of model design for scientific discovery.

    1. Genetics and Genomics
    2. Neuroscience

    Biobank-wide association scan identifies risk factors for late-onset Alzheimer’s disease and endophenotypes

    Donghui Yan, Bowen Hu ... Qiongshi Lu
    Research Article

    Rich data from large biobanks, coupled with increasingly accessible association statistics from genome-wide association studies (GWAS), provide great opportunities to dissect the complex relationships among human traits and diseases. We introduce BADGERS, a powerful method to perform polygenic score-based biobank-wide association scans. Compared to traditional approaches, BADGERS uses GWAS summary statistics as input and does not require multiple traits to be measured in the same cohort. We applied BADGERS to two independent datasets for late-onset Alzheimer’s disease (AD; n=61,212). Among 1738 traits in the UK biobank, we identified 48 significant associations for AD. Family history, high cholesterol, and numerous traits related to intelligence and education showed strong and independent associations with AD. Furthermore, we identified 41 significant associations for a variety of AD endophenotypes. While family history and high cholesterol were strongly associated with AD subgroups and pathologies, only intelligence and education-related traits predicted pre-clinical cognitive phenotypes. These results provide novel insights into the distinct biological processes underlying various risk factors for AD.

    1. Neuroscience

    Revealing intact neuronal circuitry in centimeter-sized formalin-fixed paraffin-embedded brain

    Ya-Hui Lin, Li-Wen Wang ... Li-An Chu
    Research Article

    Tissue-clearing and labeling techniques have revolutionized brain-wide imaging and analysis, yet their application to clinical formalin-fixed paraffin-embedded (FFPE) blocks remains challenging. We introduce HIF-Clear, a novel method for efficiently clearing and labeling centimeter-thick FFPE specimens using elevated temperature and concentrated detergents. HIF-Clear with multi-round immunolabeling reveals neuron circuitry regulating multiple neurotransmitter systems in a whole FFPE mouse brain and is able to be used as the evaluation of disease treatment efficiency. HIF-Clear also supports expansion microscopy and can be performed on a non-sectioned 15-year-old FFPE specimen, as well as a 3-month formalin-fixed mouse brain. Thus, HIF-Clear represents a feasible approach for researching archived FFPE specimens for future neuroscientific and 3D neuropathological analyses.