Text to brain: predicting the spatial distribution of neuroimaging observations from text reports

  • Jérôme Dockès
  • , Demian Wassermann
  • , Russell Poldrack
  • , Fabian Suchanek
  • , Bertrand Thirion
  • , Gaël Varoquaux

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Despite the digital nature of magnetic resonance imaging, the resulting observations are most frequently reported and stored in text documents. There is a trove of information untapped in medical health records, case reports, and medical publications. In this paper, we propose to mine brain medical publications to learn the spatial distribution associated with anatomical terms. The problem is formulated in terms of minimization of a risk on distributions which leads to a least-deviation cost function. An efficient algorithm in the dual then learns the mapping from documents to brain structures. Empirical results using coordinates extracted from the brain-imaging literature show that (i) models must adapt to semantic variation in the terms used to describe a given anatomical structure, (ii) voxel-wise parameterization leads to higher likelihood of locations reported in unseen documents, (iii) least-deviation cost outperforms least-square. As a proof of concept for our method, we use our model of spatial distributions to predict the distribution of specific neurological conditions from text-only reports.

Original languageEnglish
Title of host publicationMedical Image Computing and Computer Assisted Intervention – MICCAI 2018 - 21st International Conference, 2018, Proceedings
EditorsAlejandro F. Frangi, Christos Davatzikos, Gabor Fichtinger, Carlos Alberola-López, Julia A. Schnabel
PublisherSpringer Verlag
Pages584-592
Number of pages9
ISBN (Print)9783030009304
DOIs
Publication statusPublished - 1 Jan 2018
Event21st International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2018 - Granada, Spain
Duration: 16 Sept 201820 Sept 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11072 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference21st International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2018
Country/TerritorySpain
CityGranada
Period16/09/1820/09/18

Fingerprint

Dive into the research topics of 'Text to brain: predicting the spatial distribution of neuroimaging observations from text reports'. Together they form a unique fingerprint.

Cite this