In vivo cell-type and brain region classification via multimodal contrastive learning
Columbia University · Northwestern University · Psychological and Brain Sciences, Boston University · MiraclePlus · Allen Institute for Brain Science · Institut de Physique du Globe · University College London, University of London · Georgia Institute of Technology · Boston University · Stanford University · Zuckerman Institute, Columbia University
PDF 由论文原始站点提供，PaperCompass 不保存论文文件。
摘要
Current electrophysiological approaches can track the activity of many neurons, yet it is usually unknown which cell-types or brain areas are being recorded without further molecular or histological analysis. Developing accurate and scalable algorithms for identifying the cell-type and brain region of recorded neurons is thus crucial for improving our understanding of neural computation. In this work, we develop a multimodal contrastive learning approach for neural data that can be fine-tuned for different downstream tasks, including inference of cell-type and brain location. We utilize multimodal contrastive learning to jointly embed the activity autocorrelations and extracellular waveforms of individual neurons. We demonstrate that our embedding approach, Neuronal Embeddings via MultimOdal Contrastive Learning (NEMO), paired with supervised fine-tuning, achieves state-of-the-art cell-type classification for two opto-tagged datasets and brain region classification for the public International Brain Laboratory Brain-wide Map dataset. Our method represents a promising step towards accurate cell-type and brain region classification from electrophysiological recordings.