Open AccessProceedings Article
Multisensory Encoding, Decoding, and Identification
Aurel A. Lazar,Yevgeniy B. Slutskiy +1 more
- 05 Dec 2013
- Vol. 26, pp 3183-3191
TL;DR: It is demonstrated that stimuli of different dimensions can be faithfully multiplexed and encoded in the spike domain and derive tractable algorithms for decoding each stimulus from the common pool of spikes.
read more
Abstract: We investigate a spiking neuron model of multisensory integration. Multiple stimuli from different sensory modalities are encoded by a single neural circuit comprised of a multisensory bank of receptive fields in cascade with a population of biophysical spike generators. We demonstrate that stimuli of different dimensions can be faithfully multiplexed and encoded in the spike domain and derive tractable algorithms for decoding each stimulus from the common pool of spikes. We also show that the identification of multisensory processing in a single neuron is dual to the recovery of stimuli encoded with a population of multisensory neurons, and prove that only a projection of the circuit onto input stimuli can be identified. We provide an example of multisensory integration using natural audio and video and discuss the performance of the proposed decoding and identification algorithms.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Spiking neural circuits with dendritic stimulus processors
TL;DR: This work presents a multi-input multi-output neural circuit architecture for nonlinear processing and encoding of stimuli in the spike domain and demonstrates a fundamental duality between the identification of the dendritic stimulus processor of a single neuron and the decoding of stimuli encoded by a population of neurons with a bank of dendrites.
26
Volterra dendritic stimulus processors and biophysical spike generators with intrinsic noise sources.
Aurel A. Lazar,Yiyin Zhou +1 more
TL;DR: The effects of noise on encoding stimuli with circuits that include neuron models that are akin to those commonly seen in sensory systems, e.g., complex cells in V1, are demonstrated.
Massively parallel neural circuits for stereoscopic color vision
TL;DR: This work argues that evaluation of the functional identification methodology can be effectively and intuitively performed in the stimulus space and derives a duality between TDMs and CIMs that unifies the two and leads to a general theory of neural information representation for stereoscopic color vision.
7
•Book
Reconstruction, Identification and Implementation Methods for Spiking Neural Circuits
Dorian Florescu
- 24 Apr 2017
TL;DR: A new representation between the time encoded input and output of a linear filter, where the TEM is represented by an ideal IF neuron is developed, and a new practical algorithm is developed based on this representation.
7
Identifying Multisensory Dendritic Stimulus Processors
Aurel A. Lazar,Yiyin Zhou +1 more
TL;DR: The fundamental duality between the identification of the dendritic stimulus processor of a single neuron and the decoding of stimuli encoded by a population of neurons with a bank of dendrite stimulus processors is demonstrated.
7
References
•Book
Reproducing Kernel Hilbert Spaces in Probability and Statistics
Alain Berlinet,Christine Thomas-Agnan +1 more
- 11 Apr 2011
TL;DR: Sobolev spaces as mentioned in this paper are weak-derivative or derivative in the sense of distributions, and they can be used to describe Fourier transform functions as well as generalized functions.
2K
Is neocortex essentially multisensory
TL;DR: The notion that neocortical operations are essentially multisensory is examined, which forces us to abandon the notion that the senses ever operate independently during real-world cognition.
1.5K
Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments
TL;DR: This work surveys recent progress in this multisensory field, foregrounding human studies against the background of invasive animal work and highlighting possible underlying mechanisms.
1K
On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies.
TL;DR: Issues related to using the superadditive model in human brain imaging studies are discussed, focusing on population responses to multisensory stimuli and the relationship between single neuron measures and functional brain imaging measures.
204
Seeing sounds: visual and auditory interactions in the brain
David A. Bulkin,Jennifer M. Groh +1 more
TL;DR: Objects and events can often be detected by more than one sensory system and it is suggested that predominantly unimodal brain regions play a role in multisensory processing.
142