Browsing by Subject "Information Processing"
Now showing items 120 of 20

Analyzing Dynamics and Stimulus Feature Dependence in the Information Processing of Crayfish Sustaining Fibers
(20020420)The sustaining fiber (SF) stage of the crayfish visual system converts analog stimulus representations to spike train signals. A recent theory quantifies a system's information processing capabilities and relates to ... 
Asymptotic rates of the information transfer ratio
(20020520)Information processing is performed when a system preserves aspects of the input related to what the input represents while it removes other aspects. To describe a system's information processing capability, input and ... 
Basics of information processing
(20020120)Basic probability theory, statistical signal processing and information theory, and interrelationships among these disciplines form the foundations of a theory of information processing. Examples are drawn from pointprocess ... 
Dialogue Concerning Neural Coding and Information Theory
(20030820)The relations between information theory and neural coding are discussed by two researchers, one knowledgeable in information theory, the other in neuroscience. The classic informationtheoretic notions of entropy, mutual ... 
Examining methods for estimating mutual information in spiking neural systems
(20050601)Mutual information enjoys wide use in the computational neuroscience community for analyzing spiking neural systems. Its direct calculation is difficult because estimating the joint stimulusresponse distribution requires ... 
Four top reasons why mutual information does not assess neural information processing
(20020720)Mutual information between stimulus and response has been advocated as an information theoretic measure of a neural system's capability to process information. Once calculated, the result is a single number that supposedly ... 
An Information processing approach to distributed detection
(20030920)We apply the recent theory of information processing to a hybrid distributed detection architecture that combines the traditional parallel and tandem architectures. Central to this theory is the KullbackLeibler discrimination ... 
Information processing during transient responses in the crayfish visual system
(20030601)We analyzed sustaining fiber responses in the crayfish visual system to light pulses using information processing techniques. The light pulse stimuli elicited a transient and a steadystate component in the EPSP input and ... 
Information processing of linear block decoders
(20021020)This paper develops a systematic method of studying the benefits of soft decoding for linear block codes by applying the concepts of information processing. We show that soft decoding uniformly improves decoder performance ... 
Limits of population coding
(20030720)To understand whether the population response expresses information better than the aggregate of the individual responses, the sum of the individual contributions is frequently used as a baseline against which to assess ... 
Measurements vs. Bits: Compressed Sensing meets Information Theory
(20060901)Compressed sensing is a new framework for acquiring sparse signals based on the revelation that a small number of linear projections (measurements) of the signal contain enough information for its reconstruction. The ... 
Neural population structures and consequences for neural coding
(20020920)Researchers studying neural coding have speculated that populations of neurons would more effectively represent the stimulus if the neurons "cooperated:" by interacting through lateral connections, the neurons would process ... 
A new look at the informational gain of soft decisions
(20030420)This paper develops a new systematic method of studying the benefits of 2bit soft decisions by applying the concepts of information processing theory. We quantify performance in terms of the information transfer ratio and ... 
New multivariate dependence measures and applications to neural ensembles
(20030920)We develop two new multivariate statistical dependence measures. The first, based on the KullbackLeibler distance, results in a single value that indicates the general level of dependence among the random variables. The ... 
Optimal stimulus coding by neural populations using rate codes
(20020920)We create a framework based on Fisher information for determining the most effective population coding scheme for representing a continuousvalued stimulus attribute over its entire range. Using this scheme, we derive ... 
Optimizing binary decision systems by manipulating transmission intervals
(20030720)We study the optimization of a binary decision system where quantized (soft) decisions are transmitted across an additive white Gaussian noise channel. We adjust the bit transmission intervals to maximize the Chernoff ... 
Optimizing Physical Layer Data Transmission for Minimal Signal Distortion
(20030420)When transmitting a sampled signal digitally, data and error correction bits must be transmitted at least as fast as the sampling rate. Typically, each bit is allocated the same transmission time interval, which means the ... 
Symmetrizing the KullbackLeibler Distance
(20010320)We define a new distance measure  the resistoraverage distance  between two probability distributions that is closely related to the KullbackLeibler distance. While the KullbackLeibler distance is asymmetric in the ... 
Toward a theory of information processing
(20040601)Information processing theory endeavors to quantify how well signals encode information and how well systems, by acting on signals, process information. We use informationtheoretic distance measures, the KullbackLeibler ... 
When does interval coding occur?
(20030720)During the stationary portion of neuron's spiking response to a stimulus, the stimulus could be coded in the average rate and, more elaborately, in the statistics of the sequence of interspike intervals. We use information ...