Now showing items 1-20 of 20

  • Analyzing Dynamics and Stimulus Feature Dependence in the Information Processing of Crayfish Sustaining Fibers 

    Rozell, Chris (2002-04-20)
    The sustaining fiber (SF) stage of the crayfish visual system converts analog stimulus representations to spike train signals. A recent theory quantifies a system's information processing capabilities and relates to ...
  • Asymptotic rates of the information transfer ratio 

    Sinanovic, Sinan; Johnson, Don (2002-05-20)
    Information processing is performed when a system preserves aspects of the input related to what the input represents while it removes other aspects. To describe a system's information processing capability, input and ...
  • Basics of information processing 

    Johnson, Don (2002-01-20)
    Basic probability theory, statistical signal processing and information theory, and inter-relationships among these disciplines form the foundations of a theory of information processing. Examples are drawn from point-process ...
  • Dialogue Concerning Neural Coding and Information Theory 

    Johnson, Don (2003-08-20)
    The relations between information theory and neural coding are discussed by two researchers, one knowledgeable in information theory, the other in neuroscience. The classic information-theoretic notions of entropy, mutual ...
  • Examining methods for estimating mutual information in spiking neural systems 

    Rozell, Chris; Johnson, Don (2005-06-01)
    Mutual information enjoys wide use in the computational neuroscience community for analyzing spiking neural systems. Its direct calculation is difficult because estimating the joint stimulus-response distribution requires ...
  • Four top reasons why mutual information does not assess neural information processing 

    Johnson, Don (2002-07-20)
    Mutual information between stimulus and response has been advocated as an information theoretic measure of a neural system's capability to process information. Once calculated, the result is a single number that supposedly ...
  • An Information processing approach to distributed detection 

    Lexa, Michael; Johnson, Don (2003-09-20)
    We apply the recent theory of information processing to a hybrid distributed detection architecture that combines the traditional parallel and tandem architectures. Central to this theory is the Kullback-Leibler discrimination ...
  • Information processing during transient responses in the crayfish visual system 

    Rozell, Chris; Johnson, Don; Glantz, Raymon (2003-06-01)
    We analyzed sustaining fiber responses in the crayfish visual system to light pulses using information processing techniques. The light pulse stimuli elicited a transient and a steady-state component in the EPSP input and ...
  • Information processing of linear block decoders 

    Lexa, Michael; Johnson, Don (2002-10-20)
    This paper develops a systematic method of studying the benefits of soft decoding for linear block codes by applying the concepts of information processing. We show that soft decoding uniformly improves decoder performance ...
  • Limits of population coding 

    Johnson, Don (2003-07-20)
    To understand whether the population response expresses information better than the aggregate of the individual responses, the sum of the individual contributions is frequently used as a baseline against which to assess ...
  • Measurements vs. Bits: Compressed Sensing meets Information Theory 

    Sarvotham, Shriram; Baron, Dror; Baraniuk, Richard G. (2006-09-01)
    Compressed sensing is a new framework for acquiring sparse signals based on the revelation that a small number of linear projections (measurements) of the signal contain enough information for its reconstruction. The ...
  • Neural population structures and consequences for neural coding 

    Johnson, Don (2002-09-20)
    Researchers studying neural coding have speculated that populations of neurons would more effectively represent the stimulus if the neurons "cooperated:" by interacting through lateral connections, the neurons would process ...
  • A new look at the informational gain of soft decisions 

    Lexa, Michael; Johnson, Don (2003-04-20)
    This paper develops a new systematic method of studying the benefits of 2-bit soft decisions by applying the concepts of information processing theory. We quantify performance in terms of the information transfer ratio and ...
  • New multivariate dependence measures and applications to neural ensembles 

    Goodman, Ilan; Johnson, Don (2003-09-20)
    We develop two new multivariate statistical dependence measures. The first, based on the Kullback-Leibler distance, results in a single value that indicates the general level of dependence among the random variables. The ...
  • Optimal stimulus coding by neural populations using rate codes 

    Johnson, Don; Ray, Will (2002-09-20)
    We create a framework based on Fisher information for determining the most effective population coding scheme for representing a continuous-valued stimulus attribute over its entire range. Using this scheme, we derive ...
  • Optimizing binary decision systems by manipulating transmission intervals 

    Lexa, Michael; Johnson, Don (2003-07-20)
    We study the optimization of a binary decision system where quantized (soft) decisions are transmitted across an additive white Gaussian noise channel. We adjust the bit transmission intervals to maximize the Chernoff ...
  • Optimizing Physical Layer Data Transmission for Minimal Signal Distortion 

    Johnson, Don; Rodriguez-Diaz, Hiram (2003-04-20)
    When transmitting a sampled signal digitally, data and error correction bits must be transmitted at least as fast as the sampling rate. Typically, each bit is allocated the same transmission time interval, which means the ...
  • Symmetrizing the Kullback-Leibler Distance 

    Johnson, Don; Sinanovic, Sinan (2001-03-20)
    We define a new distance measure - the resistor-average distance - between two probability distributions that is closely related to the Kullback-Leibler distance. While the Kullback-Leibler distance is asymmetric in the ...
  • Toward a theory of information processing 

    Sinanovic, Sinan; Johnson, Don (2004-06-01)
    Information processing theory endeavors to quantify how well signals encode information and how well systems, by acting on signals, process information. We use information-theoretic distance measures, the Kullback-Leibler ...
  • When does interval coding occur? 

    Johnson, Don; Glantz, Raymon (2003-07-20)
    During the stationary portion of neuron's spiking response to a stimulus, the stimulus could be coded in the average rate and, more elaborately, in the statistics of the sequence of interspike intervals. We use information ...