Now showing items 1-3 of 3

    • Asymptotic rates of the information transfer ratio 

      Sinanovic, Sinan; Johnson, Don (2002-05-20)
      Information processing is performed when a system preserves aspects of the input related to what the input represents while it removes other aspects. To describe a system's information processing capability, input and ...
    • Symmetrizing the Kullback-Leibler Distance 

      Johnson, Don; Sinanovic, Sinan (2001-03-20)
      We define a new distance measure - the resistor-average distance - between two probability distributions that is closely related to the Kullback-Leibler distance. While the Kullback-Leibler distance is asymmetric in the ...
    • Toward a theory of information processing 

      Sinanovic, Sinan; Johnson, Don (2004-06-01)
      Information processing theory endeavors to quantify how well signals encode information and how well systems, by acting on signals, process information. We use information-theoretic distance measures, the Kullback-Leibler ...