Now showing items 1-3 of 3
Asymptotic rates of the information transfer ratio
Information processing is performed when a system preserves aspects of the input related to what the input represents while it removes other aspects. To describe a system's information processing capability, input and ...
Toward a theory of information processing
Information processing theory endeavors to quantify how well signals encode information and how well systems, by acting on signals, process information. We use information-theoretic distance measures, the Kullback-Leibler ...
Symmetrizing the Kullback-Leibler Distance
We define a new distance measure - the resistor-average distance - between two probability distributions that is closely related to the Kullback-Leibler distance. While the Kullback-Leibler distance is asymmetric in the ...