deposit_your_work

Asymptotic rates of the information transfer ratio

Files in this item

Files Size Format View
Sin2002May5Asymptotic.PDF 426.9Kb application/pdf Thumbnail

Show full item record

Item Metadata

Title: Asymptotic rates of the information transfer ratio
Author: Sinanovic, Sinan; Johnson, Don
Type: Conference Paper
Keywords: information processing; parallel systems
Citation: S. Sinanovic and D. Johnson,"Asymptotic rates of the information transfer ratio," in IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP),
Abstract: Information processing is performed when a system preserves aspects of the input related to what the input represents while it removes other aspects. To describe a system's information processing capability, input and output need to be compared in a way invariant to the way signals represent information. Kullback-Leibler distance, an information-theoretic measure which reflects the data processing theorem, is calculated on the input and output separately and compared to obtain information transfer ratio. We consider the special case where input serves several parallel systems and show that this configuration has the capability to represent the input information without loss. We also derive bounds for asymptotic rates at which the loss decreases as more parallel systems are added and show that the rate depends on the input distribution.
Date Published: 2002-05-20

This item appears in the following Collection(s)

  • ECE Publications [1082 items]
    Publications by Rice University Electrical and Computer Engineering faculty and graduate students
  • DSP Publications [508 items]
    Publications by Rice Faculty and graduate students in digital signal processing.