Show simple item record

dc.contributor.authorSinanovic, Sinan
Johnson, Don
dc.creatorSinanovic, Sinan
Johnson, Don 2007-10-31T01:06:14Z 2007-10-31T01:06:14Z 2004-06-01 2002-06-06
dc.identifier.citation S. Sinanovic and D. Johnson, "Toward a theory of information processing," Journal of the Franklin Institute, 2004.
dc.description Journal Paper
dc.description.abstract Information processing theory endeavors to quantify how well signals encode information and how well systems, by acting on signals, process information. We use information-theoretic distance measures, the Kullback-Leibler distance in particular, to quantify how well signals represent information. The ratio of distances calculated between two informationally different signals at a system's output and input quantifies the system's information processing properties. Using this approach, we derive the fundamental processing capabilities of simple system architectures that apply universally: the systems and the kinds of signals they process and produce don't affect our general results. Applications in array signal processing and in neural signal analysis illustrate how to apply the theory.
dc.description.sponsorship National Science Foundation
dc.language.iso eng
dc.subjectInformation theory
information processing
dc.subject.otherInformation Processing
dc.title Toward a theory of information processing
dc.type Journal article
dc.citation.bibtexName article
dc.citation.journalTitle Journal of the Franklin Institute 2004-06-11
dc.contributor.orgDigital Signal Processing (
dc.subject.keywordInformation theory
information processing
dc.type.dcmi Text
dc.type.dcmi Text

Files in this item


This item appears in the following Collection(s)

  • DSP Publications [508]
    Publications by Rice Faculty and graduate students in digital signal processing.
  • ECE Publications [1278]
    Publications by Rice University Electrical and Computer Engineering faculty and graduate students

Show simple item record