Show simple item record

dc.contributor.authorSinanovic, Sinan
Johnson, Don
dc.creatorSinanovic, Sinan
Johnson, Don
dc.date.accessioned 2007-10-31T01:06:14Z
dc.date.available 2007-10-31T01:06:14Z
dc.date.issued 2004-06-01
dc.date.submitted 2002-06-06
dc.identifier.citation S. Sinanovic and D. Johnson, "Toward a theory of information processing," Journal of the Franklin Institute, 2004.
dc.identifier.urihttps://hdl.handle.net/1911/20376
dc.description Journal Paper
dc.description.abstract Information processing theory endeavors to quantify how well signals encode information and how well systems, by acting on signals, process information. We use information-theoretic distance measures, the Kullback-Leibler distance in particular, to quantify how well signals represent information. The ratio of distances calculated between two informationally different signals at a system's output and input quantifies the system's information processing properties. Using this approach, we derive the fundamental processing capabilities of simple system architectures that apply universally: the systems and the kinds of signals they process and produce don't affect our general results. Applications in array signal processing and in neural signal analysis illustrate how to apply the theory.
dc.description.sponsorship National Science Foundation
dc.language.iso eng
dc.subjectInformation theory
information processing
Kullback-Leibler
dc.subject.otherInformation Processing
dc.title Toward a theory of information processing
dc.type Journal article
dc.citation.bibtexName article
dc.citation.journalTitle Journal of the Franklin Institute
dc.date.modified 2004-06-11
dc.contributor.orgDigital Signal Processing (http://dsp.rice.edu/)
dc.subject.keywordInformation theory
information processing
Kullback-Leibler
dc.type.dcmi Text
dc.type.dcmi Text
dc.identifier.doihttp://dx.doi.org/10.1016/j.sigpro.2006.11.005


Files in this item

Thumbnail

This item appears in the following Collection(s)

  • DSP Publications [508]
    Publications by Rice Faculty and graduate students in digital signal processing.
  • ECE Publications [1278]
    Publications by Rice University Electrical and Computer Engineering faculty and graduate students

Show simple item record