Show simple item record

dc.contributor.advisor Johnson, Don H.
dc.creatorSinanovic, Sinan
dc.date.accessioned 2009-06-04T08:15:51Z
dc.date.available 2009-06-04T08:15:51Z
dc.date.issued 2000
dc.identifier.citation Sinanovic, Sinan. "Toward a theory of information processing." (2000) Master’s Thesis, Rice University. https://hdl.handle.net/1911/17380.
dc.identifier.urihttps://hdl.handle.net/1911/17380
dc.description.abstract Information processing is performed when a system preserves some aspects of the information encoded by its input while it suppresses others. To describe a system's information processing capability, input and output need to be compared in a way invariant to the signal's form and how it represents information. We describe an approach to quantify information processing based on applying controlled changes to the input and observing the corresponding output. Information-theoretic distance measures---those that reflect the data processing theorem---are calculated on the input and output separately and compared. The best candidate for the distance measure to describe signal processing is the information theoretic distance measure called the Kullback-Leibler distance (also known as the relative entropy). Properties of the resulting information transfer ratio are used to derive fundamental information processing properties of systems and interconnected systems.
dc.format.extent 35 p.
dc.format.mimetype application/pdf
dc.language.iso eng
dc.subjectElectronics
Electrical engineering
dc.title Toward a theory of information processing
dc.type Thesis
dc.type.material Text
thesis.degree.department Electrical and Computer Engineering
thesis.degree.discipline Engineering
thesis.degree.grantor Rice University
thesis.degree.level Masters
thesis.degree.name Master of Science


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record