Information Theory

 Lecturer: V Naicker 


Calculus, Basic Statistics


The mathematical theory of information channels and source encoding is found in a myriad of different areas in math and applied math and computer science. The basic building blocks are probabilistic in nature and apply to any area where there are sources, signal and noisy information.


Entropy, coding, data compression, Shannon's coding theorems, the Asymptotic Equipartition property, channel capacity


Cover and Thomas, Elements of information theory, Wiley and Sons


Last Modified: Tue, 10 Dec 2013 10:35:42 SAST