Course

Information Theory [ITe]

  • Lecture:

    • Prof. Dr.-Ing. J. Huber

  • Tutorial:

    • Arno Stefani, M.Sc.

  • Prerequisites:

    • Mathematics for Engineers

  • Organisation:

    • 3 class hours per week lecture, 1 class hour tutorial in winter semester

  • Time and Venue:

    • Check UnivIS

  • Current News:

    • Übung: montags (ca. 14-tägig), 16:15 - 17:45 Uhr, R4.15

    1. 09.11.2009
    2. 23.11.2009
    3. 07.12.2009
    4. 21.12.2009
    5. 11.01.2010
    6. 25.01.2010
    7. 08.02.2010

    ar, 16.11.2009

  • ECTS Information:

    • ECTS credits: 5 (Lecture and Tutorial)

  • Contents:

    • Basic definitions: information, entropy, mutual information. Coding for data compression: source coding theorem, lossless compressing codes: Huffman-, Tunstall-, Lempel-Ziv-codes, entropy and coding for sources with memory. Channel coding for reliable communications over noisy channels: channel models, capacity, channel coding theorem, bounding techniques for decoding, error probability, cut-off-rate, random coding error exponent. Information theory for continuous random variables: differential entropy, capacity of channels with white and coloured noise, bandlimited continuous-time channels, tradeoff between power and bandwidth efficiency. Introduction to Rate-Distortion-Theory.

  • References:

    1. Huber, J.: Lecture Manuscript Information Theory. 2001.
    2. Gallager, R. G.: Information Theory and Reliable Communication, John Wiley & Sons 1968, New York.
    3. Johannesson, R.: Informationstheorie - Grundlagen der (Tele-)Kommunikation, Addison-Wesley Studentlitteratur, 1992, ISBN 3-89319-465-7. (in German) Cover T., Thomas J.: Elements of Information Theory, John Wiley and Sons, New York, 1991.
  • General Information:

    • A lecture manuscript is provided.

  • Exam:

    • To be announced in the first lecure.