Department of Computer Science and Engineering

B.Tech. III (CO) Semester - 5

L

T

P

C
CO315 : INFORMATION THEORY AND CODING (EIS - I)

3

0

0

3
COURSE OBJECTIVES
  • Introduce the principles and applications of information theory.
  • To teach study how information is measured in terms of probability and entropy, and the relationships among conditional and joint entropies.
  • To teach coding schemes, including error correcting codes.
  • Explain how this quantitative measure of information may be used in order to build efficient solutions to multitudinous engineering problems.
    		•
    COURSE OUTCOMES
    After successful completion of this course, student will be able to
    • Apply information theory and linear algebra in source coding and channel coding
    • Understand various error control encoding and decoding techniques
    • Analyze the performance of error control codes
    COURSE CONTENT
    INTRODUCTION

    (04 Hours)

    Information source, Symbols, and Entropy, Mutual Information, Information measures for continuous Random Variable

    SOURCE CODING

    (12 Hours)

    The source coding theorem, Kraft inequality, Shannon-Fano codes, Huffman codes, Arithmetic Codes, Lempel-Ziv-Welch algorithm, universal source codes

    CHANNEL CAPACITY

    (08 Hours)

    Channel capacity; Noisy channel coding theorem for discrete memory-less channels; Channel capacity with feedback; Continuous and Gaussian channels

    ERROR CONTROL CODING

    (06 Hours)

    Linear block codes and their properties, hard-decision decoding, convolution codes and the Viterbi decoding algorithm, iterative decoding; turbo codes and low density-parity-check codes

    RATE DISTORTION THEORY

    (04 Hours)

    Rate distortion function, random source codes; joint source-channel coding and the separation theorem

    CONTEMPORARY RESEARCH TOPICS

    (08 Hours)
    (Total Contact Time: 42 Hours)
    BOOKS RECOMMENDED
    1. Reza, "An Introduction to Information Theory", Dover 1994
    2. T. M. Cover and J. A. Thomas," Elements of Information Theory", John Wiley & Sons, New York, 1991
    3. R. Hill, "A First Course in Coding Theory", Oxford University Press, 1986
    4. L. Hanzo, T.H. Liew and B.L. Yeap, "Turbo coding, turbo equalization and space-time coding for transmission over fading channels", John Wiley and Sons, 2002
    5. R. Bose, "Information Theory, Coding and Cryptography", TMH, 2002