TSKS12 Modern Channel Coding, Inference and Learning

This course is no longer offered. If you are interested in the topics, please contact Danyo Danev

Course topics

• Information transmission, probability, entropy
• Mutual information
• The noisy channel coding theorem
• Computing channel capacity: The Gaussian channel
• Practical channel coding
  • Repeat-Accumulate codes
  • Digital fountain codes
  • “Turbo” codes and LDPC codes
• Clustering
• Exact marginalization
  • in Trellises: The Viterbi and BCJR Algorithms
  • in Graphs: The Sum-Product Algorithm
• Monte Carlo methods
• Basics of supervised learning
• Capacity of a neuron