161-A3.1
Revision as of 09:22, 29 September 2020 by Louis Alarcon (talk | contribs)
- Activity: Mutual Information and Channel Capacity
- Instructions: In this activity, you are tasked to
- Walk through the examples.
- Calculate the channel capacity of different channel models.
- Should you have any questions, clarifications, or issues, please contact your instructor as soon as possible.
Contents
Example 1: Mutual Information
Given the following probabilities:
| A | B | AB | O | |
|---|---|---|---|---|
| Very Low | 1/8 | 1/16 | 1/32 | 1/32 |
| Low | 1/16 | 1/8 | 1/32 | 1/32 |
| Medium | 1/16 | 1/16 | 1/16 | 1/16 |
| High | 1/4 | 0 | 0 | 0 |
Example 2: A Noiseless Binary Channel
Example 3: A Noisy Channel with Non-Overlapping Outputs
Example 4: The Binary Symmetric Channel (BSC)
Sources
- Yao Xie's slides on Entropy and Mutual Information
