Difference between revisions of "161-A3.1"
Jump to navigation
Jump to search
| Line 24: | Line 24: | ||
|- | |- | ||
! scope="row" | Low | ! scope="row" | Low | ||
| − | | | + | | 1/16 |
| − | | | + | | 1/8 |
| − | | | + | | 1/32 |
| − | | | + | | 1/32 |
|- | |- | ||
! scope="row" | Medium | ! scope="row" | Medium | ||
| − | | | + | | 1/16 |
| − | | | + | | 1/16 |
| − | | | + | | 1/16 |
| − | | | + | | 1/16 |
|- | |- | ||
! scope="row" | High | ! scope="row" | High | ||
| − | | | + | | 1/4 |
| − | | | + | | 0 |
| − | | | + | | 0 |
| − | | | + | | 0 |
|- | |- | ||
|} | |} | ||
| Line 50: | Line 50: | ||
== Example 4: The Binary Symmetric Channel (BSC) == | == Example 4: The Binary Symmetric Channel (BSC) == | ||
| + | |||
| + | == Sources == | ||
| + | * Yao Xie's [https://www2.isye.gatech.edu/~yxie77/ece587/Lecture2.pdf slides] on Entropy and Mutual Information | ||
Revision as of 09:22, 29 September 2020
- Activity: Mutual Information and Channel Capacity
- Instructions: In this activity, you are tasked to
- Walk through the examples.
- Calculate the channel capacity of different channel models.
- Should you have any questions, clarifications, or issues, please contact your instructor as soon as possible.
Contents
Example 1: Mutual Information
Given the following probabilities:
| A | B | AB | O | |
|---|---|---|---|---|
| Very Low | 1/8 | 1/16 | 1/32 | 1/32 |
| Low | 1/16 | 1/8 | 1/32 | 1/32 |
| Medium | 1/16 | 1/16 | 1/16 | 1/16 |
| High | 1/4 | 0 | 0 | 0 |
Example 2: A Noiseless Binary Channel
Example 3: A Noisy Channel with Non-Overlapping Outputs
Example 4: The Binary Symmetric Channel (BSC)
Sources
- Yao Xie's slides on Entropy and Mutual Information
