Difference between revisions of "Shannon's Communication Theory"

From Microlab Classes
Jump to navigation Jump to search
Line 2: Line 2:
 
[[File:Shannon comm system.png|thumb|500px|Figure 1: A general communication system<ref name="shannon1948"/>.]]
 
[[File:Shannon comm system.png|thumb|500px|Figure 1: A general communication system<ref name="shannon1948"/>.]]
  
In his landmark 1948 paper<ref name="shannon1948">C. E. Shannon, A Mathematical Theory of Communication, The Bell System Technical Journal, Vol. 27, pp. 379–423, 623–656, July, October, 1948. ([http://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf pdf])</ref>, Claude Shannon developed a general model for communication systems, as well as a framework for analyzing these systems. The model has three components: (1) the sender or source, (2) the channel, and (3) the receiver or sink. The model also includes encoding and decoding blocks, as well the noise of the channel, as shown in Fig. 1.
+
In his landmark 1948 paper<ref name="shannon1948">C. E. Shannon, A Mathematical Theory of Communication, The Bell System Technical Journal, Vol. 27, pp. 379–423, 623–656, July, October, 1948. ([http://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf pdf])</ref>, Claude Shannon developed a general model for communication systems, as well as a framework for analyzing these systems. The model has three components: (1) the sender or source, (2) the channel, and (3) the receiver or sink. The model also includes the transmitter that encodes the message into a signal,  the receiver, for decoding the signal back into a message, as well the noise of the channel, as shown in Fig. 1.
 
 
  
 +
In Shannon's discrete model, the source provides a stream of symbols from a finite alphabet, <math>A=\{a_1, a_2, \ldots,\a_n\}</math>, which are then encoded. The code is sent through the channel, which could be corrupted by noise, and when the code reaches the other end, it is decoded by the receiver, and then the sink extracts information from the steam of symbols.
  
  

Revision as of 16:04, 14 September 2020

A First Look at Shannon's Communication Theory

Figure 1: A general communication system[1].

In his landmark 1948 paper[1], Claude Shannon developed a general model for communication systems, as well as a framework for analyzing these systems. The model has three components: (1) the sender or source, (2) the channel, and (3) the receiver or sink. The model also includes the transmitter that encodes the message into a signal, the receiver, for decoding the signal back into a message, as well the noise of the channel, as shown in Fig. 1.

In Shannon's discrete model, the source provides a stream of symbols from a finite alphabet, , which are then encoded. The code is sent through the channel, which could be corrupted by noise, and when the code reaches the other end, it is decoded by the receiver, and then the sink extracts information from the steam of symbols.


Shannon's Theory for Analog Channels

Kullback-Leibler Information Measure

Sources

References

  1. 1.0 1.1 C. E. Shannon, A Mathematical Theory of Communication, The Bell System Technical Journal, Vol. 27, pp. 379–423, 623–656, July, October, 1948. (pdf)