Information theory, which was developed by Claude Shannon starting in the late 1940s, deals with questions such as how quickly information can be sent over a noisy communications channel. Both the ...