Archive for March 9th, 2012

March 9, 2012

Semantics and measurement

by Neil Rickert

There are many different conceptions of “information.”  The most important of those is that due to Claude Shannon, and often referred to as “Shannon Information“.  Shannon was particularly concerned with communication and with the problem of avoiding or minimizing loss of information due to transmission over an imperfect channel.

As used today, we typically think of Shannon information being transmitted as a sequence of symbols, often as a stream of binary digits. It is considered to be a theory of syntactic information, since the engineering considerations that motivated Shannon’s work are concerned with delivery of the symbols and questions of what those symbols mean is secondary and outside Shannon’s theory.

read more »