Wiener, N. (1954).
Information is a name for the content of what is exchanged with the outer world as we adjust to it, and make our adjustment felt upon it. The process or receiving and of using information is the process of our adjusting to the contingencies of the outer environment, and of our living effectively within the environment (p. 27).
Just as the entropy is a measure of disorganization, the information carried by a set of messages is a measure of organization. In fact, it is possible to interpret the information carried by a message as essentially the negative of entropy, and the negative logarithm of its probability. That is, the more probable the message, the less information it gives. Cliches, for example, are less illuminating than great poems.
http://www.brint.com/wwwboard/messages/1532.html
*William Least Heat Moon
