Entropy of English text: Experiments with humans and a machine learning system based on rough sets

View/ Open
Issue Date
1998-01Author
Moradi, Hamid
Grzymala-Busse, Jerzy W.
Roberts, James A.
Publisher
ELSEVIER SCIENCE INC
Format
60449 bytes
Type
Article
Metadata
Show full item recordAbstract
The goal of this paper is to show the dependency of the entropy of English text on the subject of the experiment, the type of English text, and the methodology used to estimate the entropy. Claude Shannon first described the technique for estimating the entropy of English text by a human subject guessing the next letter after viewing a string of characters taken from actual text. We show how this result is affected by using different humans in the experiment (Shannon used only his wife) and by using different types of text material (Shannon used only a single book). We also show how the results are affected when we replace the human subjects with a machine learning system based on rough sets. Automating the play of the guessing game with this system, called LERS, gives rise to a lossless data compression scheme. (C) Elsevier Science Inc. 1998.
Collections
Citation
Moradi, H; GrzymalaBusse, JW; Roberts, JA. Entropy of English text: Experiments with humans and a machine learning system based on rough sets. INFORMATION SCIENCES. Jan 1998. 104:31-47.
Items in KU ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
We want to hear from you! Please share your stories about how Open Access to this item benefits YOU.