Loading...
Entropy of English text: Experiments with humans and a machine learning system based on rough sets
Moradi, Hamid Grzymala-Busse, Jerzy W. Roberts, James A.
Moradi, Hamid
Grzymala-Busse, Jerzy W.
Roberts, James A.
Citations
Altmetric:
Abstract
The goal of this paper is to show the dependency of the entropy of English text on the subject of the experiment, the type of English text, and the methodology used to estimate the entropy. Claude Shannon first described the technique for estimating the entropy of English text by a human subject guessing the next letter after viewing a string of characters taken from actual text. We show how this result is affected by using different humans in the experiment (Shannon used only his wife) and by using different types of text material (Shannon used only a single book). We also show how the results are affected when we replace the human subjects with a machine learning system based on rough sets. Automating the play of the guessing game with this system, called LERS, gives rise to a lossless data compression scheme. (C) Elsevier Science Inc. 1998.
Description
Date
1998-01
Journal Title
Journal ISSN
Volume Title
Publisher
ELSEVIER SCIENCE INC
Research Projects
Organizational Units
Journal Issue
Keywords
Computer science, Information systems
Citation
Moradi, H; GrzymalaBusse, JW; Roberts, JA. Entropy of English text: Experiments with humans and a machine learning system based on rough sets. INFORMATION SCIENCES. Jan 1998. 104:31-47.