Featured Research

from universities, journals, and other organizations

What was that again? A mathematical model of language incorporates the need for repetition

Date:
August 29, 2011
Source:
American Institute of Physics
Summary:
Human language can appear to be a chaotic and confusing jumble of words. Fortunately, order -- or loss of entropy -- may increase in a predictable and mathematically consistent manner if communication lines are left open long enough.

As politicians know, repetition is often key to getting your message across. Now a former physicist studying linguistics at the Polish Academy of Sciences has taken this intuitive concept and incorporated it into a mathematical model of human communication.

Related Articles


In a paper in the AIP's journal Chaos, Łukasz Dębowski mathematically explores the idea that as humans we often repeat ourselves in an effort to get the story to stick. Using statistical observations about the frequency and patterns of word choice in natural language, Dębowski develops a model that shows repetitive patterns emerging in large chunks of speech.

Previous researchers have noted that long texts have more entropy, or uncertainty, than very brief statements. This tendency to higher entropy would seem to suggest that only through brevity could humans hope to build understanding -- uttering short sentences that won't confuse listeners with too much information. But as long texts continue to get longer, the increase in the entropy starts to level off.

Dębowski connects this power-law growth of entropy to a similar power-law growth in the number of distinct words used in a text. The two concepts -- entropy and vocabulary size -- can be related by the idea that humans describe a random world, but in a highly repetitive way. Dębowski shows this by examining a block of text as a dynamic system that moves from randomness toward order through a series of repetitive steps. He theorizes that if a text describes a given number of independent facts in a repetitive way then it must contain at least the same number of distinct words that occur in a related repetitive fashion. What this reveals is that language may be viewed as a system that fights a natural increase in entropy by slowly constructing a framework of repetitive words that enable humans to better grasp its meaning.

For now the research is theoretical, but future work could experimentally test how closely it describes real texts, and maybe even candidates' stump speeches.


Story Source:

The above story is based on materials provided by American Institute of Physics. Note: Materials may be edited for content and length.


Cite This Page:

American Institute of Physics. "What was that again? A mathematical model of language incorporates the need for repetition." ScienceDaily. ScienceDaily, 29 August 2011. <www.sciencedaily.com/releases/2011/08/110829114908.htm>.
American Institute of Physics. (2011, August 29). What was that again? A mathematical model of language incorporates the need for repetition. ScienceDaily. Retrieved March 28, 2015 from www.sciencedaily.com/releases/2011/08/110829114908.htm
American Institute of Physics. "What was that again? A mathematical model of language incorporates the need for repetition." ScienceDaily. www.sciencedaily.com/releases/2011/08/110829114908.htm (accessed March 28, 2015).

Share This


More From ScienceDaily



More Mind & Brain News

Saturday, March 28, 2015

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

AAA: Distracted Driving a Serious Teen Problem

AAA: Distracted Driving a Serious Teen Problem

AP (Mar. 25, 2015) While distracted driving is not a new problem for teens, new research from the AAA Foundation for Traffic Safety says it&apos;s much more serious than previously thought. (March 25) Video provided by AP
Powered by NewsLook.com
Smartphone Use Changing Our Brain and Thumb Interaction, Say Researchers

Smartphone Use Changing Our Brain and Thumb Interaction, Say Researchers

Reuters - Innovations Video Online (Mar. 25, 2015) European researchers say our smartphone use offers scientists an ideal testing ground for human brain plasticity. Dr Ako Ghosh&apos;s team discovered that the brains and thumbs of smartphone users interact differently from those who use old-fashioned handsets. Jim Drury went to meet him. Video provided by Reuters
Powered by NewsLook.com
Many Don't Know They Have Alzheimer's, But Their Doctors Do

Many Don't Know They Have Alzheimer's, But Their Doctors Do

Newsy (Mar. 24, 2015) According to a new study by the Alzheimer&apos;s Association, more than half of those who have the degenerative brain disease aren&apos;t told by their doctors. Video provided by Newsy
Powered by NewsLook.com
A Quick 45-Minute Nap Can Improve Your Memory

A Quick 45-Minute Nap Can Improve Your Memory

Newsy (Mar. 23, 2015) Researchers found those who napped for 45 minutes to an hour before being tested on information recalled it five times better than those who didn&apos;t. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Health & Medicine

Mind & Brain

Living & Well

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins