Featured Research

from universities, journals, and other organizations

Finding Patterns Of Importance In A Deluge Of Data

Date:
January 10, 2007
Source:
Dartmouth College
Summary:
Two Dartmouth engineers think that PQS, or process query systems, are the way to go to make sense of the huge volume of data we collect each day from computer network monitors, video surveillance cameras, financial transaction records, databases of email exchanges, etc. The duo present their case in a paper published in the January 2007 issue of the journal IEEE Computer.

Vince Berk (left) and George Cybenko.
Credit: Photo by Joseph Mehling

Dartmouth engineers George Cybenko and Vincent Berk think that PQS, or process query systems, are the way to go to make sense of the huge volume of data we collect each day from computer network monitors, video surveillance cameras, financial transaction records, databases of email exchanges, etc. The duo present their case in a paper published in this month's IEEE Computer, the flagship magazine of the Institute of Electrical and Electronics Engineers' Computer Society.

Related Articles


"PQS closes the gap between gathering a tremendous amount of valuable data and figuring out what the data means," says Cybenko, the Dorothy and Walter Gramm Professor of Engineering at Dartmouth's Thayer School of Engineering.

PQS has been an evolving algorithmic and software framework for the past few years. Cybenko and Berk say that PQS is a useful and incredibly powerful tool to quickly analyze credit reports for ID theft, discover attacks on computer networks, and measure activity at, say, national borders, mall parking lots, or wildlife refuge areas. According to Cybenko, "PQS can do for discrete, categorical data analysis problems what classical times series analysis did for finance and control systems where the data are numerical."

It is based on the premise that sensed environments, be they computer networks, email traffic, or high-security buildings, all consist of processes with distinct states, dynamics, and observables. PQS works to detect and understand the changes or irregularities in these processes. The PQS software is easily installed with the sensor equipment to collect, monitor, and sort out a great deal of data.

"I think the most interesting application of PQS to date is in network security monitoring," says Vincent Berk, research associate and lecturer at Dartmouth's Thayer School. "Network administrators have many options when it comes to monitoring tools, however none of them are integrated; and, while all of them produce useful information, it's often in hugely impractical quantities. PQS brings together the information, and effectively focuses on the most important issues first. To my knowledge there has not been a new software technology that is this versatile since the introduction of relational databases."

This work is a project of Dartmouth's Institute for Security Technology Studies, and it is supported in part by funding from the US Department of Homeland Security, Science and Technology Directorate, and the Department of Defense (DTO, AFRL, and DARPA).


Story Source:

The above story is based on materials provided by Dartmouth College. Note: Materials may be edited for content and length.


Cite This Page:

Dartmouth College. "Finding Patterns Of Importance In A Deluge Of Data." ScienceDaily. ScienceDaily, 10 January 2007. <www.sciencedaily.com/releases/2007/01/070109171355.htm>.
Dartmouth College. (2007, January 10). Finding Patterns Of Importance In A Deluge Of Data. ScienceDaily. Retrieved January 31, 2015 from www.sciencedaily.com/releases/2007/01/070109171355.htm
Dartmouth College. "Finding Patterns Of Importance In A Deluge Of Data." ScienceDaily. www.sciencedaily.com/releases/2007/01/070109171355.htm (accessed January 31, 2015).

Share This


More From ScienceDaily



More Computers & Math News

Saturday, January 31, 2015

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

China's "Great Firewall" Frustrates Internet Users

China's "Great Firewall" Frustrates Internet Users

Reuters - News Video Online (Jan. 31, 2015) The Chinese government moves to tighten regulations for virtual private network (VPN) services that are used to access websites and services normally blocked in China. That&apos;s affected many internet users in the country. Yiming Woo reports. Video provided by Reuters
Powered by NewsLook.com
Google Forced To Obey Law, Changes U.K. Privacy Policy

Google Forced To Obey Law, Changes U.K. Privacy Policy

Newsy (Jan. 30, 2015) Google has agreed to make its privacy policy more transparent in compliance with a U.K. law. Video provided by Newsy
Powered by NewsLook.com
Newsweek's Tech Sexism Story: More Than Just A Cover

Newsweek's Tech Sexism Story: More Than Just A Cover

Newsy (Jan. 29, 2015) Some objected to the art for Newsweek&apos;s cover story "What Silicon Valley Thinks of Women," but it&apos;s achieved one mission: getting people talking. Video provided by Newsy
Powered by NewsLook.com
Now Bill Gates Is 'Concerned' About Artificial Intelligence

Now Bill Gates Is 'Concerned' About Artificial Intelligence

Newsy (Jan. 29, 2015) Bill Gates joins the list of tech moguls scared of super-intelligent machines. He says more people should be concerned, but why? Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins