Featured Research

from universities, journals, and other organizations

Finding Patterns Of Importance In A Deluge Of Data

Date:
January 10, 2007
Source:
Dartmouth College
Summary:
Two Dartmouth engineers think that PQS, or process query systems, are the way to go to make sense of the huge volume of data we collect each day from computer network monitors, video surveillance cameras, financial transaction records, databases of email exchanges, etc. The duo present their case in a paper published in the January 2007 issue of the journal IEEE Computer.

Vince Berk (left) and George Cybenko.
Credit: Photo by Joseph Mehling

Dartmouth engineers George Cybenko and Vincent Berk think that PQS, or process query systems, are the way to go to make sense of the huge volume of data we collect each day from computer network monitors, video surveillance cameras, financial transaction records, databases of email exchanges, etc. The duo present their case in a paper published in this month's IEEE Computer, the flagship magazine of the Institute of Electrical and Electronics Engineers' Computer Society.

"PQS closes the gap between gathering a tremendous amount of valuable data and figuring out what the data means," says Cybenko, the Dorothy and Walter Gramm Professor of Engineering at Dartmouth's Thayer School of Engineering.

PQS has been an evolving algorithmic and software framework for the past few years. Cybenko and Berk say that PQS is a useful and incredibly powerful tool to quickly analyze credit reports for ID theft, discover attacks on computer networks, and measure activity at, say, national borders, mall parking lots, or wildlife refuge areas. According to Cybenko, "PQS can do for discrete, categorical data analysis problems what classical times series analysis did for finance and control systems where the data are numerical."

It is based on the premise that sensed environments, be they computer networks, email traffic, or high-security buildings, all consist of processes with distinct states, dynamics, and observables. PQS works to detect and understand the changes or irregularities in these processes. The PQS software is easily installed with the sensor equipment to collect, monitor, and sort out a great deal of data.

"I think the most interesting application of PQS to date is in network security monitoring," says Vincent Berk, research associate and lecturer at Dartmouth's Thayer School. "Network administrators have many options when it comes to monitoring tools, however none of them are integrated; and, while all of them produce useful information, it's often in hugely impractical quantities. PQS brings together the information, and effectively focuses on the most important issues first. To my knowledge there has not been a new software technology that is this versatile since the introduction of relational databases."

This work is a project of Dartmouth's Institute for Security Technology Studies, and it is supported in part by funding from the US Department of Homeland Security, Science and Technology Directorate, and the Department of Defense (DTO, AFRL, and DARPA).


Story Source:

The above story is based on materials provided by Dartmouth College. Note: Materials may be edited for content and length.


Cite This Page:

Dartmouth College. "Finding Patterns Of Importance In A Deluge Of Data." ScienceDaily. ScienceDaily, 10 January 2007. <www.sciencedaily.com/releases/2007/01/070109171355.htm>.
Dartmouth College. (2007, January 10). Finding Patterns Of Importance In A Deluge Of Data. ScienceDaily. Retrieved April 16, 2014 from www.sciencedaily.com/releases/2007/01/070109171355.htm
Dartmouth College. "Finding Patterns Of Importance In A Deluge Of Data." ScienceDaily. www.sciencedaily.com/releases/2007/01/070109171355.htm (accessed April 16, 2014).

Share This



More Computers & Math News

Wednesday, April 16, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Google Patents Contact Lens Cameras; Internet Is Wary

Google Patents Contact Lens Cameras; Internet Is Wary

Newsy (Apr. 15, 2014) Google has filed for a patent to develop contact lenses capable of taking photos. The company describes possible benefits to blind people. Video provided by Newsy
Powered by NewsLook.com
NYPD Ends Muslim Surveillance Program

NYPD Ends Muslim Surveillance Program

AP (Apr. 15, 2014) The New York City Police Department has ended a program that once kept tabs on the city's muslim population. (April 15) Video provided by AP
Powered by NewsLook.com
Images Of Rumored Amazon Smartphone Leaked

Images Of Rumored Amazon Smartphone Leaked

Newsy (Apr. 15, 2014) BGR has leaked images of what could be Amazon's smartphone. The outlet's been right about Amazon leaks before. Sources expect an announcement in June. Video provided by Newsy
Powered by NewsLook.com
The Walking, Talking Oil-Drigging Rig

The Walking, Talking Oil-Drigging Rig

Reuters - Business Video Online (Apr. 15, 2014) Pennsylvania-based Schramm is incorporating modern technology in its next generation oil-drigging rigs, making them smaller, safer and smarter. Ernest Scheyder reports. Video provided by Reuters
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins