Featured Research

from universities, journals, and other organizations

What makes Paris look like Paris? Software finds stylistic core

Date:
August 7, 2012
Source:
Carnegie Mellon University
Summary:
Paris is one of those cities that has a look all its own, something that goes beyond landmarks such as the Eiffel Tower or Notre Dame. Researchers have developed visual data mining software that can automatically detect these sometimes subtle features, such as street signs, streetlamps and balcony railings, that give Paris and other cities a distinctive look.

What details in an ordinary street scene can help identify the city it is in? Carnegie Mellon University researchers have developed software that can automatically identify elements, such as the emblematic street signs, balustrade window and balcony supports indicative of Paris in the upper photos, and the neoclassical entryway, Victorian window and cast iron railings indicative of London in the lower photos.
Credit: Image courtesy of Carnegie Mellon University

Paris is one of those cities that has a look all its own, something that goes beyond landmarks such as the Eiffel Tower or Notre Dame. Researchers at Carnegie Mellon University and INRIA/Ecole Normale Supιrieure in Paris have developed visual data mining software that can automatically detect these sometimes subtle features, such as street signs, streetlamps and balcony railings, that give Paris and other cities a distinctive look.

Related Articles


The software analyzed more than 250 million visual elements gleaned from 40,000 Google Street View images of Paris, London, New York, Barcelona and eight other cities to find those that were both frequent and could be used to discriminate one city from the others. This yielded sets of geo-informative visual elements unique to each city, such as cast-iron balconies in Paris, fire escapes in New York City and bay windows in San Francisco.

The discovered visual elements can be useful for a variety of computational geography tasks. Examples include mapping architectural correspondences and influences within and across cities, or finding representative elements at different geo-spatial scales such as a continent, a city, or a specific neighborhood.

Researchers will present their findings Aug. 9 at SIGGRAPH 2012, the International Conference on Computer Graphics and Interactive Techniques, at the Los Angeles Convention Center.

Alexei Efros, associate professor of robotics and computer science at CMU, noted that although finding patterns in very large databases -- so-called Big Data mining -- is widely used, it has so far been limited to text or numerical data. "Visual Data is much more difficult, so the field of visual data mining is still in its infancy, but I believe it holds a lot of promise. Our data mining technique was able to go through millions of image patches automatically -- something that no human would be patient enough to do," said Efros, who collaborated with colleagues including Abhinav Gupta, assistant research professor of robotics, and Carl Doersch, a Ph.D. student in CMU's Machine Learning Department. "In the long run, we wish to automatically build a digital visual atlas of not only architectural but also natural geo-informative features for the entire planet."

For this study, the researchers started with 25,000 randomly selected visual elements from city images gathered from Google Street View. A machine learning program then analyzed these visual elements to determine which details made them different from similar visual elements in other cities. After several iterations, the software identified the top-scoring patches for identifying a city. For Paris, those patches corresponded to doors, balconies, windows with railings, street signs (the shape and color of the signs, not the street names on the signs), and special Parisian lampposts. It had more trouble identifying geo-informative elements for U.S. cities, which the researches attributed to the relative lack of stylistic coherence in American cities with their melting pot of styles and influences.

"We let the data speak for itself," said Gupta, noting the entire process is automated, yet produces a set of images that convey a better stylistic feel for a city than a set of random images.

Doersch said this process requires a significant amount of computing time, keeping 150 processors working overnight. By comparison, art directors for the 2007 Pixar movie "Ratatouille" spent a week running around Paris taking photos so they could capture the look and feel of Paris in their computer model of the city.


Story Source:

The above story is based on materials provided by Carnegie Mellon University. Note: Materials may be edited for content and length.


Cite This Page:

Carnegie Mellon University. "What makes Paris look like Paris? Software finds stylistic core." ScienceDaily. ScienceDaily, 7 August 2012. <www.sciencedaily.com/releases/2012/08/120807113321.htm>.
Carnegie Mellon University. (2012, August 7). What makes Paris look like Paris? Software finds stylistic core. ScienceDaily. Retrieved October 25, 2014 from www.sciencedaily.com/releases/2012/08/120807113321.htm
Carnegie Mellon University. "What makes Paris look like Paris? Software finds stylistic core." ScienceDaily. www.sciencedaily.com/releases/2012/08/120807113321.htm (accessed October 25, 2014).

Share This



More Computers & Math News

Saturday, October 25, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Real-Life Transformer Robot Walks, Then Folds Into a Car

Real-Life Transformer Robot Walks, Then Folds Into a Car

Buzz60 (Oct. 24, 2014) — Brave Robotics and Asratec teamed with original Transformers toy company Tomy to create a functional 5-foot-tall humanoid robot that can march and fold itself into a 3-foot-long sports car. Jen Markham has the story. Video provided by Buzz60
Powered by NewsLook.com
Microsoft Riding High On Strong Surface, Cloud Performance

Microsoft Riding High On Strong Surface, Cloud Performance

Newsy (Oct. 24, 2014) — Microsoft's Q3 earnings showed its tablets and cloud services are really hitting their stride. Video provided by Newsy
Powered by NewsLook.com
The Best Apps to Organize Your Life

The Best Apps to Organize Your Life

Buzz60 (Oct. 23, 2014) — Need help organizing your bills, schedules and other things? Ko Im (@konakafe) has the best apps to help you stay on top of it all! Video provided by Buzz60
Powered by NewsLook.com
Nike And Apple Team Up To Create Wearable ... Something

Nike And Apple Team Up To Create Wearable ... Something

Newsy (Oct. 23, 2014) — For those looking for wearable tech that's significantly less nerdy than Google Glass, Nike CEO Mark Parker says don't worry, It's on the way. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins