Science News
from research organizations

Do computers understand art?

Date:
December 25, 2009
Source:
FECYT - Spanish Foundation for Science and Technology
Summary:
Mathematical algorithms can provide clues about the artistic style of a painting. The composition of colors or certain aesthetic measurements can already be quantified by a computer, but machines are still far from being able to interpret art in the way that people do.
Share:
       
FULL STORY

This a painting of a seated woman with bent knee by Egon Schiele (1917).
Credit: Egon Schiele

A team of researchers from the University of Girona and the Max Planck Institute in Germany has shown that some mathematical algorithms provide clues about the artistic style of a painting. The composition of colours or certain aesthetic measurements can already be quantified by a computer, but machines are still far from being able to interpret art in the way that people do.

How does one place an artwork in a particular artistic period? This is the question raised by scientists from the Laboratory of Graphics and Image in the University of Girona and the Max Planck Institute for Biological Cybernetics, in Germany. The researchers have shown that certain artificial vision algorithms mean a computer can be programmed to "understand" an image and differentiate between artistic styles based on low-level pictorial information. Human classification strategies, however, include medium and high-level concepts.

Low-level pictorial information encompasses aspects such as brush thickness, the type of material and the composition of the palette of colours. Medium-level information differentiates between certain objects and scenes appearing in a picture, as well as the type of painting (landscape, portrait, still life, etc.). High-level information takes into account the historical context and knowledge of the artists and artistic trends.

"It will never be possible to precisely determine mathematically an artistic period nor to measure the human response to a work of art, but we can look for trends," said Miquel Feixas, one of the authors of the study, published in the journal Computers and Graphics.

The researchers analysed various artificial vision algorithms used to classify art, and found that certain aesthetic measurements (calculating "the order" of the image based on analysing pixels and colour distribution), as well as the composition and diversity of the palette of colours, can be useful.

The team also worked with people with little knowledge of art, showing them more than 500 paintings done by artists from 11 artistic periods. The participants were "surprisingly good" at linking the artworks with their corresponding artistic period, showing the high capacity of human perception.

Beyond the implications for philosophy and art, the scientists want to apply their research in developing image viewing and analysis tools, classifying and searching for collections in museums, creating public informative and entertainment equipment, and in order to better understand the interactions between people, computers and works of art.

Beauty, order and complexity

The earliest work of this kind was done in 1933, when the mathematician George D. Birkhoff tried to formalise the notion of beauty with an aesthetic measurement defined as the relationship between order and complexity. After this, the philosopher Max Bense converted this into a measurement of information based on entropy (disorder or diversity).

According to Bense, the creative process is a selective process ("to create is to select"), within a range of elements (a palette of colours, sounds, phonemes, etc.). The creative process can be seen as channel for transmitting information between the palette and the artist and the objects or features of an image. This concept provides a powerful tool for analysing composition and the visual attention ("saliency") of a painting.


Story Source:

The above post is reprinted from materials provided by FECYT - Spanish Foundation for Science and Technology. Note: Materials may be edited for content and length.


Journal Reference:

  1. Wallraven et al. Categorizing art: Comparing humans and computers. Computers & Graphics, 2009; 33 (4): 484 DOI: 10.1016/j.cag.2009.04.003

Cite This Page:

FECYT - Spanish Foundation for Science and Technology. "Do computers understand art?." ScienceDaily. ScienceDaily, 25 December 2009. <www.sciencedaily.com/releases/2009/12/091223094738.htm>.
FECYT - Spanish Foundation for Science and Technology. (2009, December 25). Do computers understand art?. ScienceDaily. Retrieved August 30, 2015 from www.sciencedaily.com/releases/2009/12/091223094738.htm
FECYT - Spanish Foundation for Science and Technology. "Do computers understand art?." ScienceDaily. www.sciencedaily.com/releases/2009/12/091223094738.htm (accessed August 30, 2015).

Share This Page: