Google invents a new tool that can make you hear color

Have you ever heard colors?

As part of a new exhibition, the worlds of culture and technology collide, bringing sound to the colors of abstract art pioneer Wassily Kandinsky.

Kandinsky had synesthesia, where looking at colors and shapes causes some with the condition to hear associated sounds. With the help of machine learning, virtual visitors to the Sounds Like Kandinsky exhibition, a partnership project by Centre Pompidou in Paris and Google Arts & Culture, can have an aural experience of his art.

An eye for music

Kandinsky’s synesthesia is thought to have heavily influenced his painting. Seeing yellow summoned up trumpets, evoking emotions like cheekiness; reds produced violins portraying restlessness; while organs representing heavenliness he associated with blues, according to the exhibition notes.

Virtual visitors are invited to take part in an experiment called Play a Kandinsky, which allows them to see and hear the world through the artist’s eyes.

In 1925, the artist’s masterpiece, “Yellow, Red, Blue”, broke new ground in the world of abstract art, guiding the viewer from left to right with shifting shapes and shades. Almost a century after it was painted, Google’s interactive tool lets visitors click different parts of the artwork to journey through the artist’s description of the colors, associated sounds and moods that inspired the work.

But Google’s new toy is not the only tool developed to enhance the artistic experience.

Artist Neil Harbisson has developed an artificial way to emulate Kandinsky by turning colors into sounds. He has a rare form of color blindness and sees the world in greyscale. But a smart antenna attached to his head translates dominant colors into musical notes, creating a real-world soundtrack of what’s in front of him. The invention could open up a new world for people who are color blind.

Reprinted with permission of the World Economic Forum. Read the original article.