This Algorithm is Better at Recognizing Drawings Than You

Artificial Intelligence  

Researchers have built the first computer program that can recognize hand-drawn sketches better than humans. The system, called Sketch-a-Net, examines the unique characteristics of sketches, particularly the order the strokes were drawn to identify their content.

Researchers from Queen Mary University of London (QMUL) have built the first computer program that can recognize hand-drawn sketches better than humans.

Known as Sketch-a-Net, the program is capable of correctly identifying the subject of sketches 74.9 per cent of the time compared to humans that only managed a success rate of 73.1 per cent.

"Our network on the other hand not only delivers the best performance on the largest human sketch dataset to date, but also is small in size making efficient training possible using just CPUs," write the authors.  Many recent neural networks have been making AI advances using GPU frameworks.

"It’s exciting that our computer program can solve the task even better than humans can."

As sketching becomes more relevant with the increase in the use of touchscreens, the development could provide a foundation for new ways to interact with computers.

Related articles Google's Inceptionism Lets Us Look at an Artificial Intelligence Hallucination  Deep Learning is About to Go Mainstream  Google Simulates Brain Capable Of Detecting Cats On YouTube

The researchers note that touchscreens could understand what you are drawing enabling you to retrieve a specific image by drawing it with your fingers, which is more natural than keyword searches for finding items such as furniture or fashion accessories. The improvement could also aid police forensics when an artist’s impression of a criminal needs to be matched to a mugshot or CCTV database.

The technology may also open up new human-computer interaction methods for devices like smart watches.

The research also demonstrated that the program performed better at determining finer details in sketches. For example, it was able to successfully distinguish the specific bird variants ‘seagull’, ‘flying-bird’, ‘standing-bird’ and ‘pigeon’ with 42.5 per cent accuracy compared to humans that only achieved 24.8 per cent.

Sketch-a-Net is a deep neural network – a type of computer program designed to emulate the processing of the human brain. It is particularly successful because it accommodates the unique characteristics of sketches, particularly the order the strokes were drawn. This was information that was previously ignored but is especially important for understanding drawings on touchscreens.

"It’s exciting that our computer program can solve the task even better than humans can," said Timothy Hospedales, co-author of the study. "Sketches are an interesting area to study because they have been used since pre-historic times for communication and now, with the increase in use of touchscreens, they are becoming a much more common communication tool again. This could really have a huge impact for areas such as police forensics, touchscreen use and image retrieval, and ultimately will help us get to the bottom of visual understanding."

SOURCE  Queen Mary University of London

By 33rd Square

Embed