Are doodles the key to an effective search?

By Michael Kanellos on 05 October 2004

Tags: icon

Researchers in southern California are developing a technology to tag files with arbitrary graphics so that searches can take advantage of the way the brain processes images.

Do you remember faces better than names? A team of university researchers is developing software that applies the same phenomenon to PCs.

VisualID is an experimental program that seeks to help individuals more rapidly find their word files or spreadsheets by tagging them with graphical -- and largely arbitrary -- icons.

A snowflake with pop artist Peter Max overtones, for instance, might represent a document listing the members of an organization, while a dachshund-with-a-hat doodle might become the visual mnemonic for the household expense file.

The principle behind VisualID is that humans can remember pictures better than words, and can navigate faster and easier with distinct, individual images than with generic icons (like the consistent, omnipresent "W" that tags Microsoft Word documents).

"Our visual brains 'suck up' the appearance of everything we see. It doesn't require effort or even conscious thought. We just do it, all the time," J.P. Lewis, a researcher at the University of Southern California and the principal author of the project, wrote in an email interview. Researchers at USC and at the Massachusetts Institute of Technology are cooperating on the project.

The quest for better desktop navigation is as old as the computer industry itself. Mice, graphical Oases and directories have all helped simplify PC controls. More recently, Google, Apple Computer, Microsoft and others have announced plans to release search tools that will scour hard drives for files, although Microsoft recently delayed its project.

The appeal of VisualID is that it takes advantage of the familiarity of the graphical icons concept and the hardwiring of human psychology. The program won't replace text file names -- just enhance them.

"Visuals always help," said Jerry Tarasofksky, CEO of iPerceptions, which analyses Web sites for large companies. "When you are looking for shoes, an icon is so much clearer than 'shoes.'"

One of the more intriguing findings with VisualID has been that the icons themselves don't have to be meaningful for people to remember them. A squiggly sea monster-like icon can just as easily represent a file outlining monthly sales figures or a stored URL on beach vacations.

It turns out that "scenery" of this sort is not used by the brain for data visualisation but instead enables visual search and memory, according to Lewis. The icons of VisualID can relate to each other. The program fashions similar icons for files with similar names, and icons can be grouped under a thematic meta-icon. But, overall, no intrinsic connection between content of the file and doodle exists.

"We cannot always guess the appearance of a book due to arrive in the mail from knowledge of its subject matter, but its somewhat arbitrary appearance is almost instantly learned and remembered once we see it," Lewis writes. "I think the realisation that relating the visuals to content is not necessary is one of our bigger contributions."

Doodle away, maestro
VisualID icons, called doodles, expand on the icon vocabulary in software today. Applications on PCs typically sport icons -- like the script triangle that signifies Adobe Acrobat files -- but the icon stays the same for each document or file created with that application. VisualID gives each file its own distinct symbol automatically.

While the shape of an icon is random, the program creates mutations of an original icon if a new file shares a similar name. The icons differ from each other by shape, but colour may be added as a future identifier.

Determining what makes a good icon remains a challenge. The VisualID icons are deliberately complex to avoid confusion and overlapping imagery, but also try avoid excessive complexity. The group adopted the Kolmogorov definition of complexity, which says that an object is complex to the extent that each part of it is unpredictable given the other parts.

"A humanised version of the definition would be: How many words would it take someone to describe a particular icon to someone else over the phone with enough detail that it could be picked out from among other icons of the same general sort?" Lewis said. For instance, a triangle is easily identifiable, but there aren't enough simple shapes like this for the thousands of files inside the average PC. A circle containing random dots is clearly distinct and individual, but nearly impossible to remember with precision.

A look at results
Surprisingly, people can keep many squiggly figures in mind. "In one study, people were able to form much better than chance recognition memory for a set of 100 of these icons after seeing them once for a few seconds each," Lewis wrote. "The brain is finite, so there is some limit to how many icons can be learned, depending on how long a person spends working with the icons...I would guess that this number is in the several hundreds to several thousands range."

Fortunately, not all of the figures have to be kept at the forefront of the mind. Because most people access just a few files during a given period -- and often never access many files after a relevant period again -- only a few files need be actively recognised at any given time.

It's too soon to tell whether the VisualID work will influence the future development of software. But early tests indicate that the system works. In one experiment, VisualID users took 25.2 seconds on average to conduct four file searches versus 30.5 seconds for those seeking with generic icons. In another experiment, subjects recalled VisualID tags 37 percent of the time a day later, as opposed to 24 percent of the time with generic markers.

Subjects contacted six weeks after the study were able to still correctly identify previously seen icons (as opposed to icons they weren't shown in the experiment) 80 percent of the time, according to researchers.

Like this article? Click below to send it to your mobile for free!

Be the first to comment on this article!

  • Leave a comment

All fields marked with * are required

What do you think

Your e-mail will not be displayed

You must read and type the 6 chars within 0..9 and A..F

You must read and type the 6 chars.


  • How to share files between Office and iWork

  • Dragon NaturallySpeaking 10 Preferred

  • Apple iCal: An insiders guide

  • Free Speed: Make your Mac faster

  • Aussies pay more for Adobe Acrobat 9

  • Google Docs gets limited PDF support

  • Adobe Acrobat 9 Pro Extended

  • Google trials new Gmail features

  • Adobe Acrobat takes big online leap

More articles »

Find the right software

Brand
  • Multiple options can be selected

    The Explain Series

    • Dragon NaturallySpeaking 10 Preferred

      Dragon NaturallySpeaking 10 Preferred

      Dragon NaturallySpeaking 10 isn't perfect, but it's the best dictation software available. We don't find this upgrade necessary for the most basic dictation, although new features may benefit heavily-accented English speakers and those who rely heavily on voice commands.

    • Adobe Acrobat 9 Pro Extended

      Adobe Acrobat 9 Pro Extended

      Adobe Acrobat 9 document-creation software is adding dynamic features such as integration of animation, dynamic maps, 256-bit encryption, and improved forms. We've been playing with the beta edition of Acrobat 9 Pro Extended.

    • Quickbooks QBi 2008/2009

      Quickbooks QBi 2008/2009

      Existing users of Reckon's line of accounting packages have the best reason in years to upgrade with the QBi series. New users should find the attractive pricing of the entry-level versions pretty compelling too.

    • Mozilla Thunderbird 2

      Mozilla Thunderbird 2

      Thunderbird 2 provides a compelling option for users looking for an open source e-mail client.

    • Microsoft Office 2008 for Mac (Special Media Edition)

      Microsoft Office 2008 for Mac (Special Media Edition)

      Office 2008 for Mac may be the best pick for business users, but most people can get by with less expensive alternatives.

    More reviews »

    Membership benefits

    Create wishlists

    Create wishlists

    See a product on CNET.com.au that you want? Add it to your wishlist and send a hint to your friends and family. Sign up for a free CNET.com.au membership now!