Join CNET.com.au: Receive free newsletters, post to forums and win prizes. Sign up now!

Start-up lets you fix focus after snapping the shutter

By Stephen Shankland on 29 February 2008

Tags: digital camera | focus | imaging | light field | refocus | sensor | software | stanford | image | lens

It's one of the oldest, most common problems in photography: that picture you thought would be the prize shot is out of focus.

Mouse over the image and move the slider to see how the point of focus can be changed.

Refocus Imaging, a Silicon Valley start-up, thinks its technology can be used to make cameras that can fix that problem -- after you take the photo.

By fitting a camera's image sensor with a special lens and then processing the resulting data with new methods, Refocus Imaging's technology will let photographers fix their photos and exercise new creative control after the shutter is released, founder and Chief Executive Ren Ng said.

"There's a lot of physical stuff in the camera that is limiting its performance," Ng said. "What we're doing is to capture much more than a two-dimensional photograph inside the camera ... By collecting the light, we can process it in software to do what the hardware usually has to do."

And the technology boosts some aspects of camera performance in the process, he said. Ng said he hopes to license it to camera companies, and boasts that Refocus Imaging's patent portfolio is "very, very good."

The technology, which stems from Ng's research at Stanford University, is an example of computational photography, which augments traditional image capture with computers -- either in the camera or on a PC -- to achieve new possibilities.

Mouse over the image and move the slider to see how the point of focus can be changed.

Included here are examples from Refocus Imaging that show how the technology works. The slider on the right of each graphic can be used to change the point of focus from foreground elements to those in the background, or clicking on a different area will bring it into focus.

Ng also showed the technology off at the 6sight digital-imaging conference in November.

The way Ng sees it, the Refocus Imaging technique has several possible advantages. For one thing, being able to focus images after the fact means that cameras could take a picture sooner without waiting for an autofocus mechanism to lock in. For another, because the depth of field also is adjustable along with focus, a pro photographer could fine-tune a picture to properly blur a background or get just the right amount of a subject in focus.

"One way to think of it is just a raw image, except to the nth degree," Ng said, referring to the raw images that higher-end cameras can record directly from the image sensor, leaving processing choices to the photographer. "It contains a ton more information than a raw picture today. There are all kinds of creative controls you couldn't even conceive of now."

Another advantage is that the technology works better in low light, he said. And by transforming the light's optical properties using a computer instead of relying just on the camera's lenses, a computing system can correct aberrations to improve lens sharpness, as well as heighten lens contrast and lower its manufacturing costs.

Mouse over the image and move the slider to see how the point of focus can be changed.

Sounds swell, right? Well, there's still no thing as a free lunch.

A lot more image processing is required, for one thing, though Ng legitimately points out that camera processors are steadily improving. Another big drawback is that the full resolution of the image sensor isn't available in the ultimate image the camera produces.

Ng isn't willing to discuss exactly how much resolution is lost in the process at this stage in the company's research. "You can get gorgeous 4x6 prints or (larger), and take those much more dependably," he said.

Refocus Imaging's ideas are related to an image sensor that can see in 3D, in a sense, that another Stanford researcher, Keith Fife, demonstrated earlier this month. That sensor also uses tiny lenses, but his are built directly into the sensor, with one lens dedicated to a particular subarray of sensor pixels.

Ng's company is one of several organisations researching the idea of the "light field," which describes all the light entering a camera, not just the subset that gets photographed with a particular camera setting. Ng offers an analogy: where a photograph is like an X-ray image, the light field is like a three-dimensional CT scan that lets a doctor effectively look at the interior of a person from any direction.

One light field research project at Stanford in the 1990s used an array of 100 cameras all taking a photo of the same subject, then compressing the resulting image data into a representation of the light field. With Refocus Imaging's technology, Ng said, "we can make that compression in a single device."

shegzy
03/03/2008 10:43 PM

its beautiful and creative

Report offensive content

  • Leave a comment

All fields marked with * are required

What do you think

Your e-mail will not be displayed

You must read and type the 6 chars within 0..9 and A..F

You must read and type the 6 chars.


  • News

  • Features

  • Oi!

  • Must read

More news »

Find the right digital camera

Brand
  • Multiple options can be selected

    • Kodak EasyShare Z8612 IS

      Kodak EasyShare Z8612 IS

      The Kodak EasyShare Z8612 IS has trimmed off every gram of fat, but the 12x zoom lens overbalances the camera. It oozes understated élan and even has some clever features, but the performance isn't quite there.

    • Nikon D700

      Nikon D700

      Boasting many of the internal bits from the professional-spec (and professionally priced) D3, the D700 is an (almost) affordable full-frame dSLR. It faces up to the Canon 5D with a 12.1-megapixel CMOS sensor, 51 auto-focussing points, 5fps or 8fps shooting depending on battery and mini-HDMI out.

    • Kodak EasyShare V1073

      Kodak EasyShare V1073

      Don't be fooled by its contemporary metal design: the heart of this disappointing camera is pure plastic.

    • Nikon Coolpix P60

      Nikon Coolpix P60

      Taking on the popular Canon A720 IS with its update to the P50, Nikon's Coolpix P60 includes some non-trivial enhancements, including optical image stabilisation, an electronic viewfinder, and an increase in the zoom range to 5x up from 3.5x.

    • Samsung i8

      Samsung i8

      Aimed at amateurs, the Samsung i8 is a user-friendly digital camera with strong multimedia functionality and helpful how-to guides. Slow performance and the sometimes frustrating logic of the main menu will mean this is probably one to skip unless you're interested in the bare basics.

    More reviews »

    Membership benefits

    Win prizes and other promotion benefits

    Win prizes and other promotion benefits

    As a CNET.com.au member, you're eligible to enter and win any prizes on our site. Sign up for a free CNET.com.au membership now!