Advertisements
Advertisements

Advertisements

Pelican PiCam, for slimmer high performance cameras.

| September 8, 2014 | 8 Replies

Screen Shot 2014-09-08 at 10.57.47

 

I guess this goes as part 3 of our quest of high quality cameras against the challenge of slim, bump reduced/free phones.

Related:

http://mynokiablog.com/2014/09/06/could-we-ever-see-a-phone-camera-sensor-as-big-as-the-one-in-the-nokia-808-pureview/

http://mynokiablog.com/2014/09/07/leakyleak-4-7-iphone-6-with-camera-bump-junk-in-trunk-to-be-trendy-hands-on-demoes/

This popped up on reddit over the weekend. Oddly at a similar time to a comment by Rob Beijendorf which mentioned Pelican’s slimmer modules. Nokia prior to the DS buyout had invested into Pelican Imaging. Harlow is constantly praising the research Nokia Imaging peeps do regarding both hardware and computational imaging.

It’s the 16 array camera that provides a lot of depth information. But it’s so much more.

  • The traditional lens is divided into 16 lenses, each with a particular aperture.
  • Each lens corresponds to a subsensor and underlying sensor array
  • Each subsensor is independently controlled
  • Individual sensors are optically isolated
  • Colour filters are a single colour for each camera, eliminating colour cross talk.
  • The raw data is read out and processed that synthesises a high resolution colour image, which also produces a depth map.

Screen Shot 2014-09-08 at 11.15.50

Production of a high res image:

 

Differences in parallax must be corrected. There’s slightly different view points for each camera and software cuts that out.

Without correction, it would look like a bit of a blur with images slightly superimposed.

Screen Shot 2014-09-08 at 11.17.08

To correct this, they compute a depth map.

Screen Shot 2014-09-08 at 11.18.25

Here’s the corrected image side by side with the raw image.

Screen Shot 2014-09-08 at 11.19.16

After depth information, the restoration stage can begin. Pixels are fused from each of the 16 low resolution cameras into a high resolution grid. Screen Shot 2014-09-08 at 11.19.47

Below, it’s just the green channel.Screen Shot 2014-09-08 at 11.20.44

The above is just a small subsection.

 

Once fused onto a common grid, the remaining holes are filled.Screen Shot 2014-09-08 at 11.21.43

Advertisements

These are the ‘filled in holes’

Screen Shot 2014-09-08 at 11.23.16

This is further refined with the map restoration algorithm to form an optimal reconstruction of the original scene.
Screen Shot 2014-09-08 at 11.24.15

Finally, the colour is restored.

Screen Shot 2014-09-08 at 11.25.00

Things we’ve seen before?

  • With 16 cameras, PiCam can produce a picture of different depth information. So focusing afterwards. Instead of the way Nokia camera takes multiple photos at different focus point, the 16 cameras can all take individual focus points, correct the image and produce a picture that you can focus afterwards.
  • Everything is in focus but you can also create synthetic focus effects.

Screen Shot 2014-09-08 at 11.27.06

PiCam can refocus video as well.

Screen Shot 2014-09-08 at 11.29.01

There’s virtual view points. A sort of 3D view as you can pan up/down/left/right and see around objects etc.

The motion parallax gives a sense of depth. No special glasses or screen necessary.

Screen Shot 2014-09-08 at 11.29.45

The depth information and image can also be used to create 3D objects/improved augmented reality.

Screen Shot 2014-09-08 at 11.30.52

 

Concerns?

  • What will the actual performance be like?
  • What about low light?
  • What about action shots?
  • How much detail can we get?
  • What about OIS? (Some comments in youtube video suggested further computational IS)

 

Advertisements

Category: Lumia, Nokia

About the Author ()

Hey, thanks for reading my post. My name is Jay and I'm a medical student at the University of Manchester. When I can, I blog here at mynokiablog.com and tweet now and again @jaymontano. We also have a twitter and facebook accounts @mynokiablog and  Facebook.com/mynokiablog. Check out the tips, guides and rules for commenting >>click<< Contact us at tips(@)mynokiablog.com or email me directly on jay[at]mynokiablog.com