IMAGE FUSION

How to Best Utilize Dual Cameras for Enhanced Image Quality

Image Fusion is the process of combining two or more input images into a single image. The main reason for combining the images is to get a more informative output image. In mobile, dual camera Image Fusion comes into play in several ways: The first is related to a dual camera with one color sensor and another monochromatic sensor (with the Bayer filter removed). The monochromatic sensor captures 2.5 times more light, thus reaches better resolution and SNR. By fusing the images coming from both cameras, the output image has better SNR and resolution, especially in low light conditions.
The second is with a zoom dual camera – a wide field-of-view camera coupled with a telephoto narrow field-of-view camera. In this case, Image Fusion will also improve the SNR and resolution from no zoom up to the point the telephoto camera field-of-view is the dominant one. In the following example images it is easy to see the resolution improvement in the fused image vs the standard digital zoom (images were taken with a 3x optical zoom camera).

Download Full White Paper PDF

Image quality

Image quality testing
UI/UX testing
Testing benchmark design and integration

Camera hardware

Compact Lens design
Micro electro-mechanical systems for zoom, auto-focus, optical image stabilization
Diverse actuator technologies and control systems
Environmental and reliability testing in preparation for ultra high volume Manufacturing

Computer Vision

Deep Computer Vision models for: scene understanding, object detection and recognition and tracking; classification; depth analysis
Stereo vision and depth mapping
Image fusion
Dynamic multi aperture calibration
Heterogeneous computing (MT CPU, GPU, DSP, unified-memory architecture)
Mobile camera software architecture
UI/UX design for camera applications