Computational Photography

Computational Photography (n.) The practice of producing a photograph by combining and processing multiple sensor readings with software, rather than relying on a single exposure from a single lens. It’s the reason a $1,200 phone can outshoot a $3,000 mirrorless camera in poor light, and the reason two photos taken a second apart on the same phone can look completely different.

What’s Actually Happening When You Tap the Shutter

On a modern phone, pressing the shutter button doesn’t take one picture. It takes somewhere between 4 and 15 frames, often starting before you even tap, and then blends them into a single output image. Apple calls its version Deep Fusion and Smart HDR. Google calls theirs HDR+ and Night Sight. Samsung has Scene Optimizer. They all do roughly the same thing: capture a burst, align the frames, pick the best parts of each, and stitch them together.

This is why dynamic range on phones now rivals full-frame cameras. A single sensor read on a phone still can’t capture a bright sky and a dark shadow at the same time. But four reads at different exposures can, and the phone blends them so fast you never see the seam. The result is a photo that looks like the scene did to your eyes, which a single-exposure camera often can’t match.

Where Computational Photography Shines

Low light is the killer app. Google’s Night Sight, Apple’s Night Mode, and Samsung’s Nightography can pull a clean, detailed image out of a scene your eye can barely see. They do it by stacking 8 to 15 long exposures and using motion analysis to cancel hand shake between frames. A DSLR in the same conditions would need a tripod and a 10-second shutter; your phone does it handheld in 3 seconds.

Portrait mode is another. Phones physically can’t produce the background blur of a large-sensor camera with a fast lens. Their sensors are too small and their lenses too slow. So they fake it: depth maps from multiple lenses, AI subject detection, and simulated bokeh rendered over the background. At best it’s indistinguishable from the real thing. At worst you get blurred hair and sharpened ears.

Where It Goes Wrong

The tradeoff nobody discusses: computational photography is interpretation, not recording. Two phones pointed at the same scene will produce meaningfully different images, because their algorithms make different choices about what to sharpen, what to smooth, how aggressively to lift shadows, and how much to boost colors. A Google Pixel will often crush contrast and push green grass toward teal. An iPhone will smooth skin tones. A Samsung will oversaturate reds and push sharpening hard.

The other problem is motion. All that frame stacking assumes the scene is mostly still. Shoot a moving subject in low light and you’ll get ghosted limbs, smeared faces, and weird AI artifacts where the phone tried to stitch something it shouldn’t have. Night mode is worthless for sports and wildlife for this exact reason.

Pro Tip

If you want to see what your phone’s sensor actually captured before the computational layer got to it, shoot in RAW (or ProRAW on iPhone, Expert RAW on Samsung). The difference is dramatic. RAW files look flatter, less contrasty, and grainier in shadows, because they’re the honest read. Everything else your phone shows you is a rendered interpretation of that honest read, dressed up to look impressive on social media.

Sebastian Chase
Sebastian Chase

Sebastian Chase is a mobile digital photographer who enjoys trying out new mobile technologies, and figuring out how to get them to deliver high-quality images with minimal effort. Join him on his mission to help mobile photographers create incredible images and videos with their new-age digital cameras, no matter the form that they may take.

Articles: 134