Impact of Sensor Size on Performance — a Contemporary Survey

I am in the middle of a choice between interchangeable lens systems and one of my pressing needs is the selection of a system that lets me have a smaller, lighter camera bag. Now is not a bad time to be shopping for cameras, with so much choice being available across price brackets and IQ variance. As always, having a lot to choose from is another way of getting confused, so I decided to do some objective data analysis to figure out what’s what.

The choice is between 35mm (full frame or FX in Nikon parlance), APS-C, Micro Four-Thirds (MFT) and 1″ (CX in Nikon parlance) sensor platforms. It’s worth noting that there isn’t any FX mirrorless interchangeable lens camera on the market so far, so going FX means using a DSLR with a mirror and built-in OVF. Similarly, there’s only the Nikon 1 system available in the 1″ format.

Crop Factors

Crop factor is the ratio of the field of view between FX and the sensor in question. One of the things it tells is the focal length required on a 35mm sensor for a given focal length on the sensor in question. E.g. the crop factor of APS-C sensors is usually 1.5, which means that a 100mm lens on APS-C would give the same kind of frame as a 150 mm lens on FX.

Crop factor also determines the increase in Depth of Field (DoF) for a given aperture value between FX and the sensor in question. E.g. a 100mm lens at f/4 on APS-C would give the same frame and DoF as a 150mm lens at f/6 on an FX sensor. One thing the crop factor doesn’t change, though, is the metering. A scene that requires 1/100s shutter speed at f/5.6, ISO200 on FX would still require 1/100s at f/5.6, ISO 200 on a CX sensor. I.e., a smaller sensor allows you to shoot at wider apertures and lower ISO or higher shutter speeds for the same DoF.

Lastly, the square of the crop factor indicates how much larger the FX sensor is compared to the sensor in question in terms of surface area. E.g. FX is 1.52 = 2.25 times larger than APS-C sensors.

So, let’s take a look at the crop factors across the systems and see how they compare. Here’s a chart:

CropFactors

 

As you can see, the biggest gap is between FX and APS-C. The smallest is between APS-C and MFT. All of them are fairly close to 1 stop (1.414) so you can assume that you change a stop’s worth of equivalent aperture while going across the spectrum.

These crop factors have interesting consequences. They mean, for example, that a 50mm f/1.8 “normal prime” would behave like a 135mm f/4.9 telephoto lens on a CX camera, except for exposure metrics.

Tonality

Tonality, or colour depth, is the ability of a sensor to distinguish very similar looking colours from one another. This metric is what gives photos from larger sensor cameras that “3D look” while the pictures form cellphones and small cameras look very “flat”. I have pulled the best in class tonality data from DxOMark scores for each format. The chart below shows how they compare.

Tonality

This chart shows an almost linear progression across formats, except that the best CX format sensor (Sony CyberShot RX100) is nearly as good as the best MFT sensor. The good news here is that if you’re looking for colour depth in your photos, you are much better off in 2013 than just 5 years ago. The colour depth of the RX100 (22.6 bits) is about the same as that of the Nikon D90 (22.7 bits), despite the latter having more than 3 times the sensor area.

The not-so-good news, of course, is that an FX sensor is still quite far ahead in terms of tonality, and this becomes especially important if you are a landscape photographer shooting in snow or haze. Portrait photographers would also get much better skin tone gradation with FX sensors.

Dynamic Range

Dynamic Range (DR) is a measure of the maximum variation of light and dark areas in a scene before the sensor loses the ability to resolve colour or tone, rendering the dark areas as greyish black and bright areas as white. DR is especially important for shooting outdoors in daylight or indoors with overhead lighting or spotlights. People who shoot Christian weddings would also want to be careful about the DR of their sensor since they often need to shoot the groom wearing a black suit along with the bride wearing a white dress.

The DR variance, again based on the segment topping sensor scores on DxOMark across formats is shown below.

DynamicRange

This is an interesting chart because the variance in DR doesn’t have any correspondence with the crop factors. The best FX and APS-C sensors are quite close to each other, but there is a huge gap from APS-C to MFT. In fact the RX100 outperforms its MFT siblings in DR despite a sensor that’s almost half as large.

Noise

Now we come to the most important metric for a sensor, i.e. noise performance. We all recognise noise as the speckles and freckles that we see all over a photograph. That is the most visible effect of noise, but it’s not the only one. Noise also reduces a sensor’s tonality and DR quite a bit. What’s even worse, a noisier sensor would also perform worse at its base ISO for long exposures compared to a less noisy sensor.

So what does the Noise progression look like across formats? Well, here it is. No surprises.

MaxISO

The chart above is based on DxOMark‘s listing of ISO measurement at which the degradation in image quality becomes perceptible. I have converted those numbers into “stops” for a more easy comparison. E.g. according to the chart above, the best CX sensor (Nikon 1 V2, in this case) is 3 stops noisier than the best FX sensor (Nikon D3s).

Sensor Performance Conclusions

Based on the above charts, we see that there’s a significant gap between every segment, except MFT and CX, wherein the RX100 is acting as a bit of a leveler, albeit with 1.14 stops poorer noise performance.

If you are an outdoors shooter, it’s probably not a bad idea to downsize since the key metrics for outdoor shooting (Tonality and DR) are far more level across the formats, while the kit size reduction is significant. If you shoot indoors without studio lighting, though, you should strongly consider having a large sensor system.

Another important thing to remember, though, is that today’s sensors in any segment match up to or outperform the sensors of the next segment from 5 years ago across all metrics. If you are satisfied with your 5 year old equipment’s IQ, you are ready to downsize without consequence.

Shooting in the Dark

Digital sensors have made a lot of progress on the light efficiency front. The Nikon D3s sensor, currently the most efficient sensor available, offers amazingly clean images at crazy high ISOs. Something that film shooters could only dream of. There is still some time, however, before a D3s calibre sensor makes it to consumer bodies. Meanwhile, it will help knowing the tips and tricks of shooting in the dark for the win.

Gear

Before proceeding further on the topic, I’d like to say that the best thing to do is simply not shoot in low light. Most low light situations can benefit hugely from an off-camera speedlight bounced from the ceiling or walls. This essentially involves placing a large external flash like the SB-600 somewhere out of your field of view (your camera’s hot shoe is also a good candidate) and pointing it toward the ceiling. You can now happily shoot at ISO 200 and enjoy good, clean images with soft pleasant lighting. The following shot of pizza toppings was made at f/5.6, ISO 400, 1/60s in ambient light provided by 2 11-watt CFLs. Without the flash, this shot would have had less tonality, more noise and perhaps motion blur (corresponding flash-less settings would be something like ISO 3200, 1/8s).

Pizzascape

The other very important piece would be a lens that has a large aperture, i.e. at least f/2.8 or larger. The AF 50mm f/1.8 D Nikkor aka Nifty-Fifty is a good, inexpensive purchase. Beware, though, shooting at very wide apertures places a big ask on focus accuracy because the DoF at large apertures might become too thin to be workable. Auto-focus systems also tend to perform poorly in low light. One useful tip for shooting people with wide apertures is to try and focus on the near eye — eyes are easier for AF systems to lock on, and it gives a natural guide for the viewer of the photograph.

Despite having the best gear, you still might end up in situations where you can’t do anything but bump up the ISO and face the lack of light. That’s where some of the following techniques will help.

Taking the Photographs

1. Exposure vs. ISO

The first time I was faced with shooting in low light, the camera metered some terribly low shutter speed like 1/20s at ISO 640, which is tough to shoot with even in low light. I decided to under-expose by a stop at the same ISO to get up to 1/8s because I didn’t want to hit the limit of the ISO range at 1600. Higher ISO = More Noise, right? Yes, provided the exposure is comparable in both. Under-exposure results in even more noisy photos. My shots from the above-mentioned sequence were all wasted. Here’s a noisy, under-exposed shot. Do you want to guess what ISO the following shot was made at?

Electro-forking-daemon

ISO 100! You can see the effect of -5 EV under-exposure on the noise even in this small version. It would print really horrible on 6″x4″ paper. When you have to choose between underexposing and bumping up the ISO to get to a desired shutter speed, always go for higher ISO. An underexposed, low ISO shot is almost always more noisy than a properly exposed high ISO shot. Here’s another shot where I chose to over-expose +2/3 EV even at ISO 1600, to allow good tonality and saturation. The result speaks for itself.

Tandoori Burra Champ

2. Auto-Focus

Another area that suffers badly in low-light is auto-focus. Most AF systems try to lock in on edges that they find under the focus points where the boundaries appear the sharpest. This turns out to be difficult in low light because the difference in light intensity between light and dark parts of an edge are reduced. Having a speedlight like the SB-600 helps here, because it projects a focusing grid on to the field of view (much like the red grid you might see in supermarket barcode readers). If you find your hardware failing, you could try some of these tricks:

  • Zoom-in; Focus; Zoom-out: This works if you have a zoom lens that’s not “varifocal“, i.e. its focus doesn’t change while zooming in and out. The trick is to zoom all the way in, acquire focus — either manually or automatically — and zoom out to the frame you want. Most of the modern SLR zoom lenses are parfocal. I know that the 18-200mm f/3.5-5.6 VR Nikkor works.
  • Focus and Recompose: Sometimes, we would like to focus on a subject that’s not contrasty enough for AF or manual focus to work. In this case, it might be helpful to focus on a more edgy object at roughly the same distance and recompose. The results are iffy, though. Also, if you are not able to verify exact focus through the camera view-finder, chances are that your photograph would pass on as fairly in focus, anyway.
  • Live View: Most new DSLRs now support Live View feature. Live View can help you a lot when trying to focus manually. Turn on Live View and zoom all the way in on the view. Since you’re zooming in on the image preview and not on the lens itself, this trick works even with non-parfocal lenses. I made the following shot using the same technique in fading daylight. The AF was being tricked too often by the bushes and rubble, and generally being unable to cope with the fast moving bird.

Li'l Birdie

3. People Shots with Slow Sync Flash

One of the most frustrating experiences in low-light shooting is blurry people shots. When your shutter speeds drop to levels below 1/20s, asking people to stand still also doesn’t help. You end up needing to try something else. You also can’t pop the on-board flash because

  1. it gets into people’s eyes (not a problem with ceiling bounce), and
  2. it doesn’t bring out the ambient light properly, leading to an unpleasant photograph.

Issue #2 can be solved by using the flash in “Slow Sync” mode. In this mode, the flash fires for a short time (1/60s) but the shutter stays open for as long as it would have opened without the flash. You can choose whether the flash fires in the beginning of the exposure (Front Curtain Sync) or toward the end (Rear Curtain Sync). Why would you use slow sync instead of just shooting without flash? Because it de-emphasises motion blur that occurs while the flash is not on and captures a sharp outline when the flash pops.

While shooting people in slow sync mode, Rear curtain sync works better than front curtain for two reasons. One, people don’t notice a snap until the flash goes off. In front curtain, they tend to think that the snap is done when the flash goes off and let go of their pose while the shutter is still open. This leading to blurry shots.

Secondly, rear curtain captures motion in the forward direction. You get to see the final position of a moving object most prominently, which is more natural than seeing the starting position of an object and seeing a blur in its later direction of movement.

While using slow-sync, just always remember to disable pre-flashes by using FV lock to determine exposure. You want your flash to fire exactly once, and toward the end of the exposure, to get people to instinctively comply with the slow shutter. You might also want to use an orange colour gel in front of your flash if you don’t want the people to appear blue while shooting in incandescent light. Here’s a 1/8s full-on action shot of my friend strumming on the guitar, taken using this technique. If you look carefully, you could reveal a lot more motion blur than what is apparent in first glance. That’s the rear sync advantage!

Ambar and the Guitar

4. Camera Stability

One of the easy ways of success in low light is to be able to use slow shutter speed, at least for relatively still subjects. The problem here is that slow speed results in camera shake. It is, therefore, important to learn how to have a stable grip on the camera. I myself, took a very long time getting this right. Part of the reason is that people talk about this aspect very infrequently on forums. Part of it is that you only get the information in bits and pieces. I’d invite you to go through this excellent blog post on how to make a “human tripod”. Supporting the camera: holding with your hands.

One of the techniques I often apply when faced with camera shake is to burst a series of shots. Chances are that one of those shots will be sharp. It frequently happens to be the first in the series and I find bursting for more than 2 seconds to be a waste. The following is a 1/4s shot made using a Canon PowerShot A630 P&S in burst mode.

More Nikon D80 Switches

That’s it for this article. It still talks about shooting at high ISO and it is inevitable that you’ll get noise in such shots. In the next post, I’ll talk about development techniques that would help you reduce the apparent noise, beyond just pushing the NR slider all the way up. Oh yeah, you’re shooting RAW, aren’t you? 😉