Tone Mapping and Shadow Recovery Using GIMP’s ‘Colors/Exposure’
by Elle Stone
A very common editing problem is how to lighten the shadows and midtones of an image while retaining highlight details, a task sometimes referred to as “shadow recovery” and more generally speaking as “tone mapping”. This step-by-step tutorial shows you how to use high bit depth GIMP’s floating point “Colors/Exposure” operation to add one or more stops of positive exposure compensation to an image’s shadows and midtones while retaining highlight details.
High bit depth GIMP’s floating point “Colors/Exposure”: much better than Curves for lightening the shadows and midtones of an image without blowing the highlights¶
A very common editing problem is how to lighten the shadows and midtones of an image without blowing out the highlights, which problem is very often encountered when dealing with photographs of scenes lit by direct sunlight. Precanned algorithms for accomplishing this task are often referred to as “shadow recovery” algorithms. But really these algorithms are special-purpose tone-mapping algorithms, which sometimes work pretty well, and sometimes not so well, depending on the algorithm, the image, and your artistic intentions for the image.
This step-by-step tutorial shows you how to use GIMP’s unbounded floating point “Colors/Exposure” operation to recover shadow information—that is, add one or more stops of positive exposure compensation to an image’s shadows and midtones—without blowing out or unduly compressing the image highlights. The procedure is completely “hand-tunable” using masks and layers, and is as close as you can get to non-destructive image editing using high bit depth GIMP 2.9/2.10.
Hight bit depth GIMP is my primary image editor, and I’ve used the procedure described below for the last couple of years as my “go to” way to modify image tonality. The same general procedure can be used to darken as well as lighten portions of an image, again controlling the effect using a layer mask. This isn’t exactly nondestructive editing because at some point you need to make a “New from Visible” layer. But unlike using Curves, using high bit depth GIMP’s floating point “Colors/Exposure” doesn’t clip RGB channel values and allows you to fine-tune the results by modifying and re-modifying the layer mask until you are completely happy with the resulting tonality.
A step-by-step example showing how to recover shadow information using high bit depth GIMP’s floating point “Colors/Exposure”¶
This step-by-step example provides a sample image and is broken down into five steps, starting with downloading the image. Steps 3, 4, and 5 describe the actual procedure, so here’s an overview:
Duplicate the base layer and then use GIMP’s unbounded Levels to add one stop of positive exposure compensation to the duplicated layer.
Add an inverse grayscale layer mask to the now much brighter duplicated layer.
Do “Auto/Stretch Contrast” on the layer mask and then fine-tune the mask until you are happy. Then make a “New from Visible” layer.
Download tree.png, which is a 16-bit integer sRGB image. High bit depth GIMP really is an “sRGB only” image editor, so it’s best if you don’t even try to edit in other RGB working spaces.
Open tree.png with GIMP and assign the GIMP built-in sRGB profile (the image colors won’t change a bit). Then convert the image to 32-bit floating point linear precision: Go to “Image/Precision”, select “32-bit floating point”, and when the Dither dialog pops up, select “Linear light” (this ensures that the Normal blend mode produces radiometrically correct results).
Make a copy of the “tree.png” layer, and label it “+1 stop exposure comp”. Then use “Colors/Exposure” to add one stop of positive exposure compensation—Figure 3 below shows the proper settings for the “Colors/Exposure” dialog, and Figure 4 shows the result:
When using “Colors/Exposure” to add one stop of positive exposure compensation, make sure the image really is at floating point precision, because integer precision will clip the highlights.
The image in Figure 4 clearly has “blown” highlights in the sky. But the highlights aren’t really blown (that is, clipped to 1.0 in one or more channels). Instead the highlight information is still there, but the RGB channel values fall outside the RGBdisplay channel value range of 0.0f to 1.0f. The sample points dialog in Figure 4 above shows four sample points that have RGB channel values that are greater than 1.0. As shown in Figure 5 below, adding a mask allows you to recover these highlights by bringing them back down into the display range.
If you had used integer precision instead of floating point, the highlights really would be blown: The sample points would have a maximum channel values of 255, 65535 or 4294967295, depending on the bit depth. And masking would only “recover” a solid expanse of gray, completely lacking any details (try for yourself and see what happens).
Add an inverse grayscale layer mask: Right-click on the layer and select “Layer/Mask/Add Layer Mask”, and when the “Add a mask to the Layer” dialog pops up, choose “Grayscale copy of layer” and check the “Invert mask” box.
As shown in Figure 5 below, at this point the highlights will be brought back into the display range, meaning all RGB channel values are between 0.0f and 1.0f. But the image will probably look a little odd (sort of cloudy and flat), and depending on the image, the brightest highlights might actually have dark splotches—don’t worry! this is temporary.
Click on the layer mask to select it for editing, and then select “Colors/Auto/Stretch Contrast”:
“Keep Colors” should be checked (though it doesn’t really matter on grayscale images such as layer masks). Figure 6 below shows the final result:
That’s the whole procedure for using “Colors/Exposure” to add a stop of positive exposure compensation to the shadows without blowing out the highlights. Now you can either fine-tune the mask, or else just make a “New from Visible” layer and continue editing your nicely brightened image. Depending on the image and also on your artistic intentions for the image, the mask might not need fine-tuning. But very often you’ll want to modify the resulting tonal distribution by doing a “Colors/Exposure” gamma correction, or perhaps a Curves operation on the mask, or else by painting directly on the mask. And sometimes you’ll want to blur the mask to restore micro contrast.
Depending on your particular artistic intentions for an image, some images are more likely than others to benefit from being tone mapped using floating point “Colors/Exposure”. Your mileage may vary, but typically the procedure described on this page works best for photographs of scenes with a pronounced tonal difference between the highlights and shadows, as per typical sunny day “sky-ground” photographs.
For adding just one stop of positive exposure compensation, the procedure described on this page works really well. Depending on the image you might want to blur the mask using an edge-respecting blur algorithm, and/or tweak the mask using “Colors/Exposure”, Curves, etc. But only modify the mask after using Auto Stretch Contrast on the mask. Otherwise results will be unpredictable: Gamma adjustments produce odd results when operating on out of gamut values, and Curves will summarily clip out of gamut values.
For adding more than one stop of exposure compensation, you can use one or more than one positive-exposure-compensation layers. Either way the layer mask(s) will need careful tweaking that’s very image-specific and also specific to your intended result. Figure 7 shows an example of using two exposure compensation layers to add two and a half stops of exposure compensation to the shadows and midtones of an image:
Before using “Colors/Exposure” to add positive exposure compensation, the base layer should already be stretched to its maximum dynamic range. The easiest way to stretch the base layer to its maximum dynamic range is to do “Colors/Auto/Stretch Contrast” and make sure that “Keep colors” is checked.
If you’ve never used an unbounded floating point image editor before, “Colors/Auto/Stretch Contrast” can produce an unexpected result: The image might actually end up with a severely reduced dynamic range, having either lighter shadows or darker highlights or both:
Dispensing with “useless” shadow and highlight information: Sometimes interpolated raw files of photographs of high dynamic range scenes end up with a sprinkling of highlight and shadow pixels that contains essentially no useful information. The easiest thing to do with such pixels is to use “Colors/Exposure” to set the desired black and white points, and then clip the resulting out of gamut channel information.
Useless highlight information:
For the “Power lines” picture shown in Figure 8 above, after doing “Color/Auto/Stretch Contrast”, a measly 48 pixels occupied nearly half the tonal range (see the histogram to the right). A little investigation with GIMP’s Threshold tool revealed that all 48 pixels are the peak values of specular highlights on the ceramic insulators on the power line pole in the foreground.
In cases where nearly half the histogram is occupied by a sprinkling of specular highlights, clipping the pixels is often the best and easiest solution. For the “Power lines” image, the 48 pixels in question carried essentially zero information. So I used “Colors/Exposure” to raise the white point, and then used “Tools/GEGL Operation/Clip RGB” to actually clip the channel information in the highlights (this time making sure the “Clip high pixel values” box was checked).
Useless shadow information:
Some raw processors can output images with negative channel values. And previous edits using high bit depth GIMP might have produced negative channel values. If doing an “Auto/Stretch Contrast” on your base image layer makes the image a whole lot lighter in the shadows, the problem is negative RGB channel values. One solution is to use “Colors/Exposure” to move the black point to where you want it to be, and then clip the negative channel values. Here are two ways to clip negative channel values:
Use “Tools/GEGL Operation/Clip RGB”, making sure to uncheck the “Clip high pixel values” box.
Or else create a solid black layer above your base image layer, set the blend mode to “Lighten only”, and make a “New from Visible” layer.
Blurring the mask to restore micro contrast: Putting an inverse mask on a layer that’s used to add positive exposure compensation necessarily slightly flattens micro contrast. Depending on your artistic intentions for the image, you might want to blur the mask to restore micro contrast. The trick is how to blur the mask without introducing “halos” around the edges of objects in the image. Small radius Gaussian blurs produce small but distressingly obvious halos around dark edges. A large radius gaussian blur sometimes works but just as often produces a large obvious halo separating the brighter and darker portions of the image. For many images a better solution is to blur the mask use an edge-respecting filter such as the GIMPG’MIC bilateral smooth filter:
An essential component of the procedure for using “Colors/Exposure” to add positive exposure compensation to images with dark shadows and midtones needs to be explicitly mentioned: Not only is the high bit depth GIMP’s “Colors/Exposure” operation unbounded at floating point precision—layer masks are also unbounded.
If the inverted grayscale masks were summarily clipped (as is the case when editing at integer precision), then the procedure described in this tutorial wouldn’t work.
Photographs taken in bright direct sunlight typically are of high dynamic range scenes, and the resulting camera file usually requires careful tone mapping to produce a satisfactory final image. High bit depth GIMP’s floating point floating point “Colors/Exposure” provides a very useful tool for dealing with this type of image, and of course is equally useful for any image where the goal is to raise the shadows and midtones without blowing out the highlights.
High bit depth GIMP’s floating point “Colors/Exposure” combined with a suitable layer mask can also be used to darken portions of the image, either by moving the upper left Value slider to the right (darkens the image by increasing contrast and also increases saturation; requires careful masking to avoid producing regions of solid black), or moving the lower right Value slider to the left (darkens the image by decreasing contrast, useful for de-emphasizing portions of the image).
This is a GIMP-specific tutorial. However, the same technique can be employed using the PhotoFlow raw processor and possibly other image editors that allow for 32-bit floating point processing using unbounded RGB channel values. The neat thing about using this technique in PhotoFlow is that PhotoFlow uses nodes, which allows for completely non-destructive editing of the inverted grayscale mask that’s used to recover the highlight detail after applying positive exposure compensation to raise the tonality of the shadows and midtones (even if you close and reopen the image, if you save the image’s PFI file).