Common Names: Histogram Modeling, Histogram Equalization
Histogram modeling techniques (e.g. histogram equalization) provide a
sophisticated method for modifying the dynamic range and contrast of
an image by altering that image such that its intensity
histogram has a desired shape. Unlike contrast
stretching, histogram modeling operators may employ non-linear
and non-monotonic transfer functions to map between pixel
intensity values in the input and output images. Histogram
equalization employs a monotonic, non-linear mapping which re-assigns
the intensity values of pixels in the input image such that the output
image contains a uniform distribution of intensities (i.e. a flat
histogram). This technique is used in image comparison processes
(because it is effective in detail enhancement) and in the correction
of non-linear effects introduced by, say, a digitizer or display
system.
Histogram modeling is usually introduced using continuous, rather
than discrete, process functions. Therefore, we suppose that the
images of interest contain continuous intensity levels (in the
interval [0,1]) and that the transformation function f
which maps an input image onto an output image
is continuous within this interval. Further,
it will be assumed that the transfer law (which may also be written in
terms of intensity density levels, e.g.
)
is single-valued and monotonically increasing (as is the case in
histogram equalization) so that it is possible to define the inverse
law
. An example of such a transfer
function is illustrated in Figure 1.
Figure 1 A histogram transformation function.
All pixels in the input image with densities in the region
to
will have their pixel
values re-assigned such that they assume an output pixel density value
in the range from
to
. The
surface areas
and
will therefore be equal, yielding:
where .
This result can be written in the language of probability theory if the histogram h is regarded as a continuous probability density function p describing the distribution of the (assumed random) intensity levels:
In the case of histogram equalization, the output probability
densities should all be an equal fraction of the maximum number of
intensity levels in the input image (where the
minimum level considered is 0). The
transfer function (or point
operator) necessary to achieve this result is simply:
Therefore,
where is simply the cumulative probability
distribution (i.e. cumulative histogram) of the original image.
Thus, an image which is transformed using its cumulative histogram
yields an output histogram which is flat!
A digital implementation of histogram equalization is usually performed by defining a transfer function of the form:
where N is the number of image pixels and
is the number of pixels at intensity level k or
less.
In the digital implementation, the output image will not necessarily be fully equalized and there may be `holes' in the histogram (i.e. unused intensity levels). These effects are likely to decrease as the number of pixels and intensity quantization levels in the input image are increased.
To illustrate the utility of histogram equalization, consider
which shows an 8-bit grayscale image of the surface of the moon. The histogram
confirms what we can see by visual inspection: this image has poor dynamic range. (Note that we can view this histogram as a description of pixel probability densities by simply scaling the vertical axis by the total number of image pixels and normalizing the horizontal axis using the number of intensity density levels (i.e. 256). However, the shape of the distribution will be the same in either case.)
In order to improve the contrast of this image, without affecting the structure (i.e. geometry) of the information contained therein, we can apply the histogram equalization operator. The resulting image is
and its histogram is shown
Note that the histogram is not flat (as in the examples from the continuous case) but that the dynamic range and contrast have been enhanced. Note also that when equalizing images with narrow histograms and relatively few gray levels, increasing the dynamic range has the adverse effect of increasing visual grainyness. Compare this result with that produced by the linear contrast stretching operator
In order to further explore the transformation defined by the histogram equalization operator, consider the image of the Scott Monument in Edinburgh, Scotland
Although the contrast on the building is acceptable, the sky region is represented almost entirely by light pixels. This causes most histogram pixels
to be pushed into a narrow peak in the upper graylevel region. The histogram equalization operator defines a mapping based on the cumulative histogram
which results in the image
While histogram equalization has enhanced the contrast of the sky regions in the image, the picture now looks artificial because there is very little variety in the middle graylevel range. This occurs because the transfer function is based on the shallow slope of the cumulative histogram in the middle graylevel regions (i.e. intensity density levels 100 - 230) and causes many pixels from this region in the original image to be mapped to similar graylevels in the output image.
We can improve on this if we define a mapping based on a sub-section of the image which contains a better distribution of intensity densities from the low and middle range graylevels. If we crop the image so as to isolate a region which contains more building than sky
we can then define a histogram equalization mapping for the whole image based on the cumulative histogram
of this smaller region. Since the cropped image contains a more even distribution of dark and light pixels, the slope of the transfer function is steeper and smoother, and the contrast of the resulting image
is more natural. This idea of defining mappings based upon particular sub-sections of the image is taken up by another class of operators which perform Local Enhancements as discussed below.
Histogram equalization is limited in that it is capable of producing
only one result: an image with a uniform intensity distribution.
Sometimes it is desirable to be able to control the shape of the
output histogram in order to highlight certain intensity levels in an
image. This can be accomplished by the histogram specialization
operator which maps a given intensity distribution
into a desired distribution
using a histogram equalized image
as an intermediate stage.
The first step in histogram specialization, is to specify the desired
output density function and write a transformation
g(c). If is single-valued
(which is true when there are no unfilled levels in the specified
histogram or errors in the process of rounding off
to the nearest intensity level), then
defines a mapping from the equalized levels of the
original image,
. It is possible to
combine these two transformations such that the image need not be
histogram equalized explicitly:
The histogram processing methods discussed above are global in the sense that they apply a transformation function whose form is based on the intensity level distribution of an entire image. Although this method can enhance the overall contrast and dynamic range of an image (thereby making certain details more visible), there are cases in which enhancement of details over small areas (i.e. areas whose total pixel contribution to the total number of image pixels has a negligible influence on the global transform) is desired. The solution in these cases is to derive a transformation based upon the intensity distribution in the local neighborhood of every pixel in the image.
The histogram processes described above can be adapted for local enhancement. The procedure involves defining a neighborhood around each pixel and, using the histogram characteristics of this neighborhood, to derive a transfer function which maps that pixel into an output intensity level. This is performed for each pixel in the image. (Since moving across rows or down columns only adds one new pixel to the local histogram, updating the histogram from the previous calculation with new data introduced at each motion is possible.) Local enhancement may also define transforms based on pixel attributes other than histogram, e.g. intensity mean (to control variance) and variance (to control contrast) are common.
You can interactively experiment with this operator by clicking here.
------------------------------- | Gray Level | Number of Pixels | |------------+------------------| | 0 | 34 | |------------+------------------| | 1 | 50 | |------------+------------------| | 2 | 500 | |------------+------------------| | 3 | 1500 | |------------+------------------| | 4 | 2700 | |------------+------------------| | 5 | 4500 | |------------+------------------| | 6 | 4000 | |------------+------------------| | 7 | 3100 | -------------------------------
(a) f has a horizontal plateau,
(b) f contains a vertical jump,
(c) f has a negative slope.
(Hint: it can be useful to sketch the curve, as in Figure 1, and then map a few points from histogram A to histogram B.)
Compare this result with those derived by means of the global transfer function shown in the above examples.
Compare your results.
R. Boyle and R. Thomas Computer Vision: A First Course, Blackwell Scientific Publications, 1988, pp 35 - 41.
R. Gonzalez and R. Woods Digital Image Processing, Addison-Wesley Publishing Company, 1992, Chap. 4.
A. Jain Fundamentals of Digital Image Processing, Prentice-Hall, 1986, pp 241 - 243.
A. Marion An Introduction to Image Processing, Chapman and Hall, 1991, Chap. 6.
Specific information about this operator may be found here.
More general advice about the local HIPR installation is available in the Local Information introductory section.