next up previous
Next: Colour Texture Boundary Information Up: Image Segmentation Strategy Previous: Initialisation: Perceptual Edges

Colour Texture Region Information

Colour in a textured region is by definition not homogenous and presents a very variable behaviour through different image regions. Hence, methods which implicitly assume the same shape for all the clusters in the space, are not able to handle the complexity of the real feature space [19]. Therefore, we focus our attention on density estimation from a non-parametric approach since these methods do not have embedded assumptions, and specifically we adopt the kernel estimation technique. Considering colour pixels inside seeds as a set of data points assumed to be a sample of region colour, density estimation techniques allow the construction of an estimate of the probability density function which describes the behaviour of colour in a region. Given $n$ data points $x_i$, $i=1,\ldots ,n$ in the d-dimensional space $R^d$, the multivariate kernel density estimator with kernel $K_H(x)$ and a bandwidth parameter $h$, becomes the expression


\begin{displaymath}
\hat{f}(x)=\frac{1}{nh^d}\sum_{i=1}^{n} K_H(\frac{x-x_i}{h})
\end{displaymath} (1)

which gives us the probability of a pixel to belong to a region considering colour properties, $P_{R_c}$, on the three-dimensional colour space. Note that in order to use only one bandwidth parameter $h>0$ the metric of the feature space has to be Euclidean.

On the other hand, texture of each region $R_i$ is modeled by a multivariate Gaussian distribution considering the set of $k$ texture features extracted from the luminance image. Thus, the mean vector $\overrightarrow{\mu_i}$ and the covariance matrix $\Sigma_i$, which are initialised from the seeds, describe the texture homogeneity region behaviour. Therefore, the probability of a pixel of belonging to a region taking textural properties into account, $P_{R_t}$, is given by the probability density function of a multivariate Gaussian distribution.

Considering both properties together, colour and texture, the probability of a pixel $j$ of belonging to a region $R_i$ will be obtained considering the similarity of the colour pixel with the colour of the region, and the similarity of the texture around the pixel with the texture of the region. The combination of both terms gives the equation


\begin{displaymath}
P_R(j\vert R_i)=\beta P_{R_c}(j\vert R_i)+(1-\beta) P_{R_t}(j\vert R_i)
\end{displaymath} (2)

where $\beta$ weights the relative importance of colour and texture terms to evaluate the region information.


next up previous
Next: Colour Texture Boundary Information Up: Image Segmentation Strategy Previous: Initialisation: Perceptual Edges
Xavier Llado 2004-05-31