Research

My research generally revolves about shape modelling, variational approach, model-based image segmentation, and object recognition. The emphasis of my thesis is, specifically, the segmentation from an image of entities that have the form of a 'network',

*i.e.*the region in the image corresponding to the entity is composed of branches joining together at junctions,

*e.g.*road, river, vessel, etc. Or more precisely, the goal is to model the

*prior*geometry of network regions at different scales of the image. The application is to segment road networks R from very high resolution (VHR) QuickBird images (~0.61 m/pixel) in dense urban areas.

To model families of regions such as network, Rochery

*et al.*[1] introduced ‘higher-order active contours’ (HOACs). HOACs incorporate not only local, differential knowledge about the boundary, but also nonlocal, long-range interactions between tuples of contour points. Building on this work, the model energy E(R) is defined as the sum of two pieces: a HOAC prior energy E

_{P}(R) describing the geometric prior knowledge of the network regions, that is, elongated structures with parallel borders and slowly varying width that meet at junctions; and a data energy E

_{D}(I, R) describing the image I we expect to see given a road network R. By minimizing the total energy E with respect to R, an estimate of the road network is obtained.

The complete task is tackled in two steps. First, we choose to work on extracting the main road networks. This is still not a trivial problem. The images are complicated, with much 'noise' in the road region due to cars, road markings, etc., while the background is very varied, containing many features that are locally similar to roads. To cope with these difficulties existing in the VHR images, we propose two terms:

● Multi-scale data term, to combine information from multiple scales.

● Specific prior term, to introduce stronger prior knowledge.

Subsequently, we turn to the issue of extracting the secondary road networks. These are much more difficult because their radiometric properties are very similar to those of the background, and because secondary roads are often obscured by shadows and trees. Furthermore, the

*generic*prior term in [1] suffers from a severe limitation: network branch width was constrained to be similar to maximum network branch radius of curvature, thereby it provides a poor model of networks with straight narrow branches. A straightforward solution is to separate the interactions between pixels on the same and opposite sides of a network branch. To achieve this goal, we propose two new types of HOAC term:

● Nonlinear nonlocal prior term, to enlarge the magnitude of the interaction along one side of a network branch.

● Linear nonlocal prior term, to increase the range of the interaction along one side of a network branch.

[1] M. Rochery, I. H. Jermyn, and J. Zerubia, “Higher-order active contours”,

*Int J. Comput. Vis.*, vol. 69, no. 1, pp. 27-42, 2006.

Last update: Dec. 10, 2008