Operator Reference

points_foerstnerT_points_foerstnerPointsFoerstnerPointsFoerstnerpoints_foerstner (Operator)

points_foerstnerT_points_foerstnerPointsFoerstnerPointsFoerstnerpoints_foerstner — Detect points of interest using the Förstner operator.

Signature

Herror T_points_foerstner(const Hobject Image, const Htuple SigmaGrad, const Htuple SigmaInt, const Htuple SigmaPoints, const Htuple ThreshInhom, const Htuple ThreshShape, const Htuple Smoothing, const Htuple EliminateDoublets, Htuple* RowJunctions, Htuple* ColumnJunctions, Htuple* CoRRJunctions, Htuple* CoRCJunctions, Htuple* CoCCJunctions, Htuple* RowArea, Htuple* ColumnArea, Htuple* CoRRArea, Htuple* CoRCArea, Htuple* CoCCArea)

void PointsFoerstner(const HObject& Image, const HTuple& SigmaGrad, const HTuple& SigmaInt, const HTuple& SigmaPoints, const HTuple& ThreshInhom, const HTuple& ThreshShape, const HTuple& Smoothing, const HTuple& EliminateDoublets, HTuple* RowJunctions, HTuple* ColumnJunctions, HTuple* CoRRJunctions, HTuple* CoRCJunctions, HTuple* CoCCJunctions, HTuple* RowArea, HTuple* ColumnArea, HTuple* CoRRArea, HTuple* CoRCArea, HTuple* CoCCArea)

void HImage::PointsFoerstner(const HTuple& SigmaGrad, const HTuple& SigmaInt, const HTuple& SigmaPoints, const HTuple& ThreshInhom, double ThreshShape, const HString& Smoothing, const HString& EliminateDoublets, HTuple* RowJunctions, HTuple* ColumnJunctions, HTuple* CoRRJunctions, HTuple* CoRCJunctions, HTuple* CoCCJunctions, HTuple* RowArea, HTuple* ColumnArea, HTuple* CoRRArea, HTuple* CoRCArea, HTuple* CoCCArea) const

void HImage::PointsFoerstner(double SigmaGrad, double SigmaInt, double SigmaPoints, double ThreshInhom, double ThreshShape, const HString& Smoothing, const HString& EliminateDoublets, HTuple* RowJunctions, HTuple* ColumnJunctions, HTuple* CoRRJunctions, HTuple* CoRCJunctions, HTuple* CoCCJunctions, HTuple* RowArea, HTuple* ColumnArea, HTuple* CoRRArea, HTuple* CoRCArea, HTuple* CoCCArea) const

void HImage::PointsFoerstner(double SigmaGrad, double SigmaInt, double SigmaPoints, double ThreshInhom, double ThreshShape, const char* Smoothing, const char* EliminateDoublets, HTuple* RowJunctions, HTuple* ColumnJunctions, HTuple* CoRRJunctions, HTuple* CoRCJunctions, HTuple* CoCCJunctions, HTuple* RowArea, HTuple* ColumnArea, HTuple* CoRRArea, HTuple* CoRCArea, HTuple* CoCCArea) const

void HImage::PointsFoerstner(double SigmaGrad, double SigmaInt, double SigmaPoints, double ThreshInhom, double ThreshShape, const wchar_t* Smoothing, const wchar_t* EliminateDoublets, HTuple* RowJunctions, HTuple* ColumnJunctions, HTuple* CoRRJunctions, HTuple* CoRCJunctions, HTuple* CoCCJunctions, HTuple* RowArea, HTuple* ColumnArea, HTuple* CoRRArea, HTuple* CoRCArea, HTuple* CoCCArea) const   ( Windows only)

static void HOperatorSet.PointsFoerstner(HObject image, HTuple sigmaGrad, HTuple sigmaInt, HTuple sigmaPoints, HTuple threshInhom, HTuple threshShape, HTuple smoothing, HTuple eliminateDoublets, out HTuple rowJunctions, out HTuple columnJunctions, out HTuple coRRJunctions, out HTuple coRCJunctions, out HTuple coCCJunctions, out HTuple rowArea, out HTuple columnArea, out HTuple coRRArea, out HTuple coRCArea, out HTuple coCCArea)

void HImage.PointsFoerstner(HTuple sigmaGrad, HTuple sigmaInt, HTuple sigmaPoints, HTuple threshInhom, double threshShape, string smoothing, string eliminateDoublets, out HTuple rowJunctions, out HTuple columnJunctions, out HTuple coRRJunctions, out HTuple coRCJunctions, out HTuple coCCJunctions, out HTuple rowArea, out HTuple columnArea, out HTuple coRRArea, out HTuple coRCArea, out HTuple coCCArea)

void HImage.PointsFoerstner(double sigmaGrad, double sigmaInt, double sigmaPoints, double threshInhom, double threshShape, string smoothing, string eliminateDoublets, out HTuple rowJunctions, out HTuple columnJunctions, out HTuple coRRJunctions, out HTuple coRCJunctions, out HTuple coCCJunctions, out HTuple rowArea, out HTuple columnArea, out HTuple coRRArea, out HTuple coRCArea, out HTuple coCCArea)

def points_foerstner(image: HObject, sigma_grad: Union[float, int], sigma_int: Union[float, int], sigma_points: Union[float, int], thresh_inhom: Union[float, int], thresh_shape: float, smoothing: str, eliminate_doublets: str) -> Tuple[Sequence[float], Sequence[float], Sequence[float], Sequence[float], Sequence[float], Sequence[float], Sequence[float], Sequence[float], Sequence[float], Sequence[float]]

Description

points_foerstnerpoints_foerstnerPointsFoerstnerPointsFoerstnerpoints_foerstner extracts significant points from an image. Significant points are points that differ from their neighborhood, i.e., points where the image function changes in two dimensions. These changes occur on the one hand at the intersection of image edges (called junction points), and on the other hand at places where color or brightness differs from the surrounding neighborhood (called area points).

The point extraction takes place in two steps: In the first step the point regions, i.e., the inhomogeneous, isotropic regions, are extracted from the image. To do so, the smoothed matrix is calculated, where and are the first derivatives of each image channel and S stands for a smoothing. If SmoothingSmoothingSmoothingsmoothingsmoothing is 'gauss'"gauss""gauss""gauss""gauss", the derivatives are computed with Gaussian derivatives of size SigmaGradSigmaGradSigmaGradsigmaGradsigma_grad and the smoothing is performed by a Gaussian of size SigmaIntSigmaIntSigmaIntsigmaIntsigma_int. If SmoothingSmoothingSmoothingsmoothingsmoothing is 'mean'"mean""mean""mean""mean", the derivatives are computed with a 3 x 3 Sobel filter (and hence SigmaGradSigmaGradSigmaGradsigmaGradsigma_grad is ignored) and the smoothing is performed by a SigmaIntSigmaIntSigmaIntsigmaIntsigma_int x SigmaIntSigmaIntSigmaIntsigmaIntsigma_int mean filter. Then inhomogeneity = Trace(M) is the degree of inhomogeneity in the image and is the degree of the isotropy of the texture in the image. Image points that have an inhomogeneity greater or equal to ThreshInhomThreshInhomThreshInhomthreshInhomthresh_inhom and at the same time an isotropy greater or equal to ThreshShapeThreshShapeThreshShapethreshShapethresh_shape are subsequently examined further.

In the second step, two optimization functions are calculated for the resulting points. Essentially, these optimization functions average for each point the distances to the edge directions (for junction points) and the gradient directions (for area points) within an observation window around the point. If SmoothingSmoothingSmoothingsmoothingsmoothing is 'gauss'"gauss""gauss""gauss""gauss", the averaging is performed by a Gaussian of size SigmaPointsSigmaPointsSigmaPointssigmaPointssigma_points, if SmoothingSmoothingSmoothingsmoothingsmoothing is 'mean'"mean""mean""mean""mean", the averaging is performed by a SigmaPointsSigmaPointsSigmaPointssigmaPointssigma_points x SigmaPointsSigmaPointsSigmaPointssigmaPointssigma_points mean filter. The local minima of the optimization functions determine the extracted points. Their subpixel precise position is returned in (RowJunctionsRowJunctionsRowJunctionsrowJunctionsrow_junctions, ColumnJunctionsColumnJunctionsColumnJunctionscolumnJunctionscolumn_junctions) and (RowAreaRowAreaRowArearowArearow_area, ColumnAreaColumnAreaColumnAreacolumnAreacolumn_area).

In addition to their position, for each extracted point the elements CoRRJunctionsCoRRJunctionsCoRRJunctionscoRRJunctionsco_rrjunctions, CoRCJunctionsCoRCJunctionsCoRCJunctionscoRCJunctionsco_rcjunctions, and CoCCJunctionsCoCCJunctionsCoCCJunctionscoCCJunctionsco_ccjunctions (and CoRRAreaCoRRAreaCoRRAreacoRRAreaco_rrarea, CoRCAreaCoRCAreaCoRCAreacoRCAreaco_rcarea, and CoCCAreaCoCCAreaCoCCAreacoCCAreaco_ccarea, respectively) of the corresponding covariance matrix are returned. This matrix facilitates conclusions about the precision of the calculated point position. To obtain the actual values, it is necessary to estimate the amount of noise in the input image and to multiply all components of the covariance matrix with the variance of the noise. (To estimate the amount of noise, apply intensityintensityIntensityIntensityintensity to homogeneous image regions or plane_deviationplane_deviationPlaneDeviationPlaneDeviationplane_deviation to image regions, where the gray values form a plane. In both cases the amount of noise is returned in the parameter Deviation.) This is illustrated by the example program points_foerstner_ellipses.hdev.

It lies in the nature of this operator that corners often result in two distinct points: One junction point, where the edges of the corner actually meet, and one area point inside the corner. Such doublets will be eliminated automatically, if EliminateDoubletsEliminateDoubletsEliminateDoubletseliminateDoubletseliminate_doublets is 'true'"true""true""true""true". To do so, each pair of one junction point and one area point is examined. If the points lie within each others' observation window of the optimization function, for both points the precision of the point position is calculated and the point with the lower precision is rejected. If EliminateDoubletsEliminateDoubletsEliminateDoubletseliminateDoubletseliminate_doublets is 'false'"false""false""false""false", every detected point is returned.

Attention

Note that only odd values for SigmaIntSigmaIntSigmaIntsigmaIntsigma_int and SigmaPointsSigmaPointsSigmaPointssigmaPointssigma_points are allowed, if SmoothingSmoothingSmoothingsmoothingsmoothing is 'mean'"mean""mean""mean""mean". Even values automatically will be replaced by the next larger odd value.

points_foerstnerpoints_foerstnerPointsFoerstnerPointsFoerstnerpoints_foerstner with SmoothingSmoothingSmoothingsmoothingsmoothing = 'gauss'"gauss""gauss""gauss""gauss" uses a special implementation that is optimized using SSE2 instructions if the system parameter 'sse2_enable'"sse2_enable""sse2_enable""sse2_enable""sse2_enable" is set to 'true'"true""true""true""true" (which is default if SSE2 is available on your machine). This implementation is slightly inaccurate compared to the pure C version due to numerical issues (for 'byte' images the difference in RowJunctionsRowJunctionsRowJunctionsrowJunctionsrow_junctions and ColumnJunctionsColumnJunctionsColumnJunctionscolumnJunctionscolumn_junctions is in order of magnitude of 1.0e-5). If you prefer accuracy over performance you can set 'sse2_enable'"sse2_enable""sse2_enable""sse2_enable""sse2_enable" to 'false'"false""false""false""false" (using set_systemset_systemSetSystemSetSystemset_system) before you call points_foerstnerpoints_foerstnerPointsFoerstnerPointsFoerstnerpoints_foerstner. This way points_foerstnerpoints_foerstnerPointsFoerstnerPointsFoerstnerpoints_foerstner does not use SSE2 accelerations. Don't forget to set 'sse2_enable'"sse2_enable""sse2_enable""sse2_enable""sse2_enable" back to 'true'"true""true""true""true" afterwards.

Note that filter operators may return unexpected results if an image with a reduced domain is used as input. Please refer to the chapter Filters.

Execution Information

  • Multithreading type: reentrant (runs in parallel with non-exclusive operators).
  • Multithreading scope: global (may be called from any thread).
  • Automatically parallelized on internal data level.

Parameters

ImageImageImageimageimage (input_object)  (multichannel-)image objectHImageHObjectHObjectHobject (byte / uint2 / real)

Input image.

SigmaGradSigmaGradSigmaGradsigmaGradsigma_grad (input_control)  number HTupleUnion[float, int]HTupleHtuple (real / integer) (double / int / long) (double / Hlong) (double / Hlong)

Amount of smoothing used for the calculation of the gradient. If SmoothingSmoothingSmoothingsmoothingsmoothing is 'mean', SigmaGradSigmaGradSigmaGradsigmaGradsigma_grad is ignored.

Default: 1.0

Suggested values: 0.7, 0.8, 0.9, 1.0, 1.2, 1.5, 2.0, 3.0

Value range: 0.0 ≤ SigmaGrad SigmaGrad SigmaGrad sigmaGrad sigma_grad

Recommended increment: 0.1

SigmaIntSigmaIntSigmaIntsigmaIntsigma_int (input_control)  number HTupleUnion[float, int]HTupleHtuple (real / integer) (double / int / long) (double / Hlong) (double / Hlong)

Amount of smoothing used for the integration of the gradients.

Default: 2.0

Suggested values: 0.7, 0.8, 0.9, 1.0, 1.2, 1.5, 2.0, 3.0

Recommended increment: 0.1

Restriction: SigmaInt > 0

SigmaPointsSigmaPointsSigmaPointssigmaPointssigma_points (input_control)  number HTupleUnion[float, int]HTupleHtuple (real / integer) (double / int / long) (double / Hlong) (double / Hlong)

Amount of smoothing used in the optimization functions.

Default: 3.0

Suggested values: 0.7, 0.8, 0.9, 1.0, 1.2, 1.5, 2.0, 3.0

Recommended increment: 0.1

Restriction: SigmaPoints >= SigmaInt && SigmaPoints > 0.6

ThreshInhomThreshInhomThreshInhomthreshInhomthresh_inhom (input_control)  number HTupleUnion[float, int]HTupleHtuple (real / integer) (double / int / long) (double / Hlong) (double / Hlong)

Threshold for the segmentation of inhomogeneous image areas.

Default: 200

Suggested values: 50, 100, 200, 500, 1000

Value range: 0.0 ≤ ThreshInhom ThreshInhom ThreshInhom threshInhom thresh_inhom

ThreshShapeThreshShapeThreshShapethreshShapethresh_shape (input_control)  real HTuplefloatHTupleHtuple (real) (double) (double) (double)

Threshold for the segmentation of point areas.

Default: 0.3

Suggested values: 0.1, 0.2, 0.3, 0.4, 0.5, 0.7

Value range: 0.01 ≤ ThreshShape ThreshShape ThreshShape threshShape thresh_shape ≤ 1

Minimum increment: 0.01

Recommended increment: 0.1

SmoothingSmoothingSmoothingsmoothingsmoothing (input_control)  string HTuplestrHTupleHtuple (string) (string) (HString) (char*)

Used smoothing method.

Default: 'gauss' "gauss" "gauss" "gauss" "gauss"

List of values: 'gauss'"gauss""gauss""gauss""gauss", 'mean'"mean""mean""mean""mean"

EliminateDoubletsEliminateDoubletsEliminateDoubletseliminateDoubletseliminate_doublets (input_control)  string HTuplestrHTupleHtuple (string) (string) (HString) (char*)

Elimination of multiply detected points.

Default: 'false' "false" "false" "false" "false"

List of values: 'false'"false""false""false""false", 'true'"true""true""true""true"

RowJunctionsRowJunctionsRowJunctionsrowJunctionsrow_junctions (output_control)  point.y-array HTupleSequence[float]HTupleHtuple (real) (double) (double) (double)

Row coordinates of the detected junction points.

ColumnJunctionsColumnJunctionsColumnJunctionscolumnJunctionscolumn_junctions (output_control)  point.x-array HTupleSequence[float]HTupleHtuple (real) (double) (double) (double)

Column coordinates of the detected junction points.

CoRRJunctionsCoRRJunctionsCoRRJunctionscoRRJunctionsco_rrjunctions (output_control)  number-array HTupleSequence[float]HTupleHtuple (real) (double) (double) (double)

Row part of the covariance matrix of the detected junction points.

CoRCJunctionsCoRCJunctionsCoRCJunctionscoRCJunctionsco_rcjunctions (output_control)  number-array HTupleSequence[float]HTupleHtuple (real) (double) (double) (double)

Mixed part of the covariance matrix of the detected junction points.

CoCCJunctionsCoCCJunctionsCoCCJunctionscoCCJunctionsco_ccjunctions (output_control)  number-array HTupleSequence[float]HTupleHtuple (real) (double) (double) (double)

Column part of the covariance matrix of the detected junction points.

RowAreaRowAreaRowArearowArearow_area (output_control)  point.y-array HTupleSequence[float]HTupleHtuple (real) (double) (double) (double)

Row coordinates of the detected area points.

ColumnAreaColumnAreaColumnAreacolumnAreacolumn_area (output_control)  point.x-array HTupleSequence[float]HTupleHtuple (real) (double) (double) (double)

Column coordinates of the detected area points.

CoRRAreaCoRRAreaCoRRAreacoRRAreaco_rrarea (output_control)  number-array HTupleSequence[float]HTupleHtuple (real) (double) (double) (double)

Row part of the covariance matrix of the detected area points.

CoRCAreaCoRCAreaCoRCAreacoRCAreaco_rcarea (output_control)  number-array HTupleSequence[float]HTupleHtuple (real) (double) (double) (double)

Mixed part of the covariance matrix of the detected area points.

CoCCAreaCoCCAreaCoCCAreacoCCAreaco_ccarea (output_control)  number-array HTupleSequence[float]HTupleHtuple (real) (double) (double) (double)

Column part of the covariance matrix of the detected area points.

Result

points_foerstnerpoints_foerstnerPointsFoerstnerPointsFoerstnerpoints_foerstner returns 2 ( H_MSG_TRUE) if all parameters are correct and no error occurs during the execution. If the input is empty the behavior can be set via set_system('no_object_result',<Result>)set_system("no_object_result",<Result>)SetSystem("no_object_result",<Result>)SetSystem("no_object_result",<Result>)set_system("no_object_result",<Result>). If necessary, an exception is raised.

Possible Successors

gen_cross_contour_xldgen_cross_contour_xldGenCrossContourXldGenCrossContourXldgen_cross_contour_xld, disp_crossdisp_crossDispCrossDispCrossdisp_cross

Alternatives

points_harrispoints_harrisPointsHarrisPointsHarrispoints_harris, points_lepetitpoints_lepetitPointsLepetitPointsLepetitpoints_lepetit, points_harris_binomialpoints_harris_binomialPointsHarrisBinomialPointsHarrisBinomialpoints_harris_binomial

References

W. Förstner, E. Gülch: “A Fast Operator for Detection and Precise Location of Distinct Points, Corners and Circular features”. In Proceedings of the Intercommission Conference on Fast Processing of Photogrametric Data, Interlaken, pp. 281-305, 1987.
W. Förstner: “Statistische Verfahren für die automatische Bildanalyse und ihre Bewertung bei der Objekterkennung und -vermessung”. Volume 370, Series C, Deutsche Geodätische Kommission, München, 1991.
W. Förstner: “A Framework for Low Level Feature Extraction”. European Conference on Computer Vision, LNCS 802, pp. 383-394, Springer Verlag, 1994.
C. Fuchs: “Extraktion polymorpher Bildstrukturen und ihre topologische und geometrische Gruppierung”. Volume 502, Series C, Deutsche Geodätische Kommission, München, 1998.

Module

Foundation