match_rel_pose_ransacmatch_rel_pose_ransacMatchRelPoseRansacMatchRelPoseRansacmatch_rel_pose_ransacT_match_rel_pose_ransac
Short description
match_rel_pose_ransacmatch_rel_pose_ransacMatchRelPoseRansacMatchRelPoseRansacmatch_rel_pose_ransacT_match_rel_pose_ransac β Compute the relative orientation between two cameras by automatically
finding correspondences between image points.
Signature
match_rel_pose_ransac( image Image1, image Image2, number Rows1, number Cols1, number Rows2, number Cols2, campar CamPar1, campar CamPar2, string GrayMatchMethod, integer MaskSize, integer RowMove, integer ColMove, integer RowTolerance, integer ColTolerance, angle.rad Rotation, number MatchThreshold, string EstimationMethod, number DistanceThreshold, integer RandSeed, out pose RelPose, out real CovRelPose, out real Error, out integer Points1, out integer Points2 )match_rel_pose_ransac( Image1, Image2 : : Rows1, Cols1, Rows2, Cols2, CamPar1, CamPar2, GrayMatchMethod, MaskSize, RowMove, ColMove, RowTolerance, ColTolerance, Rotation, MatchThreshold, EstimationMethod, DistanceThreshold, RandSeed : RelPose, CovRelPose, Error, Points1, Points2 )void MatchRelPoseRansac( const HObject& Image1, const HObject& Image2, const HTuple& Rows1, const HTuple& Cols1, const HTuple& Rows2, const HTuple& Cols2, const HTuple& CamPar1, const HTuple& CamPar2, const HTuple& GrayMatchMethod, const HTuple& MaskSize, const HTuple& RowMove, const HTuple& ColMove, const HTuple& RowTolerance, const HTuple& ColTolerance, const HTuple& Rotation, const HTuple& MatchThreshold, const HTuple& EstimationMethod, const HTuple& DistanceThreshold, const HTuple& RandSeed, HTuple* RelPose, HTuple* CovRelPose, HTuple* Error, HTuple* Points1, HTuple* Points2 )static void HOperatorSet.MatchRelPoseRansac( HObject image1, HObject image2, HTuple rows1, HTuple cols1, HTuple rows2, HTuple cols2, HTuple camPar1, HTuple camPar2, HTuple grayMatchMethod, HTuple maskSize, HTuple rowMove, HTuple colMove, HTuple rowTolerance, HTuple colTolerance, HTuple rotation, HTuple matchThreshold, HTuple estimationMethod, HTuple distanceThreshold, HTuple randSeed, out HTuple relPose, out HTuple covRelPose, out HTuple error, out HTuple points1, out HTuple points2 )def match_rel_pose_ransac( image_1: HObject, image_2: HObject, rows_1: Sequence[Union[float, int]], cols_1: Sequence[Union[float, int]], rows_2: Sequence[Union[float, int]], cols_2: Sequence[Union[float, int]], cam_par_1: Sequence[Union[float, int, str]], cam_par_2: Sequence[Union[float, int, str]], gray_match_method: str, mask_size: int, row_move: int, col_move: int, row_tolerance: int, col_tolerance: int, rotation: MaybeSequence[Union[float, int]], match_threshold: Union[int, float], estimation_method: str, distance_threshold: Union[float, int], rand_seed: int ) -> Tuple[Sequence[Union[int, float]], Sequence[float], Sequence[float], Sequence[int], Sequence[int]]
def match_rel_pose_ransac_s( image_1: HObject, image_2: HObject, rows_1: Sequence[Union[float, int]], cols_1: Sequence[Union[float, int]], rows_2: Sequence[Union[float, int]], cols_2: Sequence[Union[float, int]], cam_par_1: Sequence[Union[float, int, str]], cam_par_2: Sequence[Union[float, int, str]], gray_match_method: str, mask_size: int, row_move: int, col_move: int, row_tolerance: int, col_tolerance: int, rotation: MaybeSequence[Union[float, int]], match_threshold: Union[int, float], estimation_method: str, distance_threshold: Union[float, int], rand_seed: int ) -> Tuple[Sequence[Union[int, float]], Sequence[float], float, Sequence[int], Sequence[int]]Herror T_match_rel_pose_ransac( const Hobject Image1, const Hobject Image2, const Htuple Rows1, const Htuple Cols1, const Htuple Rows2, const Htuple Cols2, const Htuple CamPar1, const Htuple CamPar2, const Htuple GrayMatchMethod, const Htuple MaskSize, const Htuple RowMove, const Htuple ColMove, const Htuple RowTolerance, const Htuple ColTolerance, const Htuple Rotation, const Htuple MatchThreshold, const Htuple EstimationMethod, const Htuple DistanceThreshold, const Htuple RandSeed, Htuple* RelPose, Htuple* CovRelPose, Htuple* Error, Htuple* Points1, Htuple* Points2 )
HPose HImage::MatchRelPoseRansac( const HImage& Image2, const HTuple& Rows1, const HTuple& Cols1, const HTuple& Rows2, const HTuple& Cols2, const HCamPar& CamPar1, const HCamPar& CamPar2, const HString& GrayMatchMethod, Hlong MaskSize, Hlong RowMove, Hlong ColMove, Hlong RowTolerance, Hlong ColTolerance, const HTuple& Rotation, const HTuple& MatchThreshold, const HString& EstimationMethod, const HTuple& DistanceThreshold, Hlong RandSeed, HTuple* CovRelPose, HTuple* Error, HTuple* Points1, HTuple* Points2 ) const
HPose HImage::MatchRelPoseRansac( const HImage& Image2, const HTuple& Rows1, const HTuple& Cols1, const HTuple& Rows2, const HTuple& Cols2, const HCamPar& CamPar1, const HCamPar& CamPar2, const HString& GrayMatchMethod, Hlong MaskSize, Hlong RowMove, Hlong ColMove, Hlong RowTolerance, Hlong ColTolerance, double Rotation, Hlong MatchThreshold, const HString& EstimationMethod, double DistanceThreshold, Hlong RandSeed, HTuple* CovRelPose, double* Error, HTuple* Points1, HTuple* Points2 ) const
HPose HImage::MatchRelPoseRansac( const HImage& Image2, const HTuple& Rows1, const HTuple& Cols1, const HTuple& Rows2, const HTuple& Cols2, const HCamPar& CamPar1, const HCamPar& CamPar2, const char* GrayMatchMethod, Hlong MaskSize, Hlong RowMove, Hlong ColMove, Hlong RowTolerance, Hlong ColTolerance, double Rotation, Hlong MatchThreshold, const char* EstimationMethod, double DistanceThreshold, Hlong RandSeed, HTuple* CovRelPose, double* Error, HTuple* Points1, HTuple* Points2 ) const
HPose HImage::MatchRelPoseRansac( const HImage& Image2, const HTuple& Rows1, const HTuple& Cols1, const HTuple& Rows2, const HTuple& Cols2, const HCamPar& CamPar1, const HCamPar& CamPar2, const wchar_t* GrayMatchMethod, Hlong MaskSize, Hlong RowMove, Hlong ColMove, Hlong RowTolerance, Hlong ColTolerance, double Rotation, Hlong MatchThreshold, const wchar_t* EstimationMethod, double DistanceThreshold, Hlong RandSeed, HTuple* CovRelPose, double* Error, HTuple* Points1, HTuple* Points2 ) const (Windows only)
HPose HCamPar::MatchRelPoseRansac( const HImage& Image1, const HImage& Image2, const HTuple& Rows1, const HTuple& Cols1, const HTuple& Rows2, const HTuple& Cols2, const HCamPar& CamPar2, const HString& GrayMatchMethod, Hlong MaskSize, Hlong RowMove, Hlong ColMove, Hlong RowTolerance, Hlong ColTolerance, const HTuple& Rotation, const HTuple& MatchThreshold, const HString& EstimationMethod, const HTuple& DistanceThreshold, Hlong RandSeed, HTuple* CovRelPose, HTuple* Error, HTuple* Points1, HTuple* Points2 ) const
HPose HCamPar::MatchRelPoseRansac( const HImage& Image1, const HImage& Image2, const HTuple& Rows1, const HTuple& Cols1, const HTuple& Rows2, const HTuple& Cols2, const HCamPar& CamPar2, const HString& GrayMatchMethod, Hlong MaskSize, Hlong RowMove, Hlong ColMove, Hlong RowTolerance, Hlong ColTolerance, double Rotation, Hlong MatchThreshold, const HString& EstimationMethod, double DistanceThreshold, Hlong RandSeed, HTuple* CovRelPose, double* Error, HTuple* Points1, HTuple* Points2 ) const
HPose HCamPar::MatchRelPoseRansac( const HImage& Image1, const HImage& Image2, const HTuple& Rows1, const HTuple& Cols1, const HTuple& Rows2, const HTuple& Cols2, const HCamPar& CamPar2, const char* GrayMatchMethod, Hlong MaskSize, Hlong RowMove, Hlong ColMove, Hlong RowTolerance, Hlong ColTolerance, double Rotation, Hlong MatchThreshold, const char* EstimationMethod, double DistanceThreshold, Hlong RandSeed, HTuple* CovRelPose, double* Error, HTuple* Points1, HTuple* Points2 ) const
HPose HCamPar::MatchRelPoseRansac( const HImage& Image1, const HImage& Image2, const HTuple& Rows1, const HTuple& Cols1, const HTuple& Rows2, const HTuple& Cols2, const HCamPar& CamPar2, const wchar_t* GrayMatchMethod, Hlong MaskSize, Hlong RowMove, Hlong ColMove, Hlong RowTolerance, Hlong ColTolerance, double Rotation, Hlong MatchThreshold, const wchar_t* EstimationMethod, double DistanceThreshold, Hlong RandSeed, HTuple* CovRelPose, double* Error, HTuple* Points1, HTuple* Points2 ) const (Windows only)
HTuple HPose::MatchRelPoseRansac( const HImage& Image1, const HImage& Image2, const HTuple& Rows1, const HTuple& Cols1, const HTuple& Rows2, const HTuple& Cols2, const HCamPar& CamPar1, const HCamPar& CamPar2, const HString& GrayMatchMethod, Hlong MaskSize, Hlong RowMove, Hlong ColMove, Hlong RowTolerance, Hlong ColTolerance, const HTuple& Rotation, const HTuple& MatchThreshold, const HString& EstimationMethod, const HTuple& DistanceThreshold, Hlong RandSeed, HTuple* Error, HTuple* Points1, HTuple* Points2 )
HTuple HPose::MatchRelPoseRansac( const HImage& Image1, const HImage& Image2, const HTuple& Rows1, const HTuple& Cols1, const HTuple& Rows2, const HTuple& Cols2, const HCamPar& CamPar1, const HCamPar& CamPar2, const HString& GrayMatchMethod, Hlong MaskSize, Hlong RowMove, Hlong ColMove, Hlong RowTolerance, Hlong ColTolerance, double Rotation, Hlong MatchThreshold, const HString& EstimationMethod, double DistanceThreshold, Hlong RandSeed, double* Error, HTuple* Points1, HTuple* Points2 )
HTuple HPose::MatchRelPoseRansac( const HImage& Image1, const HImage& Image2, const HTuple& Rows1, const HTuple& Cols1, const HTuple& Rows2, const HTuple& Cols2, const HCamPar& CamPar1, const HCamPar& CamPar2, const char* GrayMatchMethod, Hlong MaskSize, Hlong RowMove, Hlong ColMove, Hlong RowTolerance, Hlong ColTolerance, double Rotation, Hlong MatchThreshold, const char* EstimationMethod, double DistanceThreshold, Hlong RandSeed, double* Error, HTuple* Points1, HTuple* Points2 )
HTuple HPose::MatchRelPoseRansac( const HImage& Image1, const HImage& Image2, const HTuple& Rows1, const HTuple& Cols1, const HTuple& Rows2, const HTuple& Cols2, const HCamPar& CamPar1, const HCamPar& CamPar2, const wchar_t* GrayMatchMethod, Hlong MaskSize, Hlong RowMove, Hlong ColMove, Hlong RowTolerance, Hlong ColTolerance, double Rotation, Hlong MatchThreshold, const wchar_t* EstimationMethod, double DistanceThreshold, Hlong RandSeed, double* Error, HTuple* Points1, HTuple* Points2 ) (Windows only)
HPose HImage.MatchRelPoseRansac( HImage image2, HTuple rows1, HTuple cols1, HTuple rows2, HTuple cols2, HCamPar camPar1, HCamPar camPar2, string grayMatchMethod, int maskSize, int rowMove, int colMove, int rowTolerance, int colTolerance, HTuple rotation, HTuple matchThreshold, string estimationMethod, HTuple distanceThreshold, int randSeed, out HTuple covRelPose, out HTuple error, out HTuple points1, out HTuple points2 )
HPose HImage.MatchRelPoseRansac( HImage image2, HTuple rows1, HTuple cols1, HTuple rows2, HTuple cols2, HCamPar camPar1, HCamPar camPar2, string grayMatchMethod, int maskSize, int rowMove, int colMove, int rowTolerance, int colTolerance, double rotation, int matchThreshold, string estimationMethod, double distanceThreshold, int randSeed, out HTuple covRelPose, out double error, out HTuple points1, out HTuple points2 )
HPose HCamPar.MatchRelPoseRansac( HImage image1, HImage image2, HTuple rows1, HTuple cols1, HTuple rows2, HTuple cols2, HCamPar camPar2, string grayMatchMethod, int maskSize, int rowMove, int colMove, int rowTolerance, int colTolerance, HTuple rotation, HTuple matchThreshold, string estimationMethod, HTuple distanceThreshold, int randSeed, out HTuple covRelPose, out HTuple error, out HTuple points1, out HTuple points2 )
HPose HCamPar.MatchRelPoseRansac( HImage image1, HImage image2, HTuple rows1, HTuple cols1, HTuple rows2, HTuple cols2, HCamPar camPar2, string grayMatchMethod, int maskSize, int rowMove, int colMove, int rowTolerance, int colTolerance, double rotation, int matchThreshold, string estimationMethod, double distanceThreshold, int randSeed, out HTuple covRelPose, out double error, out HTuple points1, out HTuple points2 )
HTuple HPose.MatchRelPoseRansac( HImage image1, HImage image2, HTuple rows1, HTuple cols1, HTuple rows2, HTuple cols2, HCamPar camPar1, HCamPar camPar2, string grayMatchMethod, int maskSize, int rowMove, int colMove, int rowTolerance, int colTolerance, HTuple rotation, HTuple matchThreshold, string estimationMethod, HTuple distanceThreshold, int randSeed, out HTuple error, out HTuple points1, out HTuple points2 )
HTuple HPose.MatchRelPoseRansac( HImage image1, HImage image2, HTuple rows1, HTuple cols1, HTuple rows2, HTuple cols2, HCamPar camPar1, HCamPar camPar2, string grayMatchMethod, int maskSize, int rowMove, int colMove, int rowTolerance, int colTolerance, double rotation, int matchThreshold, string estimationMethod, double distanceThreshold, int randSeed, out double error, out HTuple points1, out HTuple points2 )
Description
Given a set of coordinates of characteristic points
\((\textrm{Rows1},\textrm{Cols1})\) and \((\textrm{Rows2},\textrm{Cols2})\)
in the stereo images Image1image1image_1 and Image2image2image_2
along with known internal camera parameters CamPar1camPar1cam_par_1 and
CamPar2camPar2cam_par_2,
match_rel_pose_ransacMatchRelPoseRansac automatically determines the geometry
of the stereo setup and finds the correspondences between the characteristic
points. The geometry of the stereo setup is represented by the relative pose
RelPoserelPoserel_pose and all corresponding points have to fulfill the epipolar
constraint.
RelPoserelPoserel_pose indicates the relative pose of camera 1 with respect
to camera 2 (See create_poseCreatePose for more information about
poses and their representations.). This is in accordance with the
explicit calibration of a stereo setup using the operator
calibrate_camerasCalibrateCameras.
Now, let R,t be the rotation and translation
of the relative pose. Then, the essential matrix
E is defined as \(E=([t]_{\times} R)^T\), where
\([t]_{\times}\) denotes the 3x3 skew-symmetric
matrix realizing the cross product with the vector t. The
pose can be determined from the epipolar constraint:
\[\begin{eqnarray*}
\left(\begin{array}{c} X_{2} \\ Y_{2} \\ 1 \end{array} \right)^T
\cdot ([t]_{\times} R)^T \cdot
\left(\begin{array}{c} X_{1} \\ Y_{1} \\ 1 \end{array} \right)
= 0 \quad \textrm{where} \quad [t]_{\times} =
\left(\begin{array}{ccc} 0 & -t_{z} & t_{y} \\ t_{z} & 0 & -t_{x} \\
-t_{y} & t_{x} & 0 \\ \end{array} \right) \quad .
\end{eqnarray*}\]
Note, that the essential matrix is a projective entity and thus is
defined up to a scaling factor. From this follows that the
translation vector of the relative pose can only be determined up to
scale too. In fact, the computed translation vector will always be
normalized to unit length. As a consequence, a subsequent
three-dimensional reconstruction of the scene, using for instance
vector_to_rel_poseVectorToRelPose, can be carried out only
up to a single global scaling factor.
The operator match_rel_pose_ransacMatchRelPoseRansac is designed to deal with
a camera model, that includes lens distortions. This is in contrast
to the operator match_essential_matrix_ransacMatchEssentialMatrixRansac, which
encompasses only straight line preserving cameras. The camera
parameters are passed in CamPar1camPar1cam_par_1 and CamPar2camPar2cam_par_2. The
3D direction vectors \((X_{1},Y_{1},1)\) and
\((X_{2},Y_{2},1)\) are calculated from the point
coordinates (Rows1rows1rows_1,Cols1cols1cols_1) and
(Rows2rows2rows_2,Cols2cols2cols_2) by inverting the process of
projection (see Calibration).
The matching process is based on characteristic points, which can be
extracted with point operators like points_foerstnerPointsFoerstner or
points_harrisPointsHarris.
The matching itself is carried out in two steps: first, gray value
correlations of mask windows around the input points in the first
and the second image are determined and an initial matching between
them is generated using the similarity of the windows in both images.
Then, the RANSAC algorithm is applied to find the relative pose
that maximizes the number of correspondences under the epipolar constraint.
The size of the mask windows is MaskSize x MaskSize. Three
metrics for the correlation can be selected. If
GrayMatchMethodgrayMatchMethodgray_match_method has the value 'ssd'"ssd", the sum of
the squared gray value differences is used, 'sad'"sad" means the
sum of absolute differences, and 'ncc'"ncc" is the normalized
cross correlation. For details please refer to
binocular_disparityBinocularDisparity. The metric is minimized ('ssd'"ssd",
'sad'"sad") or maximized ('ncc'"ncc") over all possible
point pairs. A thus found matching is only accepted if the value of
the metric is below the value of MatchThresholdmatchThresholdmatch_threshold
('ssd'"ssd", 'sad'"sad") or above that value
('ncc'"ncc").
To increase the speed of the algorithm, the search area for the
matching operations can be limited. Only points within a window of
\[\begin{eqnarray*}2 \cdot
\textrm{RowTolerance} \times 2 \cdot
\textrm{ColTolerance}\end{eqnarray*}\]
points are considered. The offset of the
center of the search window in the second image with respect to the
position of the current point in the first image is given by
RowMoverowMoverow_move and ColMovecolMovecol_move.
If the second camera is
rotated around the optical axis with respect to the first camera
the parameter Rotationrotationrotation may contain an estimate for the
rotation angle or an angle interval in radians. A good guess will
increase the quality of the gray value matching. If the actual
rotation differs too much from the specified estimate the matching
will typically fail. In this case, an angle interval should be
specified, and Rotationrotationrotation is a tuple with two elements. The
larger the given interval the slower the operator is since the
RANSAC algorithm is run over all angle increments within the
interval.
After the initial matching is completed a randomized search algorithm
(RANSAC) is used to determine the relative pose RelPoserelPoserel_pose.
It tries to find the relative pose that is consistent
with a maximum number of correspondences.
For a point to be accepted, the distance to its corresponding epipolar line
must not exceed the threshold DistanceThresholddistanceThresholddistance_threshold.
The parameter EstimationMethodestimationMethodestimation_method decides whether the relative
orientation between the cameras is of a special type and which algorithm is
to be applied for its computation.
If EstimationMethodestimationMethodestimation_method is either 'normalized_dlt'"normalized_dlt" or
'gold_standard'"gold_standard" the relative orientation is arbitrary.
Choosing 'trans_normalized_dlt'"trans_normalized_dlt" or 'trans_gold_standard'"trans_gold_standard"
means that the relative motion between the cameras is a pure translation.
The typical application for this special motion case is the
scenario of a single fixed camera looking onto a moving conveyor belt.
In order to get a unique solution in the correspondence problem the minimum
required number of corresponding points is six in the general case and three
in the special, translational case.
The relative pose is computed by a linear algorithm if
'normalized_dlt'"normalized_dlt" or 'trans_normalized_dlt'"trans_normalized_dlt" is chosen.
With 'gold_standard'"gold_standard" or 'trans_gold_standard'"trans_gold_standard"
the algorithm gives a statistically optimal result, and returns as well the
covariance of the relative pose CovRelPosecovRelPosecov_rel_pose.
Here, 'normalized_dlt'"normalized_dlt" and 'gold_standard'"gold_standard" stand for
direct-linear-transformation and gold-standard-algorithm respectively.
Note, that in general the found correspondences differ depending on the
deployed estimation method.
The value Errorerrorerror indicates the overall quality of the estimation
procedure and is the mean Euclidean distance in pixels between the
points and their corresponding epipolar lines.
Point pairs consistent with the mentioned constraints are considered to be
in correspondences. Points1points1points_1 contains the indices of the
matched input points from the first image and Points2points2points_2 contains
the indices of the corresponding points in the second image.
For the operator match_rel_pose_ransacMatchRelPoseRansac a special
configuration of scene points and cameras exists: if all 3D points lie in a
single plane and additionally are all closer to one of the two cameras then
the solution in the essential matrix is not unique but twofold.
As a consequence both solutions are computed and returned by the operator.
This means that the output parameters RelPoserelPoserel_pose, CovRelPosecovRelPosecov_rel_pose
and Errorerrorerror are of double length and the values of the second
solution are simply concatenated behind the values of the first one.
The parameter RandSeedrandSeedrand_seed can be used to control the
randomized nature of the RANSAC algorithm, and hence to obtain
reproducible results. If RandSeedrandSeedrand_seed is set to a positive
number the operator yields the same result on every call with the
same parameters because the internally used random number generator
is initialized with the RandSeedrandSeedrand_seed. If RandSeedrandSeedrand_seed \(=\)
00 the random number generator is initialized with the
current time. In this case the results may not be reproducible.
The value set for the HALCON system variable 'seed_rand'"seed_rand"
(see set_systemSetSystem) does not affect the results of
match_rel_pose_ransacMatchRelPoseRansac.
Execution information
-
Multithreading type: reentrant (runs in parallel with non-exclusive operators).
-
Multithreading scope: global (may be called from any thread).
-
Processed without parallelization.
Parameters
Image1image1image_1 (input_object) singlechannelimage β object (byte / uint2)object (byte / uint2)HObject (byte / uint2)HImage (byte / uint2)HObject (byte / uint2)Hobject (byte / uint2)
Input image 1.
Image2image2image_2 (input_object) singlechannelimage β object (byte / uint2)object (byte / uint2)HObject (byte / uint2)HImage (byte / uint2)HObject (byte / uint2)Hobject (byte / uint2)
Input image 2.
Rows1rows1rows_1 (input_control) number-array β (real / integer)(real / integer)HTuple (double / Hlong)HTuple (double / int / long)Sequence[Union[float, int]]Htuple (double / Hlong)
Row coordinates of characteristic points
in image 1.
Restriction: length(Rows1) >= 6 || length(Rows1) >= 3
Cols1cols1cols_1 (input_control) number-array β (real / integer)(real / integer)HTuple (double / Hlong)HTuple (double / int / long)Sequence[Union[float, int]]Htuple (double / Hlong)
Column coordinates of characteristic points
in image 1.
Restriction: length(Cols1) == length(Rows1)
Rows2rows2rows_2 (input_control) number-array β (real / integer)(real / integer)HTuple (double / Hlong)HTuple (double / int / long)Sequence[Union[float, int]]Htuple (double / Hlong)
Row coordinates of characteristic points
in image 2.
Restriction: length(Rows2) >= 6 || length(Rows2) >= 3
Cols2cols2cols_2 (input_control) number-array β (real / integer)(real / integer)HTuple (double / Hlong)HTuple (double / int / long)Sequence[Union[float, int]]Htuple (double / Hlong)
Column coordinates of characteristic points
in image 2.
Restriction: length(Cols2) == length(Rows2)
CamPar1camPar1cam_par_1 (input_control) campar β (real / integer / string)(real / integer / string)HTuple (double / Hlong / HString)HCamPar, HTuple (double / int / long / string)Sequence[Union[float, int, str]]Htuple (double / Hlong / char*)
Parameters of the 1st camera.
CamPar2camPar2cam_par_2 (input_control) campar β (real / integer / string)(real / integer / string)HTuple (double / Hlong / HString)HCamPar, HTuple (double / int / long / string)Sequence[Union[float, int, str]]Htuple (double / Hlong / char*)
Parameters of the 2nd camera.
GrayMatchMethodgrayMatchMethodgray_match_method (input_control) string β (string)(string)HTuple (HString)HTuple (string)strHtuple (char*)
Gray value comparison metric.
Default: 'ssd'"ssd"
List of values: 'ncc', 'sad', 'ssd'"ncc", "sad", "ssd"
MaskSizemaskSizemask_size (input_control) integer β (integer)(integer)HTuple (Hlong)HTuple (int / long)intHtuple (Hlong)
Size of gray value masks.
Default: 1010
Suggested values: 3, 7, 153, 7, 15
Value range: 1 β€ MaskSize
RowMoverowMoverow_move (input_control) integer β (integer)(integer)HTuple (Hlong)HTuple (int / long)intHtuple (Hlong)
Average row coordinate shift of corresponding points.
Default: 00
Value range: 0 β€ RowMove β€ 200
ColMovecolMovecol_move (input_control) integer β (integer)(integer)HTuple (Hlong)HTuple (int / long)intHtuple (Hlong)
Average column coordinate shift of
corresponding points.
Default: 00
Value range: 0 β€ ColMove β€ 200
RowTolerancerowTolerancerow_tolerance (input_control) integer β (integer)(integer)HTuple (Hlong)HTuple (int / long)intHtuple (Hlong)
Half height of matching search window.
Default: 200200
Value range: 1 β€ RowTolerance
ColTolerancecolTolerancecol_tolerance (input_control) integer β (integer)(integer)HTuple (Hlong)HTuple (int / long)intHtuple (Hlong)
Half width of matching search window.
Default: 200200
Value range: 1 β€ ColTolerance
Rotationrotationrotation (input_control) angle.rad(-array) β (real / integer)(real / integer)HTuple (double / Hlong)HTuple (double / int / long)MaybeSequence[Union[float, int]]Htuple (double / Hlong)
Estimate of the relative orientation of the right image
with respect to the left image.
Default: 0.00.0
Suggested values: 0.0, 0.1, -0.1, 0.7854, 1.571, 3.1420.0, 0.1, -0.1, 0.7854, 1.571, 3.142
MatchThresholdmatchThresholdmatch_threshold (input_control) number β (integer / real)(integer / real)HTuple (Hlong / double)HTuple (int / long / double)Union[int, float]Htuple (Hlong / double)
Threshold for gray value matching.
Default: 1010
Suggested values: 10, 20, 50, 100, 0.9, 0.710, 20, 50, 100, 0.9, 0.7
EstimationMethodestimationMethodestimation_method (input_control) string β (string)(string)HTuple (HString)HTuple (string)strHtuple (char*)
Algorithm for the computation of the
relative pose and for special pose types.
Default: 'normalized_dlt'"normalized_dlt"
List of values: 'gold_standard', 'normalized_dlt', 'trans_gold_standard', 'trans_normalized_dlt'"gold_standard", "normalized_dlt", "trans_gold_standard", "trans_normalized_dlt"
DistanceThresholddistanceThresholddistance_threshold (input_control) number β (real / integer)(real / integer)HTuple (double / Hlong)HTuple (double / int / long)Union[float, int]Htuple (double / Hlong)
Maximal deviation of a point from its epipolar line.
Default: 11
Value range: 0.5 β€ DistanceThreshold β€ 5
Restriction: DistanceThreshold > 0
RandSeedrandSeedrand_seed (input_control) integer β (integer)(integer)HTuple (Hlong)HTuple (int / long)intHtuple (Hlong)
Seed for the random number generator.
Default: 00
RelPoserelPoserel_pose (output_control) pose β (real / integer)(real / integer)HTuple (double / Hlong)HPose, HTuple (double / int / long)Sequence[Union[int, float]]Htuple (double / Hlong)
Computed relative orientation of the cameras
(3D pose).
CovRelPosecovRelPosecov_rel_pose (output_control) real-array β (real)(real)HTuple (double)HTuple (double)Sequence[float]Htuple (double)
6x6 covariance matrix of the
relative orientation.
Errorerrorerror (output_control) real(-array) β (real)(real)HTuple (double)HTuple (double)Sequence[float]Htuple (double)
Root-Mean-Square of the epipolar distance error.
Points1points1points_1 (output_control) integer-array β (integer)(integer)HTuple (Hlong)HTuple (int / long)Sequence[int]Htuple (Hlong)
Indices of matched input points in image 1.
Points2points2points_2 (output_control) integer-array β (integer)(integer)HTuple (Hlong)HTuple (int / long)Sequence[int]Htuple (Hlong)
Indices of matched input points in image 2.
Combinations with other operators
Combinations
Possible predecessors
points_foerstnerPointsFoerstner, points_harrisPointsHarris
Possible successors
vector_to_rel_poseVectorToRelPose, gen_binocular_rectification_mapGenBinocularRectificationMap
See also
binocular_calibrationBinocularCalibration, match_fundamental_matrix_ransacMatchFundamentalMatrixRansac, match_essential_matrix_ransacMatchEssentialMatrixRansac, create_poseCreatePose
References
Richard Hartley, Andrew Zisserman: ``Multiple View Geometry in
Computer Visionββ; Cambridge University Press, Cambridge; 2003.
Olivier Faugeras, Quang-Tuan Luong: ``The Geometry of Multiple
Images: The Laws That Govern the Formation of Multiple Images of a
Scene and Some of Their Applicationsββ; MIT Press, Cambridge, MA;
2001.
Module
3D Metrology