平面运动约束下的自动驾驶多相机位姿估计

    Multi-camera pose estimation under planar motion constraints for autonomous driving

    • 现有基于多相机的相对位姿估计方法通常依赖于大量特征匹配,计算复杂度较高,难以满足实时性要求。尤其在车辆平面运动这一主导场景下,通用方法未能充分利用运动约束,导致模型冗余与计算资源浪费。针对上述问题,提出一种融合平面运动先验的高效最小求解器。该方法基于广义相机模型,通过将世界坐标系固定于空间点,并引入深度参数化的平移表示,将复杂的多相机位姿估计问题转化为仅需三组特征匹配即可求解的线性模型,显著降低了对特征数量的依赖和计算复杂度。仿真与实物实验结果表明,与传统六自由度方法相比,该方法在保证估计精度的同时,计算效率提升超过3倍,且在图像噪声、道路坡度及车辆震动等干扰下仍表现出优异的鲁棒性。

       

      Abstract:
      Objective With the rapid development of visual sensing and artificial intelligence technologies, computer vision is being increasingly applied in fields such as autonomous driving and robot navigation. Visual relative pose estimation can be broadly categorized into monocular and multi-camera systems based on the number of cameras employed. Compared to monocular configurations, multi-camera systems offer distinct advantages, including a wider field of view and richer environmental information through synchronized multi-perspective observation. These attributes render them particularly suitable for applications demanding high safety and robustness, such as autonomous driving, where they have become the predominant sensing configuration. However, existing relative pose estimation methods based on multi-camera setups typically rely on a large number of feature correspondences, resulting in high computational complexity and difficulty in meeting real-time requirements. Especially in the dominant scenario of planar vehicle motion, general methods fail to fully utilize motion constraints, leading to model redundancy and computational resource waste. This study aims to design an efficient minimal solver for multi-camera pose estimation that incorporates planar motion prior, specifically targeting autonomous driving applications on structured roads.
      Methods An efficient minimal solver that incorporates prior knowledge of planar motion is proposed. Built upon the generalized camera model, this method fixes the world coordinate system to a spatial point and introduces a depth-parameterized translation representation. In typical autonomous driving scenarios, vehicles predominantly operate on structured roads or near-planar surfaces. This motion characteristic provides a critical constraint for pose estimation: the six-degree-of-freedom rigid motion of the platform can be simplified to a planar motion model involving only yaw rotation about the vertical axis and translation constrained to the horizontal plane. Based on this observation, a planar motion model tailored for multi-camera systems is constructed. This formulation transforms the complex multi-camera pose estimation problem into a linear model that can be solved with only three sets of feature correspondences, significantly reducing reliance on feature quantity and computational complexity. The method is evaluated through comprehensive simulations and real-world experiments, covering performance under image noise, road slope perturbations, and vehicle vibrations.
      Results and Discussions The proposed method, named 3pt-Depth, is systematically compared with several baselines including 17pt-Li, 6pt-Stew, and 2pt-Choi in terms of efficiency, stability, and robustness. In computational efficiency, 3pt-Depth achieves an average runtime of 14.755 μs, which is over 3 times faster than 17pt-Li and significantly faster than 6pt-Stew (Tab.1). Under noise-free conditions, 3pt-Depth exhibits competitive numerical stability, with translation error performance better than 17pt-Li and clearly superior to 6pt-Stew (Fig.3). Simulations are conducted using a binocular vision system with a baseline length of 1 meter by default, consistent with sensor configurations in the widely used KITTI dataset and representative of real-world automotive setups. To systematically evaluate method performance under various disturbances, we examine the impact of image noise, road slope, vehicle vibration, and calibration errors. All solvers are integrated within the RANSAC framework, and the estimate yielding the highest inlier count is used for final error evaluation. In image noise tests, 3pt-Depth demonstrates the strongest tolerance to image noise across different motion patterns, with the slowest accuracy degradation as noise increases (Fig.4). It also outperforms 2pt-Choi under road slope disturbances (pitch and roll) and vehicle vibration scenarios (Fig.5-7). Further experiments show that 3pt-Depth maintains accuracy under increasing extrinsic rotation and translation calibration errors, and scales well with the number of cameras (Fig.8). Real-world validation on the KITTI dataset shows that 3pt-Depth achieves lowest rotation and translation errors across all sequences, confirming its practical effectiveness in autonomous driving environments (Tab.2-3).
      Conclusions This paper presents an efficient minimal solver for multi-camera pose estimation under planar motion constraints, specifically designed for autonomous driving. By leveraging the planar motion prior and a depth-parameterized translation representation, the method requires only three feature correspondences, significantly reducing computational complexity and dependency on feature matches while maintaining estimation accuracy. The method shows strong robustness against common disturbances in driving environments. Future work will focus on extending the method to adapt to non-ideal planar motions and exploring tight-coupling frameworks with other sensors like IMUs to enhance robustness in complex real-world scenarios.

       

    /

    返回文章
    返回