内窥高光谱成像眩光抑制技术

    Glare suppression technology for endoscopic hyperspectral imaging

    • 内窥成像技术广泛应用于消化道、工业管道等受限空间目标的检测与诊断。特别地,内窥高光谱成像技术因其非接触、无损伤、可同步获取形态与光谱信息等特点,正成为内窥技术发展的重要新方向之一。然而,受组织粘液或管道界面等镜面反射的干扰,内窥图像中常出现眩光现象,影响成像质量与诊断判断。针对内窥成像场景,提出一种基于多次曝光融合的高光谱图像眩光抑制方法,以提升成像质量。该方法依据图像不同区域的明暗差异,采集一系列曝光程度不同的高光谱图像,并进行融合。实验结果表明,经多个可见光高光谱图像融合后,图像SSIM达到了0.9297,整个视场的纹理细节得到恢复,镜面反射的影响显著降低。同时,相较于其他方法,文中所提方法在光谱曲线保真方面表现更优。文中对受限空间下眩光目标的光谱分析具有积极意义,也为肿瘤原位精准诊断等问题提供了新的技术手段。

       

      Abstract:
      Objective The endoscope, a key instrument for target observation, information analysis, and operation execution in confined spaces, offers non-contact and non-invasive capabilities. It is widely used in clinical evaluations of the digestive tract and in the inspection and diagnosis of confined environments such as industrial pipelines via nondestructive testing. However, non-uniform illumination from the endoscopic light source, combined with the smooth surfaces of human organs or pipelines, often causes specular reflection. This leads to glare in the endoscopic field of view, which obscures target details and severely compromises imaging quality and diagnostic accuracy. Traditional glare suppression methods primarily rely on RGB three-channel cameras for image processing. However, these approaches are computationally intensive and limited to only three spectral bands, thereby constraining the available spectral information. As a result, they are inadequate for accurate online analysis of histochemical component differences at specific wavelengths. To overcome these limitations, this study proposes a novel glare elimination method that integrates endoscopic hyperspectral imaging with multi-exposure fusion.
      Methods To effectively suppress glare in hyperspectral images while preserving their rich spectral and spatial information, this study first analyzes the image and spectral characteristics of the central glare region and the peripheral non-glare region. Based on this analysis, a threshold mask is constructed to identify abnormal pixels in the hyperspectral data cube—such as those exceeding the camera’s saturation threshold or exhibiting low overall signal intensity—for subsequent removal. Then, the maximum intensity of each pixel across the entire spectral band is calculated, and the spectrum of each pixel is normalized. Finally, the spectral intensity curves of the remaining pixels in each image are averaged and fused. For comparative purposes, three existing glare suppression methods were selected. Image quality was evaluated using the peak signal-to-noise ratio (PSNR) and structural similarity (SSIM), while spectral fidelity was assessed based on the mean absolute error (MAE), root mean square error (RMSE), and spectral angle mapper (SAM).
      Results and Discussions The endoscopic hyperspectral imaging system captured nine hyperspectral images at different exposure times. Three RGB bands (640, 532, and 471 nm) were selected to generate pseudo-color images for visualization. At high exposure times, the central area reached the maximum intensity value of 4095, indicating overexposure and a consequent loss of detail in these bright regions. In contrast, the peripheral areas exhibited higher intensity values and retained more structural detail (Fig.2). As the exposure time decreased, the overexposed area in the center gradually diminished, allowing previously obscured details to be recovered. However, noise and burrs became more pronounced in the periphery (Fig.3), which could obscure fine details and required appropriate removal. After normalizing each pixel, the overall contrast of the hyperspectral images was significantly enhanced. Details that were previously lost in the glare region at high exposure times, as well as those obscured in the peripheral regions at low exposure times, were effectively restored (Fig.4). Finally, in comparison with other methods, the hyperspectral image obtained through average fusion demonstrated superior clarity and contrast in structural details across the entire field of view. It also achieved relatively high PSNR and SSIM scores (with the latter approaching 1, as shown in Tab.1), indicating that the structural information was highly consistent with the reference image. Moreover, the proposed method offered faster computational speed. In terms of spectral fidelity, our method exhibited a higher similarity to the original spectrum in both the central and peripheral regions ( Fig.6). Quantitative evaluations based on different spectral similarity metrics (Tab.2) confirmed that our method achieved the lowest index values across different positions, demonstrating its superior spectral reconstruction accuracy. This approach not only effectively suppressed central glare but also preserved structural and spectral information at the edges.
      Conclusions This study tackles the challenge of glare in endoscopic imaging by introducing a novel elimination method based on hyperspectral and multi-exposure image fusion. Qualitative and quantitative comparisons with existing techniques demonstrate that the proposed approach not only effectively suppresses specular reflections but also enhances textural details across the entire field of view. Moreover, it exhibits superior performance in preserving spectral fidelity. This work provides a valuable tool for the spectral analysis of target surfaces in confined spaces and offers a promising solution for accurate, online tumor diagnosis.

       

    /

    返回文章
    返回