文章詳目資料

International Journal of Science and Engineering

  • 加入收藏
  • 下載文章
篇名 利用局部二值模型及空間注意力進行街景圖像修復
卷期 13:2
並列篇名 Street Image Inpainting with Local Binary Pattern and Spatial Attention
作者 劉佾雲許雅婷林朝興
頁次 047-066
關鍵字 圖像繪製局部二值模式空間注意力Unet++門控卷積深度學習Image InpaintingLocal Binary PatternSpatial AttentionUnet++Gated ConvolutionDeep Learning
出刊日期 202310
DOI 10.53106/222344892023101302005

中文摘要

基於現有的圖像修復方法,如傳統暗房技術以及Photoshop修復技術等,皆較需費時的人工修補,而若使用自動修補功能,亦經常造成預測修補結構不完整,導致修補效果不理想。為了有效解決上述的問題,我們的專題先讓使用者透過筆刷進行簡單的塗抹覆蓋,模擬照片破損之區域(mask區域)。再利用Local Binary Pattern(LBP) Learning Network經由Unet++架構生成預測區域修補結構,並透過門控卷積(Gated Convolution)學習圖像及空間資訊,搭配Spatial Attention機制,最後利用Coarse-to-Fine方法進行Image Inpainting Network修補,產生mask區域之修補重繪結果。與本專題的研發成果相比,Photoshop及原論文的預測結果皆較無法準確修補應有結構,且後者修補結果有明顯的色差。此外,在SSIM和PSNR兩項指標上,本專題的修補成果與原論文相比,分別提升2.4%及14.6%,達到0.9848與38.82。

英文摘要

The existing image inpainting methods, such as traditional darkroom techniques and Photoshop inpainting techniques, all require time-consuming manual restoration. The use of automatic restoration functions often result in incomplete predicted restoration structures, leading to unsatisfactory restoration results. To effectively solve this issue, our project first allows users to simulate the damaged area (masked area) of a photo by simply covering it with a brush. Then, we use Local Binary Pattern (LBP) Learning Network to generate the predicted region repair structure through the Unet++ framework and learn the image and spatial information through Gated Convolution with Spatial Attention. We finally use the Coarse-to- Fine method to perform Image Inpainting Network to repair the masked region. Compared with the results of our project, the prediction results of Photoshop and the referenced work are less accurate in repairing the existing structure, and the latter also has obvious color difference. In addition, compared with the referenced work, the repair results of this project were improved by 2.4% and 14.6% to 0.9848 and 38.82 in terms of SSIM and PSNR, respectively.

相關文獻