Automatic segmentation of gas plumes from multibeam water column images using a U-shape network

Fanlin YANG; Feng WANG; Zhendong LUAN; Xianhai BU; Sai MEI; Jianxing ZHANG; Hongxia LIU

Your Location：

Home >

Browse articles >

Automatic segmentation of gas plumes from multibeam water column images using a U-shape network

Geology | Updated：2024-10-14

- Automatic segmentation of gas plumes from multibeam water column images using a U-shape network
- Journal of Oceanology and Limnology Vol. 41, Issue 5, Pages: 1753-1764(2023)
- Affiliations：
  
  1.College of Geodesy and Geomatics, Shandong University of Science and Technology, Qingdao 266590, China
  2.Key Laboratory of Ocean Geomatics, Ministry of Natural Resources, Qingdao 266590, China
  3.Key Laboratory of Marine Geology and Environment, Center of Deep Sea Research, Institute of Oceanology, Chinese Academy of Sciences, Qingdao 266071, China
  4.Qingdao Institute of Marine Geology, China Geological Survey, Ministry of Natural Resources, Qingdao 266237, China
  5.College of Mathematics and Systems Science, Shandong University of Science and Technology, Qingdao 266590, China
- Author bio：
  
  flyang@sdust.edu.cn
  luan@qdio.ac.cn
- Funds：
- DOI：
  CLC：
- Received：19 March 2022，
  
  Accepted：15 June 2022，
  
  Online First：29 July 2022，
  
  Published：01 September 2023
- Accepted：
Scan QR Code
YANG Fanlin,WANG Feng,LUAN Zhendong,et al.Automatic segmentation of gas plumes from multibeam water column images using a U-shape network[J].Journal of Oceanology and Limnology,2023,41(05):1753-1764.
DOI：

YANG Fanlin,WANG Feng,LUAN Zhendong,et al.Automatic segmentation of gas plumes from multibeam water column images using a U-shape network[J].Journal of Oceanology and Limnology,2023,41(05):1753-1764. DOI：

摘要

Abstract

Cold seeps are widely developed on the seabed of continental margins and can form gas plumes due to the upward migration of methane-rich fluids. The detection and automatic segmentation of gas plumes are of great significance in locating and studying the cold seep system that is usually accompanied by hydrate layers in the subsurface. A multibeam echo-sounder system (MBES) can record the complete backscatter intensity of the water column

and it is one of the most effective means for detecting cold seeps. However

the gas plumes recorded in multibeam water column images (WCI) are usually blurred due to the interference of the complicated water environment and the sidelobes of the MBES

making it difficult to obtain the effective segmentation. Therefore

based on the existing UNet semantic segmentation network

this paper proposes an AP-UNet network combining the convolutional block attention module and the pyramid pooling module for the automatic segmentation and extraction of gas plumes. Comparative experiments are conducted among three traditional segmentation methods and two deep learning methods. The results show that the AP-UNet segmentation model can effectively suppress complicated water column noise interference. The segmentation precision

the Dice coefficient

and the recall rate of this model are 92.09%

92.00%

and 92.49%

respectively

which are 1.17%

2.10%

and 2.07% higher than the results of the UNet.

关键词

Keywords

references

Badrinarayanan V , Kendall A , Cipolla R . 2017 . SegNet: a deep convolutional encoder-decoder architecture for image segmentation . IEEE Transactions on Pattern Analysis and Machine Intelligence , 39 ( 12 ): 2481 - 2495 , https://doi.org/10.1109/TPAMI.2016.2644615 https://doi.org/10.1109/TPAMI.2016.2644615 .

Chen L C , Papandreou G , Kokkinos I et al . 2018 . DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs . IEEE Transactions on Pattern Analysis and Machine Intelligence , 40 ( 4 ): 834 - 848 , https://doi.org/10.1109/TPAMI.2017.2699184 https://doi.org/10.1109/TPAMI.2017.2699184 .

Chen Y L , Ding J S , Zhang H Q et al . 2019 . Multibeam water column data research in the Taixinan Basin: implications for the potential occurrence of natural gas hydrate . Acta Oceanologica Sinica , 38 ( 5 ): 129 - 133 , https://doi.org/10.1007/s13131-019-1444-0 https://doi.org/10.1007/s13131-019-1444-0 .

Clarke J . 2006 . Applications of multibeam water column imaging for hydrographic survey . The Hydrographic Journal , 120 ( 3 ): 3 - 15 . https://do http://dx.doi.org/ http://dx.doi.org/http://dx.doi.org/

Colbo K , Ross T , Brown C et al . 2014 . A review of oceanographic applications of water column data from multibeam echosounders . Estuarine, Coastal and Shelf Science , 145 : 41 - 56 , https://doi.org/10.1016/j.ecss.2014.04.002 https://doi.org/10.1016/j.ecss.2014.04.002 .

Di P F , Feng D , Tao J et al . 2020 . Using time-series videos to quantify methane bubbles flux from natural cold seeps in the South China Sea . Minerals , 10 ( 3 ): 216 , https://doi.org/10.3390/min10030216 https://doi.org/10.3390/min10030216 .

Fu J , Liu J , Tian H J et al . 2019 . Dual attention network for scene segmentation . In: Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . IEEE, Long Beach . p. 3141 - 3149 , https://doi.org/10.1109/CVPR.2019.00326 https://doi.org/10.1109/CVPR.2019.00326 .

He X , Zhou Y , Zhao J Q et al . 2022 . Swin transformer embedding UNet for remote sensing image semantic segmentation . IEEE Transactions on Geoscience and Remote Sensing , 60 : 1 - 15 , https://doi.org/10.1109/TGRS.2022.3144165 https://doi.org/10.1109/TGRS.2022.3144165 .

Higgs B , Mountjoy J J , Crutchley G J et al . 2019 . Seep-bubble characteristics and gas flow rates from a shallow-water, high-density seep field on the shelf-to-slope transition of the Hikurangi subduction margin . Marine Geology , 417 : 105985 , https://doi.org/10.1016/j.margeo.2019.105985 https://doi.org/10.1016/j.margeo.2019.105985 .

Hu Y , Luo M , Liang Q Y et al . 2019 . Pore fluid compositions and inferred fluid flow patterns at the Haima cold seeps of the South China Sea . Marine and Petroleum Geology , 103 : 29 - 40 , https://doi.org/10.1016/j.marpetgeo.2019.01.007 https://doi.org/10.1016/j.marpetgeo.2019.01.007 .

Huang Q , Wu C H , Xia C Y et al . 2017 . Semantic segmentation with reverse attention . In : Proceedings of British Machine Vision Conference 2017 . BMVC, London. p.18.1-18.13, https://doi.org/10.5244/C.31.18 https://doi.org/10.5244/C.31.18 .

Huo G Y , Yang S X , Li Q W et al . 2017 . A robust and fast method for sidescan sonar image segmentation using nonlocal despeckling and active contour model . IEEE Transactions on Cybernetics , 47 ( 4 ): 855 - 872 , https://doi.org/10.1109/TCYB.2016.2530786 https://doi.org/10.1109/TCYB.2016.2530786 .

Judd A , Hovland M . 2009 . Seabed Fluid Flow: The Impact on Geology, Biology and the Marine Environment . Cambridge University Press , Cambridge , England. 408 p.

Levin L A , Baco A R , Bowden D A et al . 2016 . Hydrothermal vents and methane seeps: rethinking the sphere of influence . Frontiers in Marine Science , 3 : 72 , https://doi.org/10.3389/fmars.2016.00072 https://doi.org/10.3389/fmars.2016.00072 .

Lin T Y , Goyal P , Girshick R et al . 2017 . Focal loss for dense object detection . In: Proceedings of 2017 IEEE International Conference on Computer Vision (ICCV) . IEEE, Venice . p. 2999 - 3007 , https://doi.org/10.1109/ICCV.2017.324 https://doi.org/10.1109/ICCV.2017.324 .

Liu S , Qi L , Qin H F et al . 2018 . Path aggregation network for instance segmentation . In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . IEEE, Salt Lake City . p. 8759 - 8768 , https://doi.org/10.1109/CVPR.2018.00913 https://doi.org/10.1109/CVPR.2018.00913 .

Long J , Shelhamer E , Darrell T . 2015 . Fully convolutional networks for semantic segmentation . In: Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . IEEE, Boston . p. 3431 - 3440 , https://doi.org/10.1109/CVPR.2015.7298965 https://doi.org/10.1109/CVPR.2015.7298965 .

Marques C R V . 2012 . Automatic Mid-Water Target Detection Using Multibeam Water Column . University of New Brunswick, Fredericton .

Melvin G D , Cochrane N A . 2015 . Multibeam acoustic detection of fish and water column targets at high-flow sites . Estuaries and Coasts , 38 ( S1 ): 227 - 240 , https://doi.org/10.1007/s12237-014-9828-z https://doi.org/10.1007/s12237-014-9828-z .

Micallef A , Krastel S , Savini A . 2018 . Submarine Geomorphology . Springer, Cham . p. 367 - 387 . https://do 10.1007/978-3-319-57852-1 http://dx.doi.org/10.1007/978-3-319-57852-1

Minaee S , Boykov Y , Porikli F et al . 2022 . Image segmentation using deep learning: a survey . IEEE Transactions on Pattern Analysis and Machine Intelligence , 44 ( 7 ): 3523 - 3542 , https://doi.org/10.1109/TPAMI.2021.3059968 https://doi.org/10.1109/TPAMI.2021.3059968 .

Oktay O , Schlemper J , Folgoc L L et al . 2018 . Attention U-net: learning where to look for the pancreas . arXiv: 1804. 03999 , https://doi.org/10.48550/arXiv.1804.03999 https://doi.org/10.48550/arXiv.1804.03999 .

Pan T , Jiang J Q , Yao J et al . 2020 . A novel multi-focus image fusion network with U-shape structure . Sensors , 20 ( 14 ): 3901 , https://doi.org/10.3390/s20143901 https://doi.org/10.3390/s20143901 .

Römer M , Sahling H , Pape T et al . 2014 . Methane fluxes and carbonate deposits at a cold seep area of the central Nile deep sea fan, eastern Mediterranean Sea . Marine Geology , 347 : 27 - 42 , https://doi.org/10.1016/j.margeo.2013.10.01 https://doi.org/10.1016/j.margeo.2013.10.01 .

Ronneberger O , Fischer P , Brox T . 2015 . U-net: convolutional networks for biomedical image segmentation . In: Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention . Springer, Munich . p. 234 - 241 , https://doi.org/10.1007/978-3-319-24574-4_28 https://doi.org/10.1007/978-3-319-24574-4_28 .

Solomon E A , Kastner M , MacDonald I R et al . 2009 . Considerable methane fluxes to the atmosphere from hydrocarbon seeps in the Gulf of Mexico . Nature Geoscience , 2 ( 8 ): 561 - 565 , https://doi.org/10.1038/ngeo574 https://doi.org/10.1038/ngeo574 .

Song Y , Liu P . 2020 . Segmentation of sonar images with intensity inhomogeneity based on improved MRF . Applied Acoustics , 158 : 107051 , https://doi.org/10.1016/j.apacoust.2019.107051 https://doi.org/10.1016/j.apacoust.2019.107051 .

Suess E . 2014 . Marine cold seeps and their manifestations: geological control, biogeochemical criteria and environmental conditions . International Journal of Earth Sciences , 103 ( 7 ): 1889 - 1916 , https://doi.org/10.1007/s00531-014-1010-0 https://doi.org/10.1007/s00531-014-1010-0 .

Urban P , Köser K , Greinert J . 2017 . Processing of multibeam water column image data for automated bubble/seep detection and repeated mapping . Limnology and Oceanography : Methods , 15 ( 1 ): 1 - 21 , https://doi.org/10.1002/lom3.10138 https://doi.org/10.1002/lom3.10138 .

Wang H N , Cao P , Wang J Q et al . 2022 . UCTransNet: rethinking the skip connections in U-net from a channel-wise perspective with transformer . In: Proceedings of the 36th AAAI Conference on Artificial Intelligence . AAAI, Palo Alto . p. 2441 - 2449 . https://do 10.1609/aaai.v36i3.20144 http://dx.doi.org/10.1609/aaai.v36i3.20144

Weber T C . 2021 . A CFAR detection approach for identifying gas bubble seeps with multibeam echo sounders . IEEE Journal of Oceanic Engineering , 46 ( 4 ): 1346 - 1355 , https://doi.org/10.1109/JOE.2021.3056910 https://doi.org/10.1109/JOE.2021.3056910 .

Wei J G , Wu T T , Deng X G et al . 2020 . Acoustic characteristics of cold-seep methane bubble behavior in the water column and its potential environmental impact . Acta Oceanologica Sinica , 39 ( 5 ): 133 - 144 , https://doi.org/10.1007/s13131-019-1489-0 https://doi.org/10.1007/s13131-019-1489-0 .

Woo S , Park J C , Lee J Y et al . 2018 . CBAM: convolutional block attention module . In: Proceedings of the 15th European Conference on Computer Vision . Springer, Munich . p. 3 - 19 , https://doi.org/10.1007/978-3-030-01234-2_1 https://doi.org/10.1007/978-3-030-01234-2_1 .

Xu C , Wu M X , Zhou T et al . 2020 . Optical flow-based detection of gas leaks from pipelines using multibeam water column images . Remote Sensing , 12 ( 1 ): 119 , https://doi.org/10.3390/rs12010119 https://doi.org/10.3390/rs12010119 .

Yan J , Meng J X , Zhao J H . 2021 . Bottom detection from backscatter data of conventional side scan sonars through 1D-UNet . Remote Sensing , 13 ( 5 ): 1024 , https://doi.org/10.3390/rs13051024 https://doi.org/10.3390/rs13051024 .

Yang F L , Han L T , Wang R F et al . 2013 . Progress in object detection in middle and bottom-water based on multibeam water column image . Journal of Shandong University of Science and Technology (Natural Science) , 32 ( 6 ): 75 - 83 , https://doi.org/10.16452/j.cnki.sdkjzk.2013.06.014. https://doi.org/10.16452/j.cnki.sdkjzk.2013.06.014. (in Chinese with English abstract) .

Zhao H S , Shi J P , Qi X J et al . 2017 . Pyramid scene parsing network . In: Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . IEEE, Honolulu . p. 6230 - 6239 , https://doi.org/10.1109/CVPR.2017.660 https://doi.org/10.1109/CVPR.2017.660 .

Zhao J H , Mai D X , Zhang H M et al . 2020 . Automatic detection and segmentation on gas plumes from multibeam water column images . Remote Sensing , 12 ( 18 ): 3085 , https://doi.org/10.3390/rs12183085 https://doi.org/10.3390/rs12183085 .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

Fanlin YANG

Feng WANG

Xianhai BU

Related Institution

College of Geodesy and Geomatics, Shandong University of Science and Technology

Key Laboratory of Ocean Geomatics, Ministry of Natural Resources

Address：Editorial Office of JOL, 88 Haijun Rd. Qingdao, 266000, China
Tel：+86-532-82898754 Email：jol@qdio.ac.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰