Extracting ship and heading from Sentinel-2 images using convolutional neural networks with point and vector learning

Xiunan LI; Peng CHEN; Jingsong YANG; Wentao AN; Dan LUO; Gang ZHENG; Aiying LU

Your Location：

Home >

Browse articles >

Extracting ship and heading from Sentinel-2 images using convolutional neural networks with point and vector learning

Physics | Updated：2025-02-19

- Extracting ship and heading from Sentinel-2 images using convolutional neural networks with point and vector learning
- Extracting ship and heading from Sentinel-2 images using convolutional neural networks with point and vector learning
- 海洋湖沼学报(英文) 2025年43卷第1期页码：16-28
- Affiliations：
  
  1. Ocean College, Zhejiang University, Zhoushan 316021, China
  2. State Key Laboratory of Satellite Ocean Environment Dynamics, Second Institute of Oceanography, Ministry of Natural Resources, Hangzhou 310012, China
  3. National Satellite Ocean Application Service, Ministry of Natural Resources, Beijing 100081, China
- Author bio：
  
  chenpeng@sio.org.cn
  jsyang@sio.org.cn
- Funds：
  
  the National Key R&D Program of China(2022YFB3902400);the China High Resolution Earth Observation System Program(41-Y30F07-9001-20/22)
- DOI：
  中图分类号：
- 收稿：2023-12-12，
  
  纸质出版：2025-01-01
- Accepted：
Scan QR Code
Extracting ship and heading from Sentinel-2 images using convolutional neural networks with point and vector learning[J]. 海洋湖沼学报(英文), 2025,43(1):16-28.

LI Xiunan,CHEN Peng,YANG Jingsong,et al.Extracting ship and heading from Sentinel-2 images using convolutional neural networks with point and vector learning[J].Journal of Oceanology and Limnology,2025,43(01):16-28.
Extracting ship and heading from Sentinel-2 images using convolutional neural networks with point and vector learning[J]. 海洋湖沼学报(英文), 2025,43(1):16-28. DOI：

LI Xiunan,CHEN Peng,YANG Jingsong,et al.Extracting ship and heading from Sentinel-2 images using convolutional neural networks with point and vector learning[J].Journal of Oceanology and Limnology,2025,43(01):16-28. DOI：

摘要

Abstract

Obtaining accurate ship positions and headings in remote sensing images plays a crucial role in various applications. However

current deep learning-based methods primarily focus on ship position detection

while the detection of ship wakes relies on traditional non-deep learning approaches

which often underperform in complex marine environments. We proposed a novel

simple

and efficient method called Point-Vector Net. The proposed method leverages convolutional neural networks (CNN) for feature extraction and subsequently integrates multi-scale features to generate high-resolution feature maps. In the final stage

ship positions and headings are represented using a combination of points and vectors. Comparative experiments with results from automatic identification system (AIS) reports demonstrate that our method achieved impressive performance in two-class ship target detection

with an average precision of 96.4%

recall rate of 94.3%

and an F1 score of 95.2%. Notably

the average heading error was 3.3°. The proposed model achieved a practical inference speed (FPS>30)

and the average processing time for inferring a large-scale Sentinel-2 remote sensing image was 11.4 s.

关键词

Keywords

references

Ai J A , Qi X Y , Yu W D et al . 2011 . A novel ship wake CFAR detection algorithm based on SCR enhancement and normalized Hough transform . IEEE Geoscience and Remote Sensing Letters , 8 ( 4 ): 681 - 685 , https://doi.‍org/10.1109/LGRS.2010.2100076 https://doi.‍org/10.1109/LGRS.2010.2100076 . https://do 10.1109/lgrs.2010.2100076 http://dx.doi.org/10.1109/lgrs.2010.2100076

Chen P , Li X N , Zheng G . 2019 . Rapid detection to long ship wake in synthetic aperture radar satellite imagery . Journal of Oceanology and Limnology , 37 ( 5 ): 1523 - 1532 , https://doi.‍org/10.1007/s00343-019-8221-y https://doi.‍org/10.1007/s00343-019-8221-y . https://do 10.1007/s00343-019-8221-y http://dx.doi.org/10.1007/s00343-019-8221-y

Chen W M , Han B , Yang Z et al . 2022 . MSSDet: multi-scale ship-detection framework in optical remote-sensing images and new benchmark . Remote Sensing , 14 ( 21 ): 5460 , https://doi.org/10.3390/rs14215460 https://doi.org/10.3390/rs14215460 .

Dong Y X , Chen F K , Han S et al . 2021 . Ship object detection of remote sensing image based on visual attention . Remote Sensing , 13 ( 16 ): 3192 , https://doi.org/10.3390/rs13163192 https://doi.org/10.3390/rs13163192 .

He K M , Zhang X Y , Ren , S Q et al . 2016 . Deep residual learning for image recognition . In: Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . IEEE , Las Vegas, NV, USA . p. 770 - 778 . https://do 10.1109/cvpr.2016.90 http://dx.doi.org/10.1109/cvpr.2016.90

He Z , Huang L , Zeng W J et al . 2021 . Elongated small object detection from remote sensing images using hierarchical scale-sensitive networks . Remote Sensing , 13 ( 16 ): 3182 , https://doi.org/10.3390/rs13163182 https://doi.org/10.3390/rs13163182 .

Heiselberg H . 2016 . A direct and fast methodology for ship recognition in sentinel-2 multispectral imagery . Remote Sensing , 8 ( 12 ): 1033 , https://doi.org/10.3390/rs8121033 https://doi.org/10.3390/rs8121033 .

Hough P V C . ( 1962-03-25 ). Method and means for recognizing complex patterns . United States Patent No . 3069654 .

Hu J M , Zhi X Y , Shi T J et al . 2021 . S. PAG-YOLO: a portable attention-guided YOLO network for small ship detection . Remote Sensing , 13 ( 16 ): 3059 , https://doi.org/10.3390/rs13163059 https://doi.org/10.3390/rs13163059 .

Karakuş O , Anantrasirichai N , Aguersif A et al . 2020a . Detection of line artifacts in lung ultrasound images of COVID-19 patients via nonconvex regularization . IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control , 67 ( 11 ): 2218 - 2229 , https://doi.org/10.1109/TUFFC.2020.3016092 https://doi.org/10.1109/TUFFC.2020.3016092 .

Karakuş O , Rizaev I , Achim A . 2020b . Ship wake detection in SAR images via sparse regularization . IEEE Transactions on Geoscience and Remote Sensing , 58 ( 3 ): 1665 - 1677 , https://doi.org/10.1109/TGRS.2019.2947360 https://doi.org/10.1109/TGRS.2019.2947360 .

Lang H T , Xi Y Y , Zhang X . 2019 . Ship detection in high-resolution SAR images by clustering spatially enhanced pixel descriptor . IEEE Transactions on Geoscience and Remote Sensing , 57 ( 8 ): 5407 - 5423 , https://doi.org/10.1109/TGRS.2019.2899337 https://doi.org/10.1109/TGRS.2019.2899337 .

Li C , Hu J M , Wang D W et al . 2023a . Ship detection via multi-scale deformation modeling and fine region highlight-based loss function . Remote Sensing , 15 ( 17 ): 4337 , https://doi.org/10.3390/rs15174337 https://doi.org/10.3390/rs15174337 .

Li J F , Chen M X , Hou S Y et al . 2023b . An improved S2A-Net algorithm for ship object detection in optical remote sensing images . Remote Sensing , 15 ( 18 ): 4559 , https://doi.org/10.3390/rs15184559 https://doi.org/10.3390/rs15184559 .

Li L H , Zhou Z Q , Wang B et al . 2021 . A novel CNN-based method for accurate ship detection in HR optical remote sensing images via rotated bounding box . IEEE Transactions on Geoscience and Remote Sensing , 59 ( 1 ): 686 - 699 , https://doi.org/10.1109/TGRS.2020.2995477 https://doi.org/10.1109/TGRS.2020.2995477 .

Lin T Y , Goyal P , Girshick R et al . 2017 . Focal loss for dense object detection . In: Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV) . IEEE , Venice, Italy . p. 2980 - 2988 . https://do 10.1109/iccv.2017.324 http://dx.doi.org/10.1109/iccv.2017.324

Liu Y F , Zhao J , Qin Y . 2021 . A novel technique for ship wake detection from optical images . Remote Sensing of Environment , 258 : 112375 , https://doi.org/10.1016/j.rse.2021.112375 https://doi.org/10.1016/j.rse.2021.112375 .

Radon J . 1986 . On the determination of functions from their integral values along certain manifolds . IEEE Transactions on Medical Imaging , 5 ( 4 ): 170 - 176 , https://doi.org/10.1109/TMI.1986.4307775 https://doi.org/10.1109/TMI.1986.4307775 .

Redmon J , Divvala S , Girshick R et al . 2016 . You only look once: unified, real-time object detection . In: Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . IEEE , Las Vegas, NV, USA . p. 779 - 788 . https://do 10.1109/cvpr.2016.91 http://dx.doi.org/10.1109/cvpr.2016.91

Ren S Q , He K M , Girshick R et al . 2017 . Faster R-CNN: towards real-time object detection with region proposal networks . IEEE Transactions on Pattern Analysis and Machine Intelligence , 39 ( 6 ): 1137 - 1149 , https://doi.‍org/10.1109/TPAMI.2016.2577031 https://doi.‍org/10.1109/TPAMI.2016.2577031 . https://do 10.1109/tpami.2016.2577031 http://dx.doi.org/10.1109/tpami.2016.2577031

Xu F , Liu J H , Sun H et al . 2021 . Research progress on vessel detection using optical remote sensing image . Optics and Precision Engineering , 29 ( 4 ): 916 - 931 , https://doi.org/10.37188/OPE.2020.0419. https://doi.org/10.37188/OPE.2020.0419. (in Chinese)

Yang T , Wang X , Zhu S J et al . 2023 . LMSD-Net: a lightweight and high-performance ship detection network for optical remote sensing images . Remote Sensing , 15 ( 17 ): 4358 , https://doi.org/10.3390/rs15174358 https://doi.org/10.3390/rs15174358 .

Zhang F , Wang X Y , Zhou S L et al . 2022a . Arbitrary-oriented ship detection through center-head point extraction . IEEE Transactions on Geoscience and Remote Sensing , 60 : 5612414 , https://doi.org/10.1109/TGRS.2021.3120411 https://doi.org/10.1109/TGRS.2021.3120411 .

Zhang H P , Zhang X Y , Meng G et al . 2022b . Few-shot multi-class ship detection in remote sensing images using attention feature map and multi-relation detector . Remote Sensing , 14 ( 12 ): 2790 , https://doi.org/10.3390/rs14122790 https://doi.org/10.3390/rs14122790 .

Zhang T , Tian B , Sengupta D et al . 2021 . Global offshore wind turbine dataset . Scientific Data , 8 ( 1 ): 191 , https://doi.org/10.1038/s41597-021-00982-z https://doi.org/10.1038/s41597-021-00982-z .

Zhao Z , Ji K F , Xing X W et al . 2014a . Ship surveillance by integration of space-borne SAR and AIS—review of current research . The Journal of Navigation , 67 ( 1 ): 177 - 189 , https://doi.org/10.1017/S0373463313000659 https://doi.org/10.1017/S0373463313000659 .

Zhao Z , Ji K F , Xing X W et al . 2014b . Ship surveillance by integration of space-borne SAR and AIS—further research . The Journal of Navigation , 67 ( 2 ): 295 - 309 , https://doi.org/10.1017/S0373463313000702 https://doi.org/10.1017/S0373463313000702 .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

A physics-enhanced deep-learning model for estimating turbid shallow water depth from SAR images

Prediction of sea surface pCO₂ in the South China Sea using Spatiotemporal Convolutional LSTM model

Deep neural network based on adversarial training for short-term high-resolution precipitation nowcasting from radar echo images

A deep learning-based hybrid model for improved SST prediction in the tropical Pacific Ocean

基于模态频率的V型缺口梁裂纹扩展速率模型