MDCGA-Net: Multi-Scale Direction Context-Aware Network with Global Attention for Building Extraction from Remote Sensing Images

Article


Niu, Penghui, Gu, Junhua, Zhang, Yajuan, Zhang, Ping, Cai, Taotao, Xu, Wenjia and Han, Jungong. 2024. "MDCGA-Net: Multi-Scale Direction Context-Aware Network with Global Attention for Building Extraction from Remote Sensing Images." IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 17, pp. 8461-8476. https://doi.org/10.1109/JSTARS.2024.3387969
Article Title

MDCGA-Net: Multi-Scale Direction Context-Aware Network with Global Attention for Building Extraction from Remote Sensing Images

ERA Journal ID200605
Article CategoryArticle
AuthorsNiu, Penghui, Gu, Junhua, Zhang, Yajuan, Zhang, Ping, Cai, Taotao, Xu, Wenjia and Han, Jungong
Journal TitleIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Journal Citation17, pp. 8461-8476
Number of Pages16
Year2024
PublisherIEEE (Institute of Electrical and Electronics Engineers)
Place of PublicationUnited States
ISSN1939-1404
2151-1535
Digital Object Identifier (DOI)https://doi.org/10.1109/JSTARS.2024.3387969
Web Address (URL)https://ieeexplore.ieee.org/abstract/document/10497862
Abstract

Building extraction from remote sensing images (RSIs) requires exploring multiscale boundary detailed information and extracting it completely, which is challenging but indispensable. However, existing solutions tend to augment feature information solely through multiscale fusion and apply attention mechanisms to focus on feature relationships within a single layer while ignoring the multiscale information, which affects segmentation results. Therefore, enhancing the capability of the network to adaptively capture multiscale information and capture the global relationship of features remains a pivotal challenge in overcoming the aforementioned hurdles. To address the preceding challenge, we propose a Multiscale Direction Context-aware network with Global Attention (MDCGA-Net), employing a classic encoder–decoder architecture enhanced with direction information and global attention flow. Specifically, in the encoder part, the multiscale layer is used to extract contextual information from the interlayer. In addition, the multiscale direction context-aware module is adopted to adaptively acquire multiscale information. In the decoder part, we propose a global attention gate module to capture discriminative features. Furthermore, we construct an operation of attention feature flow to obtain the global relationship among the different features with long-range dependencies, which guarantees the integrity of results. Finally, we have performed comprehensive experiments on three public datasets to showcase the efficacy and efficiency of MDCGA-Net in building extraction.

KeywordsBuilding extraction; multiscale direction context-aware; global attention; deep learning (DL)
Contains Sensitive ContentDoes not contain sensitive content
ANZSRC Field of Research 2020460299. Artificial intelligence not elsewhere classified
Public Notes

Files associated with this item cannot be displayed due to copyright restrictions.

Byline AffiliationsSchool of Mathematics, Physics and Computing
Permalink -

https://research.usq.edu.au/item/z9v25/mdcga-net-multi-scale-direction-context-aware-network-with-global-attention-for-building-extraction-from-remote-sensing-images

  • 31
    total views
  • 0
    total downloads
  • 2
    views this month
  • 0
    downloads this month

Export as

Related outputs

A Survey on Truth Discovery: Concepts, Methods, Applications, and Opportunities
Wang, Shuang, Zhang, He, Sheng, Quan Z., Li, Xiaoping, Sun, Zhu, Cai, Taotao, Zhang, Wei Emma, Yang, Jian and Gao, Qing. 2024. "A Survey on Truth Discovery: Concepts, Methods, Applications, and Opportunities." IEEE Transactions on Big Data. https://doi.org/10.1109/TBDATA.2024.3423677
ECS-STPM: An Efficient Model for Tunnel Fire Anomaly Detection
Song, Huansheng, Wen, Ya, Song, Xiangyu, Sun, ShiJie, Cai, Taotao and Li, Jianxin. 2024. "ECS-STPM: An Efficient Model for Tunnel Fire Anomaly Detection." 7th International Joint Conference on Asia-Pacific Web and Web-Age Information Management (APWeb-WAIM 2023). Wuhan, China 06 - 08 Oct 2023 Singapore . Springer. https://doi.org/10.1007/978-981-97-2421-5_19
YOLO-SA: An Efficient Object Detection Model Based on Self-attention Mechanism
Li, Ang, Song, Xiangyu, Sun, ShiJie, Zhang, Zhaoyang, Cai, Taotao and Song, Huansheng. 2024. "YOLO-SA: An Efficient Object Detection Model Based on Self-attention Mechanism." 7th International Joint Conference on Asia-Pacific Web and Web-Age Information Management (APWeb-WAIM 2023). Wuhan, China 06 - 08 Oct 2023 Singapore. Springer. https://doi.org/10.1007/978-981-97-2421-5_1
Special issue on link prediction in complex networks
Sheng, Michael, Cai, Taotao and Mahmood, Adnan. 2024. "Special issue on link prediction in complex networks." Computing. 106 (7), pp. 2079-2079. https://doi.org/10.1007/s00607-024-01298-7
Optimal Treatment Strategies for Critical Patients with Deep Reinforcement Learning
Job, Simi, Tao, Xiaohui, Li, Lin, Xie, Haoran, Cai, Taotao, Yong, Jianming and Li, Qing. 2024. "Optimal Treatment Strategies for Critical Patients with Deep Reinforcement Learning ." ACM Transactions on Intelligent Systems and Technology. 15 (2), pp. 1-22. https://doi.org/10.1145/3643856
Robust equivalent circuit model parameters identification scheme for State of Charge (SOC) estimation based on maximum correntropy criterion
Zhang, Kexin, Zhao, Xuezhuan, Chen, Yu, Wu, Di, Cai, Taotao, Wang, Yi, Li, Lingling and Zhang, Ji. 2024. "Robust equivalent circuit model parameters identification scheme for State of Charge (SOC) estimation based on maximum correntropy criterion." International Journal of Electrochemical Science. 19 (5). https://doi.org/10.1016/j.ijoes.2024.100558
FRAMU: Attention-based Machine Unlearning using Federated Reinforcement Learning
Shaik, Thanveer, Tao, Xiaohui, Li, Lin, Xie, Haoran, Cai, Taotao, Zhu, Xiaofeng and Li, Qing. 2024. "FRAMU: Attention-based Machine Unlearning using Federated Reinforcement Learning ." IEEE Transactions on Knowledge and Data Engineering. 36 (10), pp. 5153-5167. https://doi.org/10.1109/TKDE.2024.3382726
Reconnecting the Estranged Relationships: Optimizing the Influence Propagation in Evolving Networks
Cai, Taotao, Lei, Qi, Sheng, Quan Z., Cui, Ningning, Yang, Shuiqiao, Yang, Jian, Zhang, Wei Emma and Mahmood, Adnan. 2024. "Reconnecting the Estranged Relationships: Optimizing the Influence Propagation in Evolving Networks." IEEE Transactions on Knowledge and Data Engineering. 36 (5), pp. 2151-2165. https://doi.org/10.1109/TKDE.2023.3316268
Emergency department presentations during the COVID-19 pandemic in Queensland (to June 2021): interrupted time series analysis
Sweeny, Amy L, Keijzers, Gerben, Marshall, Andrea, Hall, Emma J, Ranse, Jamie, Zhang, Ping, Grant, Gary, Huang, Ya-Ling, Palipana, Dinesh, Teng, Yang D, Gerhard, Benjamin, Greenslade, Jaimi H, Jones, Philip and Crilly, Julia L. 2023. "Emergency department presentations during the COVID-19 pandemic in Queensland (to June 2021): interrupted time series analysis." Medical Journal of Australia. 218 (3), pp. 120-125. https://doi.org/10.5694/mja2.51819
Top-k socio-spatial co-engaged location selection for social users
Hasan Haldar, Nur Al, Li, Jianxin, Ali, Mohammed Eunus, Cai, Taotao, Chen, Yunliang, Sellis, Timos and Reynolds, Mark. 2023. "Top-k socio-spatial co-engaged location selection for social users." IEEE Transactions on Knowledge and Data Engineering. 35 (5), pp. 5325-5340. https://doi.org/10.1109/TKDE.2022.3151095
Towards Multi-User, Secure, and Verifiable kNN Query in Cloud Database
Cui, Ningning, Qian, Kang, Cai, Taotao, Li, Jianxin, Yang, Xiaochun, Cui, Jie and Zhong, Hong. 2023. "Towards Multi-User, Secure, and Verifiable kNN Query in Cloud Database." IEEE Transactions on Knowledge and Data Engineering. 35 (9), pp. 9333-9349. https://doi.org/10.1109/TKDE.2023.3237879
Incremental graph computation: Anchored Vertex Tracking in Dynamic Social Networks
Cai, Taotao, Yang, Shuiqiao, Li, Jianxin, Sheng, Quan Z., Yang, Jian, Wang, Xin, Zhang, Wei Emma and Gao, Longxiang. 2023. "Incremental graph computation: Anchored Vertex Tracking in Dynamic Social Networks." IEEE Transactions on Knowledge and Data Engineering. 35 (7), pp. 7030-7044. https://doi.org/10.1109/TKDE.2022.3199494
Vitrimer-like, mechanically Robust, healable and recyclable biobased elastomers based on epoxy natural Rubbers, polylactide and layered double hydroxide
Zhang, Ping, You, Pingfeng, Feng, Jiabing, Xie, Ruishi, Chen, Lin, Xiong, Ying and Song, Pingan. 2023. "Vitrimer-like, mechanically Robust, healable and recyclable biobased elastomers based on epoxy natural Rubbers, polylactide and layered double hydroxide." Composites Part A: Applied Science and Manufacturing. 171. https://doi.org/10.1016/j.compositesa.2023.107575
Dynamic Correlation Adjacency Matrix Based Graph Neural Network for Traffic Flow Prediction
Gu, Junhua, Jia, Zhihao, Cai, Taotao, Song, Xiangyu and Mahmood, Adnan. 2023. "Dynamic Correlation Adjacency Matrix Based Graph Neural Network for Traffic Flow Prediction." Sensors. 23 (6). https://doi.org/10.3390/s23062897
A 3D rGO-supported NiFe2O4 heterostructure from sacrificial polymer-assisted exfoliation of NiFe-LDH for efficient oxygen evolution reaction
Zhang, Ping, Chen, Lin, Ge, Lei, Song, Pingan, Xie, Ruishi, Wang, Bin, Fu, Yingke, Jia, Shuyu, Liao, Ting and Xiong, Ying. 2022. "A 3D rGO-supported NiFe2O4 heterostructure from sacrificial polymer-assisted exfoliation of NiFe-LDH for efficient oxygen evolution reaction." Carbon. 200, pp. 422-429. https://doi.org/10.1016/j.carbon.2022.08.085
Effects of BN/GO on the recyclable, healable and thermal conductivity properties of ENR/PLA thermoplastic vulcanizates
Jia, Chunhui, Zhang, Ping, Seraji, Seyed Mohsen, Xie, Ruishi, Chen, Lin, Liu, Dong, Xiong, Ying, Chen, Hao, Fu, Yingke, Xu, Hailun and Song, Pingan. 2022. "Effects of BN/GO on the recyclable, healable and thermal conductivity properties of ENR/PLA thermoplastic vulcanizates." Composites Part A: Applied Science and Manufacturing. 152, pp. 1-10. https://doi.org/10.1016/j.compositesa.2021.106686
Robust cross-network node classification via constrained graph mutual information
Yang, Shuiqiao, Cai, Borui, Cai, Taotao, Song, Xiangyu, Jiang, Jiaojiao, Li, Bing and Li, Jianxin. 2022. "Robust cross-network node classification via constrained graph mutual information." Knowledge-Based Systems. 257. https://doi.org/10.1016/j.knosys.2022.109852
A survey on deep learning based knowledge tracing
Song, Xiangyu, Li, Jianxin, Cai, Taotao, Yang, Shuiqiao, Yang, Tingting and Liu, Chengfei. 2022. "A survey on deep learning based knowledge tracing." Knowledge-Based Systems. 258. https://doi.org/10.1016/j.knosys.2022.110036
Target-Aware Holistic Influence Maximization in Spatial Social Networks
Cai, Taotao, Li, Jianxin, Mian, Ajmal, Li, Rong-Hua, Sellis, Timos and Yu, Jeffrey Xu. 2022. "Target-Aware Holistic Influence Maximization in Spatial Social Networks ." IEEE Transactions on Knowledge and Data Engineering. 34 (4), pp. 1993-2007. https://doi.org/10.1109/TKDE.2020.3003047
High-Temperature Nitridation Induced Carbon Nanotubes@NiFe-Layered-Double-Hydroxide Nanosheets Taking as an Oxygen Evolution Reaction Electrocatalyst for CO2 Electroreduction
Chen, Hao, Zhang, Ping, Xie, Ruishi, Xiong, Ying, Jia, Chunhui, Fu, Yingke, Song, Pingan, Chen, Lin, Zhang, Yaping and Liao, Ting. 2021. "High-Temperature Nitridation Induced Carbon Nanotubes@NiFe-Layered-Double-Hydroxide Nanosheets Taking as an Oxygen Evolution Reaction Electrocatalyst for CO2 Electroreduction." Advanced Materials Interfaces. 8 (19), pp. 1-9. https://doi.org/10.1002/admi.202101165
Mechanically Strong, Thermally Healable, and Recyclable Epoxy Vitrimers Enabled by ZnAl-Layer Double Hydroxides
Li, Gaoming, Zhang, Ping, Huo, Siqi, Fu, Yingke, Chen, Lin, Wu, Yeping, Zhang, Yingyu, Chen, Mao, Zhao, Xiuli and Song, Pingan. 2021. "Mechanically Strong, Thermally Healable, and Recyclable Epoxy Vitrimers Enabled by ZnAl-Layer Double Hydroxides." ACS Sustainable Chemistry and Engineering. 9 (6), pp. 2580-2590. https://doi.org/10.1021/acssuschemeng.0c08636
Strong, tough and healable elastomer nanocomposites enabled by a hydrogen-bonded supramolecular network
Li, Jiajun, Zhang, Ping, Chen, Lin, Li, Gaoming, Chen, Hao, Jia, Chunhui, Wu, Yeping, Chen, Mao, Zhao, Xiuli and Song, Pingan. 2020. "Strong, tough and healable elastomer nanocomposites enabled by a hydrogen-bonded supramolecular network." Composites Communications. 22, pp. 1-7. https://doi.org/10.1016/j.coco.2020.100530
Community-diversity Driven Influence Maximization on Social Networks
Li, Jianxin, Cai, Taotao, Ke, Deng, Wang, Xinjue, Sellis, Timos and Xia, Feng. 2020. "Community-diversity Driven Influence Maximization on Social Networks." Information Systems. 92. https://doi.org/10.1016/j.is.2020.101522
Anchor vertex selection for enhanced reliability of traffic offloading service in edge-enabled mobile P2P social networks
Zhang, Hengda, Wang, Xiaofei, Fan, Hao, Cai, Taotao, Li, Jianxin, Li, Xiuhua and Leung, Victor C. M.. 2020. "Anchor vertex selection for enhanced reliability of traffic offloading service in edge-enabled mobile P2P social networks." Journal of Communications and Information Networks. 5 (2), pp. 217-224. https://doi.org/10.23919/JCIN.2020.9130437
Anchored Vertex Exploration for Community Engagement in Social Networks
Cai, Taotao, Li, Jianxin, Hasan Haldar, Nur Al, Mian, Ajmal, Yearwood, John and Sellis, Timos. 2020. "Anchored Vertex Exploration for Community Engagement in Social Networks ." 2020 IEEE 36th International Conference on Data Engineering (ICDE). Dallas, United States 20 - 24 Apr 2020 United States. IEEE (Institute of Electrical and Electronics Engineers). https://doi.org/10.1109/ICDE48307.2020.00042
Visdrone-sot2018: The vision meets drone single-object tracking challenge results
Wen, Longyin, Zhu, Pengfei, Du, Dawei, Bian, Xiao, Ling, Haibin, Hu, Qinghua, Liu, Chenfeng, Cheng, Hao, Liu, Xiaoyu, Ma, Wenya, Nie, Qinqin, Wu, Haotian, Wang, Lianjie, Perera, Asanka G., Zhang, Baochang, Heo, Byeongho, Liu, Chunlei, Li, Dongdong, Michail, Emmanouil, ..., He, Zhiqun. 2019. "Visdrone-sot2018: The vision meets drone single-object tracking challenge results." European Conference on Computer Vision 2018 Workshops. Munich, Germany 09 - 14 Sep 2018 Germany. Springer. https://doi.org/10.1007/978-3-030-11021-5_28
Correlate Influential News Article Events to Stock Quote Movement
Mandalapu, Arun Chaitanya, Gunabalan, Saranya, Sadineni, Avinash, Cai, Taotao, Hasan, Nur Al Hasan and Li, Jianxin. 2019. "Correlate Influential News Article Events to Stock Quote Movement ." Li, Jianxin, Wang, Sen, Qin, Shaowen, Li, Xue and Wang, Shuliang (ed.) 15th International Conference on Advanced Data Mining and Applications. Dalian, China 21 - 23 Nov 2019 Switzerland. Springer. https://doi.org/10.1007/978-3-030-35231-8_24
Holistic Influence Maximization for Targeted Advertisements in Spatial Social Networks
Li, Jianxin, Cai, Taotao, Mian, Ajmal, Li, Rong-Hua, Sellis, Timos and Yu, Jeffrey Xu. 2018. "Holistic Influence Maximization for Targeted Advertisements in Spatial Social Networks ." 2018 IEEE 34th International Conference on Data Engineering (ICDE). Paris, France 16 - 19 Apr 2018 United States. IEEE (Institute of Electrical and Electronics Engineers). https://doi.org/10.1109/ICDE.2018.00145
Efficient Distance-based Representative Skyline Computation in 2D Space
Mao, Rui, Cai, Taotao, Li, Rong-Hua, Yu, Jeffery Xu and Li, Jianxin. 2017. "Efficient Distance-based Representative Skyline Computation in 2D Space." World Wide Web. 20 (4), pp. 621-638. https://doi.org/10.1007/s11280-016-0406-0
Efficient Algorithms for Distance-Based Representative Skyline Computation in 2D Space
Cai, Taotao, Li, Rong-Hua, Yu, Jeffrey Xu, Mao, Rui and Cai, Yadi. 2015. "Efficient Algorithms for Distance-Based Representative Skyline Computation in 2D Space ." 17th Asia-Pacific Web Conference (APWeb2015). Guangzhou, China 18 - 20 Sep 2015 Switzerland . Springer. https://doi.org/10.1007/978-3-319-25255-1_10