👋 About Me
I am a first-year Ph.D. student at Xi’an Jiaotong University.
🔍Research Topics
- Remote Sensing Image Interpretation: Change Detection, Building Extraction, etc
- Computer Vision: Image Classification, Segmentation, Detection, etc.
- Deep Learning: Vison-Language Models, Foundation Models, etc.
🔥 News
- 2024.12: One paper on Semi-supervised Change Detection based on Vision-Language Model is accepted by TGRS.
- 2024.11: My Google Scholar citations are over 1,000 ! 🎉
- 2024.09: BAN becomes an ESI Highly Cited Paper.
- 2024.08: 获得山东计算机学会“浪潮新星杯”优秀硕士学位论文奖.
- 2024.07: Open-CD Technical Report v1.0 is released on arXiv, thanks to all contributors!
- 2024.05: We win 3rd place in ISPRS TC I Contest (Change Detection).
- 2024.04: One paper on RS few-shot segmentation is accepted by CVPR 2024 L3D-IVU workshop.
- 2024.04: We win 2nd place in the CVPR 2024 OpenEarthMap Land Cover Mapping Few-Shot Challenge.
- 2024.02: One paper on RS Change Detection based on Foundation Model is accepted by TGRS.
📖 Educations
- 2024.09-Now, Ph.D. at Xi’an Jiaotong University, supervised by Prof. Xiangyong Cao, Prof. Deyu Meng and Prof. Zhi Wang
- 2020.09-2023.06, M.S. at College of Computer Science and Engineering, Shandong University of Science and Technology, supervised by Prof. Sheng Fang
- 2016.09-2020.06, B.S. at College of Computer Science and Engineering, Shandong University of Science and Technology.
💻 Work Experiences
- 2023.10-2024.08, Research Assistant at School of Computer Science and Technology and Ministry of Education Key Lab For Intelligent Networks and Network Security, Xi’an Jiaotong University, supervised by Prof. Xiangyong Cao
- 2023.07-2023.08, Algorithm Engineer at Zhiyang Innovation Technology, mentored by Zhicai Liu.
- 2022.07-2022.09, Research Intern at Shandong Academy of Agricultural Sciences (SAAS), mentored by Dr. Jiye Zheng.
- 2022.01-2022.04, Research Intern at SenseTime Research, mentored by Dr. Jiang Wu.
📝 Selected Publications
My full paper list can be found at .
Open-Vocabulary Segmentation
SegEarth-OV: Towards Training-Free Open-Vocabulary Segmentation for Remote Sensing Images
Kaiyu Li, Ruixun Liu, Xiangyong Cao, Xueru Bai, Feng Zhou, Deyu Meng, Zhi Wang
- SegEarth-OV is the first to introduce training-free Open Vocabulary Semantic Segmentation into remote sensing images, which makes OVSS possible in remote sensing contexts.
Media coverage: 【遥感与深度学习】SegEarth-OV: 面向遥感图像的无训练开放词汇分割|【GISer阿兴】|【减论】|
Remote Sensing Image Change Detection
Open-CD: A Comprehensive Toolbox for Change Detection
Kaiyu Li, Jiawei Jiang, Andrea Codegoni, Chengxi Han, Yupeng Deng, Keyan Chen, Zhuo Zheng, Hao Chen, Zhengxia Zou, Zhenwei Shi, Sheng Fang, Deyu Meng, Zhi Wang, Xiangyong Cao
- Open-CD is one of the most popular change detection toolkits.
- We launch the Open-CD Technical Report Plan (Open-CD TRP for shot). We invite some authors to introduce their algorithms and participate in the construction of the Open-CD codebase. This plan is under active development and we will keep this report updated.
SemiCD-VL: Visual-Language Model Guidance Makes Better Semi-supervised Change Detector
Kaiyu Li, Xiangyong Cao, Yupeng Deng, Junmin Liu, Deyu Meng, Zhi Wang
- This work is the first to introduce visual language models to the semi-supervised change detection task.
A New Learning Paradigm for Foundation Model-based Remote Sensing Change Detection
Kaiyu Li, Xiangyong Cao, Deyu Meng
🏆️ ESI Highly Cited Paper
- BAN is the first universal framework to adapt the foundation model to the change detection task.
Changer: Feature interaction is what you need for change detection
Sheng Fang, Kaiyu Li†, Zhe Li
🏆️ ESI Highly Cited Paper
- We propose a novel general change detection architecture, MetaChanger, which includes a series of alternative interaction layers in the feature extractor.
- To verify the effectiveness of MetaChanger, we propose two derived models, ChangerAD and ChangerEx with simple interaction strategies: Aggregation-Distribution (AD) and “exchange”. AD is abstracted from some complex interaction methods, and “exchange” is a completely parameter&computation-free operation by exchanging bi-temporal features.
SNUNet-CD: A densely connected Siamese network for change detection of VHR images
Sheng Fang, Kaiyu Li†, Jinyuan Shao, Zhe Li
🏆️ ESI Highly Cited Paper
- We propose a densely connected siamese network for change detection, namely SNUNet-CD (the combination of Siamese network and NestedUNet). SNUNet-CD alleviates the loss of localization information in the deep layers of neural network through compact information transmission between encoder and decoder, and between decoder and decoder.
- Ensemble Channel Attention Module (ECAM) is proposed for deep supervision.
Few-shot Segmentation
Class Similarity Transition: Decoupling Class Similarities and Imbalance from Generalized Few-shot Segmentation
Shihong Wang*, Ruixun Liu*, Kaiyu Li*, Jiawei Jiang, Xiangyong Cao
- We propose a similarity transition matrix to guide the learning of novel classes with base class knowledge.
- Our solution wins 2nd place in the CVPR 2024 OpenEarthMap Land Cover Mapping Few-Shot Challenge.
Multi-modal Remote Sensing
S²ENet: Spatial–Spectral Cross-Modal Enhancement Network for Classification of Hyperspectral and LiDAR Data
Sheng Fang, Kaiyu Li†, Zhe Li
🏆️ ESI Highly Cited Paper
- We propose a Spatial-Spectral Enhancement Module (S²EM) for cross modal information interaction in deep neural networks. Specifically, S²EM consists of SpAtial Enhancement Module (SAEM) for enhancing spatial representation of hyperspectral data by LiDAR features and SpEctral Enhancement Module (SEEM) for enhancing spectral representation of LiDAR data by hyperspectral features.
Others
- [Road Graph Extraction] Towards Satellite Image Road Graph Extraction: A Global-Scale Dataset and A Novel Method, Pan Yin*, Kaiyu Li*, Xiangyong Cao, Jing Yao, Lei Liu, Xueru Bai, Feng Zhou, Deyu Meng. arXiv 2024.
- [Change Captioning] MV-CC: Mask Enhanced Video Model for Remote Sensing Change Captioning, Ruixun Liu*, Kaiyu Li*, Jiayi Song*, Dongwei Sun, Xiangyong Cao. arXiv 2024.
- [Agriculture] RepDI: A light-weight CPU network for apple leaf disease identification, Jiye Zheng, Kaiyu Li†, Wenbin Wu, Huaijun Ruan. COMPAG 2023.
- [Skeleton Extraction] CAMION: Cascade Multi-input Multi-output Network for Skeleton Extraction, Sheng Fang, Kaiyu Li†, Zhe Li. CVPRW 2022.
🛠 Projects
- Open-CD: A Change Detection Repo Standing on the Shoulders of Giants. (URL | Technical Report)
- Change_Detection.Pytorch (CDP): Deep learning models for change detection of remote sensing images. (URL)
- Multimodal-Remote-Sensing-Toolkit (MMRS): A python tool to perform deep learning experiments on multimodal remote sensing data. (URL)
🏆 Selected Competitions
- 2024, ISPRS TC I Contest (Change Detection) TOP3. (Collaboration with Jiawei Jiang) (URL | Code)
- 2024, CVPR 2024 OpenEarthMap Land Cover Mapping Few-Shot Challenge TOP2. (Team leader) (URL | Code)
- 2022, CVPR 2022 DLGC Pixel SkelNetOn Challenge TOP5. (SOLO) (URL)
- 2021, 中国模式识别与计算机视觉大会遥感图像智能解译挑战赛 TOP3. (SOLO) (URL | Code)
- 2021, 海洋目标智能感知国际挑战赛研究生可见光图像组 TOP1. (SOLO) (URL)
- 2021, 国际高分遥感图像解译大赛变化检测赛道 TOP4 (Collaboration with Fulin Sun and Xudong Liu) (URL)
- 2021, “东方国信杯”高校大数据开发大赛 TOP3. (SOLO) (URL)
- 2021, 第十届全国海洋航行器设计与制作大赛齐鲁赛区 二等奖. (SOLO)
- 2020, “未来杯高校 AI 挑战赛”图像赛道 TOP3. (SOLO) (URL)
- 2019, “未来杯高校 AI 挑战赛”图像组华北赛区 TOP1. (SOLO) (URL)
- 2019, “新大陆杯”第二届山东省高校大学生人工智能大赛 一等奖. (Team leader)
🎖 Honors and Awards
- 2024, Outstanding Master’s Degree Thesis Award of “Inspur Rising Star Cup”, Shandong Computer Federation | 山东计算机学会“浪潮新星杯”优秀硕士学位论文奖 (30 persons/year)
- 2023, Outstanding Graduate Student, Shandong University of Science and Technology | 山东科技大学优秀毕业研究生
- 2023, Graduate Scholarship, Shandong University of Science and Technology | 山东科技大学毕业生奖学金
- 2022, National Scholarship for Graduate Student, Ministry of Education | 研究生国家奖学金
- 2021, National Scholarship for Graduate Student, Ministry of Education | 研究生国家奖学金
- 2021, First Prize of Academic Scholarship, Shandong University of Science and Technology | 山东科技大学学业奖学金一等奖
- 2021, Outstanding Graduate Student, Shandong University of Science and Technology | 山东科技大学优秀研究生
- 2020, Outstanding Undergraduate, Shandong University of Science and Technology | 山东科技大学优秀本科毕业生
- 2016~2019, Outstanding Student Cadre, Shandong University of Science and Technology | 山东科技大学优秀学生干部
- 2016~2020, Academic Scholarship, Shandong University of Science and Technology | 山东科技大学学业奖学金
🔗 Academic Service
- Reviewer for IEEE Transactions on Geoscience and Remote Sensing (TGRS)
- Reviewer for IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
- Reviewer for IEEE Geoscience and Remote Sensing Letters (GRSL)
- Reviewer for IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (JSTARS)
- Reviewer for Conference on Computer Vision and Pattern Recognition (CVPR)
- Reviewer for Conference on Computer Vision and Pattern Recognition, Deep Learning for Geometric Computing (CVPR DLGC)