😊 About Me
Greetings! I’m Dongyu (Rain) Yao (姚栋宇), a Master's student in Computer Vision (MSCV) at Carnegie Mellon University. I obtained my Bachelor of Engineering (B.E.) degree at the School of Cyber Science and Engineering, Wuhan University (WHU). Prior to WHU, I spent three years studying at No.1 Middle School Affiliated to CCNU (华中师大一附中).
🔬 Research Interest
My research interests focus on Data-centric AI and Trustworthy (Multi-modal) AI, encompassing key areas in Computer Vision (data-efficient scene understanding), Natural Language Processing, and Generative Models (LLMs and MLLMs).
- Machine learning and Computer Vision
- Domain Adaptation and Transfer Learning
- Natural Language Processing
- Trustworthy Large Language Models
🔥 News
- 2024.09: One paper is accepted by NeurIPS 2024.
- 2024.06: Obtained my Bachelor of Engineering (B.E.) degree in Cyberspace Security.
- 2024.05: Selected as Outstanding Graduate (Award Rate: 10%).
- 2024.04: One paper is accepted by CogSci 2024 as Oral Presentation.
- 2024.03: Admitted to the Master of Science in Computer Vision (MSCV) program at Carnegie Mellon University!!!
- 2024.01: Our work of FuzzLLM is invited to present at one of the top hacker conventions – ShmooCon 2024!
- 2023.12: One paper is accepted by ICASSP 2024.
- 2023.10: I won the National Scholarship (Award Rate: 0.2% national-wide), First Class Scholarship (Award Rate: 5% school-wide), and was awarded the Pacemaker to Merit Student of WHU (Award Rate: 60/59774=0.1%).
- 2023.10: I ranked 1/144 in the annual comprehensive assessment (the only participant with a 90+ overall score).
- 2023.08: One paper is accepted by ICCVW UnCV 2023.
- 2023.05: Two of our projects won the First Prize in the 16th China Undergraduate Computer Design Competition of Middle South Division (Award Rate: 3%).
- 2022.10: I won the Second Class Scholarship and was graded as Merit Student (both 10% school-wide) of WHU.
📝 Publications
† : equal contribution, * : corresponding author
-
Lips Are Lying: Spotting the Temporal Inconsistency between Audio and Visual in Lip-Syncing DeepFakes [arXiv]
Weifeng Liu, Tianyi She, Jiawei Liu, Boheng Li, Dongyu Yao, Ziyou Liang, Run Wang
Annual Conference on Neural Information Processing Systems (NeurIPS), 2024
-
CORE: Mitigating Catastrophic Forgetting in Continual Learning through Cognitive Replay [arXiv]
Jianshu Zhang†, Yankai Fu†, Ziheng Peng†, Dongyu Yao, Kun He*
Cognitive Science Society Annual Conference (CogSci), 2024 (Oral)
-
FuzzLLM: A Novel and Universal Fuzzing Framework for Proactively Discovering Jailbreak Vulnerabilities in Large Language Models [arXiv] [Code]
Dongyu Yao†, Jianshu Zhang†, Ian G. Harris* , Marcel Carlsson
International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024
-
Dual-level Interaction for Domain Adaptive Semantic Segmentation [arXiv] [Code]
Dongyu Yao, Boheng Li*
ICCV Workshop on Uncertainty Quantification for Computer Vision (UnCV), 2023
Sorted by date of acceptance.
🏅 Honors and Awards
- 2024.06 Outstanding Graduate (Award Rate: 10%) Wuhan University
- 2023.10 Pacemaker to Merit Student (Award Rate: 60/59774=0.1%) Wuhan University
- 2023.10 National Scholarship (Award Rate: 0.2% national-wide) Ministry of Education, China
- 2023.10 First Class Scholarship of WHU (Award Rate: 5% school-wide) Wuhan University
- 2023.08 National Second Prize in the 16th China Undergraduate Computer Design Competition (Award Rate: 10% nation-wide)
- 2023.05 First Prize*2 in the 16th China Undergraduate Computer Design Competition of Middle South Division (Award Rate: 3% division-wide)
- 2022.10 Second Class Scholarship of WHU (Award Rate: 10% school-wide) Wuhan University
- 2022.10 Merit Student (Award Rate: 10% school-wide) Wuhan University
- 2021.12 First Prize in Top-10 Instrumentalists Contest. (Award Rate: 1% school-wide) Wuhan University
- 2021.07 Second Prize in the 6th National University Student Art Festival (Award Rate: 15% nation-wide) Ministry of Education, China
- 2021.07 First Prize in the 7th Provincial University Student Art Festival (Award Rate: 5% Province-wide) Ministry of Education, Hubei Province
📖 Educations
- 2024.08 - 2025.12 (expected), Master's student in Computer Vision (MSCV), Robotics Institute (RI), School of Computer Science (SCS), Carnegie Mellon University (CMU), USA.
- 2020.09 - 2024.06, Undergraduate, School of Cyber Science and Engineering, Wuhan University, China. B.E. in Cyberspace Security.
- 2017.09 - 2020.06, Senior High (Distinguished High School Graduate), No.1 Middle School Affiliated to CCNU (华中师大一附中), China.
💻 Internships
- 2024.04 - 2024.07, Machine Learning Engineer Intern at TikTok (ByteDance)
- 2023.07 - 2023.09, UCInspire Summer Research Program (University of California Irvine), Supervised by Prof. Ian G. Harris
- 2022.07 - 2023.12, Student Research Assistant at Key Laboratory of Aerospace Information Security and Trusted Computing, Supervised by Prof. Run Wang
- 2022.03 - 2022.11, Student Research Assistant at NIS&P lab, supervised by Prof. Qian Wang
🎢 Activities
Academic Services
Conference Reviewer:
- IEEE Symposium on Computers & Informatics (ISCI), 2025
- IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE), 2025
Journal Reviewer:
- Applied Intelligence Journal, Springer Nature
University Services
- 2020.09 - 2023.09, Chief Percussionist at Wuhan University Symphony Orchestra
Teaching Experiences
- Teaching Assistant, Big Data Analysis, Undergrads, SCSE, WHU, Fall 2023. [Lecture Slides] [Lecture Slides]
- Teaching Assistant, Artificial Intelligence (AI), Undergrads, SCSE, WHU, Fall 2022. [Lecture Slides] [Exam Paper]
Invited Talks
- How to prepare for TOEFL listening and speaking, Spring 2023. [Lecture Slides]
🍲 Misc
🥁 Music Band & Symphony Orchestra
I have been practicing and performing the percussion instruments for 18+ years (since 4 years old). My repertoire of performance skills includes instruments found in symphony orchestras and other types of music (Rock, Funk, Jazz, Pop, Chinese Folk music, etc.), such as the Snare drum, Timpani, Bass drum, Drum kit, Cymbals, Triangle, Chimes, Glockenspiel, Vibraphone, Xylophone, Marimba, Tambourine, Conga, Gong, Clave, etc.
Here are some selected recordings of my performances:
- 2023.12: New Year's Eve celebration (Most songs played in a single performance) at SCSE, Wuhan University
- 2023.05: 23's Rock Music Festival (武大制噪) at Wuhan University
- 2022.06: My first Livehouse performance at Rainbow Pub, Wuhan
- 2022.05: 22's Midsummer Music Festival at Wuhan University
- 2021.12: Top-10 Instrumentalists Contest at Wuhan University
- 2021.09: My Favorite Solo & Improvisation Drum Performance at Wuhan University
- 2020.12: 2021 New Year's Concert at Qintai Concert Hall, Wuhan
🎤 Voice & Eloquence
- I developed a strong passion for delivering English speeches during my junior school years, after winning several championships in English speaking contests.
- My favorite speech is Lincoln’s Gettysburg Address.
- My TOEFL single best score is 112 with 28 for speaking, thanks to my day-to-day oral practice. I also scored 330 (v162 + q168 + w4.0) in GRE.
🏀 Basketball Team
- I played Shooting Guard at the Men’s Basketball Team of SCSE during my undergrad years