👋 I am currently pursuing a MPhil degree in Data Science at Tsinghua University. My research interests include AI Agent, 3D AIGC, and Avatar (Human-centered generation, rigging and driving, including image and video or 3D and 4D generation.), especially in areas that have a strong connection to humans. And would like to realize AGI for the benefit of humanity through generative AI.
My google scholar is here
🎓 I received my B.S. in Software Engineering from Harbin Engineering University under the supervision of Prof. Chao Li. I had an internship at the Institute of Automation, Chinese Academy of Sciences, supervised by Prof. Yubo Chen. I had a good time with Prof. Hao Zhao and Prof. Jason Zhaoxin Fan at Institute for AI Industry Research (AIR), Tsinghua University. I will continue my MPhil’s degree in Data Science at Institute of Data and Information (iDI), Shenzhen International Graduate School (SIGS), Tsinghua University under the supervision of Prof. Ruqi Huang.
🙋♂️ If you are interested in working with me, feel free to drop me an email. yisuanwang AT gmail DOT com.
😥 I’ll be emo on a regular basis, which is a normal phenomenon and nothing to worry about.
⬅️ Never place your mouse over the left avatar! Never!
🔥 News
- 2024.11: 🎉 Idea-2-3D has been accepted by COLING 2025! 🎉 See you in Abu Dhabi, UAE, from January 19 to 24, 2025!
- 2024.11: 🎉 We released DRiVE, generate skeleton and skinning with clothes and hair for 3d gaussian avatar!
- 2024.09: 🎉 We released IW-bench, evaluating Large Multimodal Models for Converting Image-to-Web!
- 2024.04: 🎉 I was awarded the Outstanding Graduate of Heilongjiang Province!
- 2024.03: 🎉 We released Ultraman, which converts a single image of the human body into a lifelike 3D model!
📝 Publications
🧑🎨 3D AIGC
DRiVE: Diffusion-based Rigging Empowers Generation of Versatile and Expressive Characters
Mingze Sun *, Junhao Chen *, Junting Dong †, Yurun Chen, Xinyu Jiang, Shiwei Mao, Puhua Jiang, Jingbo Wang, Bo Dai, Ruqi Huang †
- This work generates skeleton and skinning with clothes and hair for 3d gaussian avatar!
Idea23D: Collaborative LMM Agents Enable 3D Model Generation from Interleaved Multimodal Inputs
Junhao Chen *, Xiang Li *, Xiaojun Ye, Chao Li, Zhaoxin Fan †, Hao Zhao †
- This work enables automated 3D model design and generation for people!
Ultraman: Single Image 3D Human Reconstruction with Ultra Speed and Detail
Mingjin Chen *, Junhao Chen *, Xiaojun Ye, Huan-ang Gao, Xiaoxue Chen, Zhaoxin Fan, Hao Zhao †
- This work converts a single image of the human body into a lifelike 3D model!
👀 Multi-modal
IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Web
Hongcheng Guo, Wei Zhang, Junhao Chen, Yaonan Gu, Jian Yang, Junjia Du, Binyuan Hui, Tianyu Liu, Jianxin Ma, Chang Zhou
- This work is a benchmark for evaluating MLLM image-2-html code generation capabilities.
MMAD: Multi-modal Movie Audio Description
Xiaojun Ye, Junhao Chen, Xiang Li, Haidong Xin, Chao Li, Sheng Zhou †, Jiajun Bu
- This work has unlocked a whole new experience of watching movies for the visually impaired.
Soulstyler: Using Large Language Model to Guide Image Style Transfer for Target Object
Junhao Chen, Peng Rong, Jingbo Sun, Chao Li †, Xiang Li, Hongwu Lv
- This work enables fine-grained stylization of a single image through text-guidance!
🎙 NLP & LLM
Towards Energy-Efficient Sentiment Classification with Spiking Neural Networks
Junhao Chen, Xiaojun Ye, Jingbo Sun, Chao Li †
- This work applies a pulsed neural network to a natural language sentiment categorization task, reaching the leading edge in terms of energy consumption.
ZhuJiu: A Multi-dimensional, Multi-faceted Chinese Benchmark for Large Language Models
Baoli Zhang *, Haining Xie *, Pengfan Du, Junhao Chen, Pengfei Cao, Yubo Chen †, Shengping Liu, Kang Liu, Jun Zhao
[📜Paper]
[🎥Video]
- This work serves as a benchmark for evaluating the Chinese language capabilities of large language models.
🎖 Honors and Awards
Innovation and Entrepreneurship Competition Award Cumulative Awards National *10, Provincial *45, School-level *11, totaling 66.
Honors awards cumulative awards national *6, provincial *2, school-level *20, a total of 28.
Competition awards and individual honors total 94 (as of 11, 18, 2024).
List of all awards received during undergraduate studies.
Selected Awards and Honors
📖 Educations
- 2024.08 - 2027.06, M.Eng. in Data Science @ Shenzhen International Graduate School (SIGS), Tsinghua University, Shenzhen.
- 2021.06 - 2024.06, B.Eng. in Software Engineering (rank 1 / 223) @ College of Software, Harbin Engineering University, Harbin.
- 2020.09 - 2021.06, Undergraduate, College of Electromechanical Engineering, Harbin Engineering University, Harbin.
💻 Experiences
- 2024.06 - 2024.08, Lightillusions, Shenzhen.
- 2023.12 - 2024.05, Shenzhen International Graduate School (SIGS), Tsinghua University, Shenzhen.
- 2023.09 - 2023.12, DISCOVERLab@Institute for AI Industry Research (AIR), Tsinghua University, Wuxi.
- 2023.04 - 2023.09, Research Group of Speech and Language Technology, National Laboratory of Pattern Recognition@Institute of Automation, Chinese Academy of Sciences, Remote.
- 2021.07 - 2023.04, Modeling and Emulation in E-Government National Engineering Laboratory, Harbin.