Welcome to Haoyuan Jiang’s Personal Homepage!

I am currently a Ph.D. student at the Technical University of Munich (TUM), where I also work as a Research Assistant. I build AI algorithms at the intersection of reinforcement learning, large foundation models and autonomous agents.

Before joining TUM, I worked as an Algorithm Expert at Alibaba Group and as a Senior Algorithm Engineer at Baidu, focusing on using reinforcement learning to improve model capabilities and performance, which has been used in large foundation models (Qwen and Ernie) and end2end autonomous driving.

I am particularly interested in building autonomous agents capable of reasoning, adaptation, self-improvement and generalization across diverse environments, with a long-term goal of contributing to the development of AGI. My research interests include Reinforcement Learning, General Agentic AI, LLM Reasoning and World Model.

Feel free to contact me if you are interested in my research and want to discuss relevant research topic or potential collaborations!

News

• 2026.06:  🎓🚀 I started a new journey as a Ph.D. student at TUM!
• 2026.02:  💼🚀 I joined Alibaba Group.
• 2024.05:  🎉🎉 One paper is accepted by KDD 2024.
• 2024.04:  🎉🎉 One first-author paper is accepted by IJCAI 2024.
• 2024.02:  🎉🎉 One first-author paper is accepted by IEEE TITS.

Publications

• IJCAI X-Light: Cross-City Traffic Signal Control Using Transformer on Transformer as Meta Multi-Agent Reinforcement Learner
  Haoyuan Jiang, Ziyue Li, Hua Wei, Xuantang Xiong, Jingqing Ruan, Jiaming Lu, Hangyu Mao, Rui Zhao.
  International Joint Conference on Artificial Intelligence(IJCAI), 2024. (Oral)
  

@inproceedings{ijcai2024p11,
  title = {X-Light: Cross-City Traffic Signal Control Using Transformer on Transformer as Meta Multi-Agent Reinforcement Learner},
  author = {Jiang, Haoyuan and Li, Ziyue and Wei, Hua and Xiong, Xuantang and Ruan, Jingqing and Lu, Jiaming and Mao, Hangyu and Zhao, Rui},
  booktitle = {Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, {IJCAI-24}},
  publisher = {International Joint Conferences on Artificial Intelligence Organization},
  editor = {Larson, Kate},
  pages = {94--102},
  year = {2024},
  month = {8},
  note = {Main Track},
  doi = {10.24963/ijcai.2024/11},
  url = {https://doi.org/10.24963/ijcai.2024/11}
}

• TITS A General Scenario-Agnostic Reinforcement Learning for Traffic Signal Control
  Haoyuan Jiang, Ziyue Li, Zhishuai Li, Lei Bai, Hangyu Mao, Wolfgang Ketter, Rui Zhao.
  IEEE Transactions on Intelligent Transportation Systems(IEEE TITS), 2024.
  

@article{jiang2024general,
  title = {A General Scenario-Agnostic Reinforcement Learning for Traffic Signal Control},
  author = {Jiang, Haoyuan and Li, Ziyue and Li, Zhishuai and Bai, Lei and Mao, Hangyu and Ketter, Wolfgang and Zhao, Rui},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2024},
  url = {https://ieeexplore.ieee.org/abstract/document/10481508/}
}

• KDD CoSLight: Co-optimizing Collaborator Selection and Decision-making to Enhance Traffic Signal Control
  Jingqing Ruan, Ziyue Li, Hua Wei, Haoyuan Jiang, Jiaming Lu, Xuantang Xiong, Hangyu Mao, Rui Zhao.
  ACM SIGKDD Conference on Knowledge Discovery and Data Mining(KDD), in Barcelona, Spain, 2024. (Oral)
  

@inproceedings{ruan2024coslight,
  title = {CoSLight: Co-optimizing Collaborator Selection and Decision-making to Enhance Traffic Signal Control},
  author = {Ruan, Jingqing and Li, Ziyue and Wei, Hua and Jiang, Haoyuan and Lu, Jiaming and Xiong, Xuantang and Mao, Hangyu and Zhao, Rui},
  booktitle = {Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining},
  year = {2024},
  doi = {10.1145/3637528.3671998},
  url = {https://dl.acm.org/doi/10.1145/3637528.3671998}
}

• AAMAS DuaLight: Enhancing Traffic Signal Control by Leveraging Scenario-Specific and Scenario-Shared Knowledge
  Jiaming Lu, Jingqing Ruan, Haoyuan Jiang, Ziyue Li, Hangyu Mao, Rui Zhao.
  International Conference on Autonomous Agents and Multi-Agent Systems(AAMAS), in Auckland, New Zealand, 2024. (Oral)
  

@inproceedings{lu2024dualight,
  title = {DuaLight: Enhancing Traffic Signal Control by Leveraging Scenario-Specific and Scenario-Shared Knowledge},
  author = {Lu, Jiaming and Ruan, Jingqing and Jiang, Haoyuan and Li, Ziyue and Mao, Hangyu and Zhao, Rui},
  booktitle = {Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems},
  year = {2024},
  doi = {10.5555/3635637.3662986},
  url = {https://dl.acm.org/doi/10.5555/3635637.3662986}
}

Preprint

• arXiv GuideLight: “Industrial Solution” Guidance for More Practical Traffic Signal Control Agents. Haoyuan Jiang, Xuantang Xiong, Ziyue Li, Hangyu Mao, Guanghu Sui, Jingqing Ruan, Yuheng Cheng, Hua Wei, Wolfgang Ketter, Rui Zhao.

@article{jiang2024guidelight,
  title = {GuideLight: "Industrial Solution" Guidance for More Practical Traffic Signal Control Agents},
  author = {Jiang, Haoyuan and Xiong, Xuantang and Li, Ziyue and Mao, Hangyu and Sui, Guanghu and Ruan, Jingqing and Cheng, Yuheng and Wei, Hua and Ketter, Wolfgang and Zhao, Rui},
  journal = {arXiv preprint arXiv:2407.10811},
  year = {2024},
  url = {https://arxiv.org/abs/2407.10811}
}

Educations

• 2026.06 - Present, Ph.D. in RL & ML, TUM, Germany.
• 2017.09 - 2019.06, Master in Software Engineering, Zhejiang University.

Experiences

• 2026.06 - Present, Research Assistant, TUM, Germany.
• 2026.02 - 2026.04, Algorithm Expert, Alibaba, China.
• 2023.09 - 2026.01, Senior Algorithm Engineer, Baidu Inc., China.
• 2018.07 - 2018.11, Research Intern, ByteDance AI Lab, China.

Selected Services

Program Committee Member or Reviewer:

• Conference on Neural Information Processing Systems (NeurIPS 2025, 2026)
• International Joint Conference on Artificial Intelligence (IJCAI 2025, 2026)
• International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2025, 2026)

Honors and Awards

• 2017, 14th National Graduate Mathematical Modeling Competition, Second Prize.
• 2017, Honor Student in IBM Innovation Bootcamp.
• 2018, 11th China College Students’ Entrepreneurship Competition, Bronze Award in Zhejiang Province.
• 2022, IJCAI 2022 - Neural MMO Challenge, Bronze Tier Award.
• 2022, Outstanding Individual of the Year in Sensetime SCG R&D Department.
• 2024, Outstanding AIT Project in Baidu Inc.