Publications

Journal Article

  1. Xingwei Pan, Song Xiang, Shilong Niu, Zheng Zhang, Jun Wang, Guangliang Li*. Multi-task Learning for Underwater Robot via Progressive Neural Network. Robot Learning, 2025 (2): 0009.
  2. Jun Wang, Song Xiang, Tian Shen, Zheng Fang, Shilong Niu, Xingwei Pan, Guangliang Li*. Imitation Learning from Observation for ROV Path Tracking. Intelligent Marine Technology and Systems. 2025(3): 20.
  3. Fang Zheng, Tianhao Chen, Tian Shen, Dong Jiang, Zheng Zhang, Guangliang Li*. Multi-Agent Generative Adversarial Interactive Self-Imitation Learning for AUV Formation Control and Obstacle Avoidance. IEEE Robotics and Automation Letters, 2025.
  4. Shilong Niu, Xingwei Pan, Jun Wang, Guangliang Li*. Deep Reinforcement Learning from Human Preferences for ROV Path Tracking. Ocean Engineering, 2025.
  5. Guangliang Li* and Randy Gomez. Embodied Intelligence: Realizing Full Body Control of Humanoid Robots, Nature Machine Intelligence, 2024.
  6. Tianhao Chen, Zheng Zhang, Zheng Fang, Dong Jiang, Guangliang Li*. Imitation learning from imperfect demonstrations for AUV path tracking and obstacle avoidance. Ocean Engineering, 2024
  7. Wei Meng, Hao Ju, Tongxu Ai, Randy Gomez, Eric Nichols, Guangliang Li*. Transferring Meta-Policy from Simulation to Reality via Progressive Neural Network. IEEE Robotics and Automation Letters, 2024
  8. Hao Ju, Rongshun Juan, Randy Gomez, Keisuke Nakamura, Guangliang Li*.Transferring Policy of Deep Reinforcement Learning from Simulation to Reality for Robotics. Nature Machine Intelligence, 2022, 4:1077-1087
  9. Zheng Fang, Dong Jiang, Jie Huang, Chunxi Cheng, Qixin Sha, Bo He, Guangliang Li*. Autonomous Underwater Vehicle Formation Control and Obstacle Avoidance Using Multi-Agent Generative Adversarial Imitation Learning. Ocean Engineering. 2022, 262(6):112182
  10. Dong Jiang, Jie Huang, Zheng Fang, Chunxi Cheng, Qixin Sha, Bo He, Guangliang Li*. Generative Adversarial Interactive Imitation Learning for Path Following of Autonomous Underwater Vehicle. Ocean Engineering. 2022, 260(1):111971
  11. Chunxi Cheng, Qixin Sha, Bo He, Guangliang Li*. Path Panning and Obstacle Avoidance for AUV: A Review. Ocean Engineering. 2021, 235:109355
  12. Guangliang Li*, Hamdi Dibeklioğlu, Shimon Whiteson and Hayley Hung. Facial Feedback for Reinforcement Learning: A Case Study and Offline Analysis Using the TAMER Framework. Autonomous Agents and Multi-Agent Systems (AAMAS), 2020, 34:1-29
  13. Guangliang Li, Randy Gomez, Keisuke Nakamura and Bo He. Human-Centered Reinforcement Learning: A Survey. IEEE Transactions on Human-Machine Systems. 2019.
  14. Guangliang Li, Shimon Whiteson, W. Bradley Knox and Hayley Hung. Social interaction for efficient agent learning from human reward. Journal of Autonomous Agents and Multi-Agent Systems. 2018.
  15. Guangliang Li, Shimon Whiteson, W. Bradley Knox and Hayley Hung. Using Informative Behavior to Increase Engagement While Learning from Human Reward. Autonomous Agents and Multi-Agent Systems. 2016.
  16. Christos Dimitrakakis, Guangliang Li, Nikoalos Tziortziotis. The Reinforcement Learning Competition 2014. AI Magazine, AAAI, 35(3): 61-65, 2014 Fall.

Conference Papers

  1. Xuyang Li, Jianwu Fang, Lin Li, Boyuan Chen, Guangliang Li, Jianru Xue. Guided Distillation and Risk Adaptive Evolution for Multi-Robot Navigation. The Fortieth AAAI Conference on Artificial Intelligence (AAAI 2026).
  2. Yang Chen, Mingyang Hu, Liu Tian, Eric Nichols, Randy Gomez, Guangliang Li*. Improving Social Robot Haru’s Emotional Perception via Physiological Signal Recognition and Analysis. The 2025 IEEE International Conference on Robotics and Biomimetics (IEEE ROBIO 2025).
  3. Tongxu Ai, Yohei Hayamizu, Pengyu Zhao, Shiqi Zhang, Eric Nichols, Randy Gomez, Guangliang Li*. Policy Generating and Value Shaping via Large Language Model for Long-Horizon Manipulation. The 7th China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI 2025).
  4. Zicheng Sun, Enqi Zhao, Ke Zhang, Zheng Fang, Eric Nichols, Randy Gomez, Guangliang Li*. Model-based Imitation Learning with Sim-to-real Transfer for Mobile Robot Path Planning. The 7th China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI 2025).
  5. Hongqi Yu, Liu Tian, Fanggeng Xiong, Yang Chen, Eric Nichols, Randy Gomez, Guangliang Li*. Shaping Embodied Chatbot Haru Emotional Intelligence with Human Implicit Feedback. The 7th China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI 2025).
  6. Tian Shen, Zheng Fang, Song Xiang, Randy Gomez, Guangliang Li*. Multi-AUV Coordination via Large Language Model-in-the-Loop Generative Adversarial Interactive Self-Imitation Learning. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025 (Late Breaking Results)
  7. Fei Tang, Mingyang Hu, Yu Fang, Eric Nichols, Randy Gomez, Guangliang Li*. Social Robot Haru Assisting Dynamic Group Discussion with Autonomous Eye Gaze Behavior. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025
  8. Liu Tian, Yang Chen, Mingyang Hu, Eric Nichols, Randy Gomez, Guangliang Li*. Social Robot Haru Imitating Human Gaze for Attention and Turn-taking Coordination in Multi-party Conversation. In Proceedings of the 17th International Conference on Social Robotics, 2025
  9. Hongqi Yu, Fei Tang, Lei Zhang, Randy Gomez, Eric Nichols, Guangliang Li*. Improving Perceived Emotional Intelligence of Embodied Chatbot Haru via Multi-Modal Interaction. The 2024 IEEE International Conference on Robotics and Biomimetics (IEEE ROBIO 2024).
  10. Lei Zhang, Chuanxiong Zheng, Hui Wang, Randy Gomez, Eric Nichols, Guangliang Li. Autonomous Storytelling with Social Robot Haru with Human-Centered Reinforcement Learning. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
  11. Zheng Zhang, Xingwei Pan, Tianhao Chen, Dong Jiang, Zheng Fang, Guangliang Li. Deep Reinforcement Learning with Model Predictive Control for Path Following of Autonomous Underwater Vehicle. The 43rd Chinese Control Conference (CCC 2024).
  12. Fei Tang, Chuanxiong Zheng, Hongqi Yu, Lei Zhang, Eric Nichols, Randy Gomez, Guangliang Li. Assisting Group Discussions Using Desktop Robot Haru. International Conference on Robotics and Automation (ICRA), 2024
  13. Chuanxiong Zheng, Lei Zhang, Hui Wang, Randy Gomez, Eric Nichols, Guangliang Li. Shaping Social Robot to Play Games with Human Demonstrations and Evaluative Feedback. International Conference on Robotics and Automation (ICRA), 2024
  14. Lei Zhang, Chuanxiong Zheng, Hui Wang, Eric Nichols, Randy Gomez, Guangliang Li*. Emotional Understanding and Behavior Learning for Haru via Social Reinforcement Learning. In Proceedings of the 15th International Conference on Social Robotics, 2023
  15. Jie Huang, Jiangshan Hao, Rongshun Juan, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Model-based Adversarial Imitation Learning from Demonstrations and Human Reward. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023.
  16. Rongshun Juan, Hao Ju, Jie Huang, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Sim-to-Real Policy and Reward Transfer with Adaptive Forward Dynamics Model. The 2023 International Conference on Robotics and Automation (ICRA).
  17. Jie Huang, Jiangshan Hao, Rongshun Juan, Randy Gomez, Keisuke Nakamura, Guangliang Li*. GAN-Based Interactive Reinforcement Learning from Demonstration and Human Evaluative Feedback. The 2023 International Conference on Robotics and Automation (ICRA).
  18. Lei Zhang, Chuanxiong Zheng, Hui Wang, Eric Nichols, Randy Gomez, Guangliang Li*. Emotional Understanding for Social Robot Haru via Human-Centered Reinforcement Learning. The 2023 International Conference on Robotics and Automation (ICRA) Workshop: Balanced Cyberphysical Society
  19. Fei Tang, Chuanxiong Zheng, Hao Ju, Hui Wang, Lei Zhang, Eric Nichols, Randy Gomez, Guangliang Li*. Where to Look during Conversation: Autonomous Attentive Behavior Learning for Social Robot via Deep Reinforcement Learning. The 2023 International Conference on Robotics and Automation (ICRA) Workshop: Balanced Cyberphysical Society
  20. Hui Wang, Jinying Lin, Zhen Ma, Yurii Vasylkiv, Heike Brock, Keisuke Nakamura, Randy Gomez, Bo He, Guangliang Li*.Affective Behavior Learning for Social Robot Haru with Implicit Evaluative Feedback. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.3881-3888, 2022
  21. Hui Wang, Guodong Chen, Randy Gomez, Keisuke Nakamura, Bo He, Guangliang Li*.Shaping Haru’s Affective Behavior with Valence and Arousal Based Implicit Facial Feedback. In Proceedings of the 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 769-776, 2022
  22. Chuanxiong Zheng, Hui Wang, Lei Zhang, Jiang Shan Hao, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Imitating Human Strategy for Social Robot in Real-Time Two-Player Games. In Proceedings of the 14th International Conference on Social Robotics, pp.1-12,2022
  23. Hui Wang, Lei Zhang, Chuanxiong Zheng, Randy Gomez, Keisuke Nakamura, Guangliang Li*. Personalized Storytelling with Social Robot Haru. In Proceedings of the 14th International Conference on Social Robotics, pp. 1-12, 2022
  24. Qilei Zhang, Chunxi Cheng, Zheng Fang, Dong Jiang, Bo He, Guangliang Li*.Continuous Control for Autonomous Underwater Vehicle Path Following Using Deep Interactive Reinforcement Learning. In Proceedings of the 2022 International Conference on Machine Learning, Control, and Robotics, pp. 1-8, 2022
  25. Dong Jiang, Zheng Fang, Chunxi Cheng, Bo He, Guangliang Li*.Action Guidance-Based Deep Interactive Reinforcement Learning for AUV Path Planning. In Proceedings of the 2022 International Conference on Machine Learning, Control, and Robotics, pp. 1-8, 2022
  26. Yurii Vasylkiv, Zhen Ma, Guangliang Li*, Eleanor Sandry, Heike Brock, Keisuke Nakamura, Irani Pourang and Randy Gomez.Automating Behavior Selection for Affective Telepresence Robot. In Proceedings of the 2021 International Conference on Robotics and Automation (ICRA), pp. 2026-2032, IEEE, 2021
  27. Rongshun Juan, Jie Huang, Randy Gomez, Keisuke Nakamura, Qixin Sha, Bo He, Guangliang Li*. Shaping Progressive Net of Reinforcement Learning for Policy Transfer with Human Evaluative Feedback. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1281-1288, IEEE, 2021
  28. Guangliang Li*, Hamdi Dibeklioğlu, Shimon Whiteson, Hayley Hung. Facial Feedback for Reinforcement Learning: A Case Study and Offline Analysis Using the TAMER Framework. In Proceedings of the 20th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), pp. 1735-1737, 2021
  29. Yurii Vasylkiv, Zhen Ma, Guangliang Li*, Heike Brock, Keisuke Nakamura, Irani Pourang and Randy Gomez. Shaping Affective Robot Haru’s Reactive Response. In Proceedings of the 30th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 989-996, IEEE, 2021
  30. Jinying Lin, Qilei Zhang, Randy Gomez, Keisuke Nakamura, Bo He, Guangliang Li*. Human Social Feedback for Efficient Interactive Reinforcement Agent Learning. In Proceedings of the 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp.706-712, 2020
  31. Guangliang Li*, Randy Gomez, Keisuke Nakamura, Bo He. Interactive Reinforcement Learning from Demonstration and Human Evaluative Feedback. In Proceedings of 27th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2018, pp. 1156-1162. (Nanjing City Prize and UBTech Prize)
  32. Guangliang Li, Hamdi Dibeklioglu, Shimon Whiteson and Hayley Hung. Towards Learning from Implicit Human Reward. In AAMAS 2016: Proceedings of the 15th International Joint Conference on Autonomous Agents and Multi-Agent Systems. May 2016, Singapore. AAMAS 2016
  33. Guangliang Li and Bo He. Reinforcement Learning from Demonstration and Human Reward. At Adaptive Learning Agents workshop on the 15th International Joint Conference on Autonomous Agents and Multi-Agent Systems. May 2016, Singapore. ALA at AAMAS 2016
  34. Guangliang Li, Hayley Hung, Shimon Whiteson. A Large-Scale Study of Agents Learning from Human Reward. In AAMAS 2015: Proceedings of the 14th International Joint Conference on Autonomous Agents and Multi-Agent Systems. May 2015, Istanbul, Turkey. AAMAS 2015
  35. Sander Bakkes, Shimon Whiteson, Guangliang Li, George Viorel Visniuc, Efstathios Charitos, Norbert Heijne, and Arjen Swellengrebel. Challenge Balancing for Personalised Game Spaces. In GEM 2014: Proceedings of the 6th IEEE Consumer Electronics Society Games, Entertainment, Media Conference. October 2014, Toronto, Canada. IEEE GEM 2014
  36. Guangliang Li, Hayley Hung, Shimon Whiteson and W. Bradley Knox. Learning from Human Reward Benefit from Social-competitive Feedback. In ICDL-EpiRob 2014: Proceedings of the 4th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics. October 2014, Genoa, Italy. ICDL-Epirob 2014
  37. Guangliang Li, Hayley Hung, Shimon Whiteson and W. Bradley Knox. Leveraging Social Networks to Motivate Humans to Train Agents. In AAMAS 2014: Proceedings of the 13th International Joint Conference on Autonomous Agents and Multi-Agent Systems. May 2014, Paris, France. AAMAS 2014
  38. Eugenio Bargiacchi, Camiel Verschoor, Guangliang Li and Diederik Roijers. Decentralized Solutions and Tactics for RTS. In BNAIC 2013: Proceedings of the 25th Benelux Conference on Artifical Intelligence. November 2013, Delft, the Netherlands. Demo BNAIC 2013
  39. Guangliang Li, Hayley Hung, Shimon Whiteson and W. Bradley Knox. Using Informative Behavior to Increase Engagement in the TAMER Framework. In AAMAS 2013: Proceedings of the 12th International Joint Conference on Autonomous Agents and Multi-Agent Systems. May 2013, Minnesota, US. AAMAS 2013
  40. Sile Ma, Qingmei Chen, Guangliang Li and Xiaohu he. Label checking system of flat bottles based on siemens PLC. In WCICA 2010: Proceedings of the 8th World Congress on Intelligent Control and Automation. 2010, Jinan, China. WCICA 2010