Hey, this is MY.



Hey, I'm Yi Ma, a 4th year PhD candidate of College of Intelligence and Computing in Tianjin University. I'm a member of Professor Jianye Hao's research group. I have an research interest in offline reinforcement learning and application of RL.

Besides, I'm a huge fan of basketball, snowboarding and orienteering.

  • Yi Ma and Hebin Liang won the first place prize of NeurIPS 2022 Driving SMARTS Competition in both Track 1 & 2

  • Second Prize of Innovation Pioneer as an intern in Huawei Central Research Institute
Selected Publications
Authors with equal contribution are marked by *.
  • Reining Generalization in Offline Reinforcement Learning via Representation Distinction
    Yi Ma, Hongyao Tang, Dong Li, Zhaopeng Meng
    NeurIPS 2023 | [paper]

  • A Hierarchical Imitation Learning-based Decision Framework for Autonomous Driving
    Hebin Liang, Zibin Dong, Yi Ma, Xiaotian Hao, Yan Zheng, Jianye Hao
    CIKM 2023 | [paper]

  • SplitNet: A Reinforcement Learning based Sequence Splitting Method for the MinMax Multiple Travelling Salesman Problem
    Hebin Liang*, Yi Ma*, Zilin Cao, Tianyang Liu, Fei Ni, Zhigang Li, Jianye Hao
    AAAI 2023 | [paper]

  • PAnDR: Fast Adaptation to New Environments from Offline Experiences via Decoupling Policy and Environment Representations
    Tong Sang, Hongyao Tang, Yi Ma, Jianye Hao, Yan Zheng, Zhaopeng Meng, Boyan Li, Zhen Wang
    IJCAI 2022 | [paper]

  • A Hierarchical Reinforcement Learning Based Optimization Framework for Large-scale Dynamic Pickup and Delivery Problems
    Yi Ma*, Xiaotian Hao*, Jianye HAO, Jiawen Lu, Xing Liu, Xialiang Tong, Mingxuan Yuan, Zhigang Li, Jie Tang, Zhaopeng Meng
    NeurIPS 2021 | [paper]

  • A Multi-Graph Attributed Reinforcement Learning Based Optimization Algorithm for Large-scale Hybrid Flow Shop Scheduling Problem
    Fei Ni, Jianye Hao, Jiawen Lu, Xialiang Tong, Mingxuan Yuan, Jiahui Duan, Yi Ma, Kun He
    KDD 2021 | [paper]

  • Dynamic Knapsack Optimization Towards Efficient Multi-Channel Sequential Advertising
    Xiaotian Hao*, Zhaoqing Peng*, Yi Ma*, Guan Wang, Junqi Jin, Jianye Hao, Shan Chen, Rongquan Bai, Mingzhou Xie, Miao Xu, Zhenzhe Zheng, Chuan Yu, Han Li, Jian Xu, Kun Gai
    ICML 2020 | [paper]

  • Learning to Accelerate Heuristic Searching for Large-Scale Maximum Weighted b-Matching Problems in Online Advertising
    Xiaotian Hao, Junqi Jin, Jianye Hao, Jin Li, Weixun Wang, Yi Ma,, Zhenzhe Zheng, Han Li, Jian Xu, Kun Gai
    IJCAI 2020 | [paper]

  • KoGuN: Accelerating Deep Reinforcement Learning via Integrating Human Suboptimal Knowledge
    Peng Zhang, Jianye Hao, Weixun Wang, Hongyao Tang, Yi Ma, Yihai Duan, Yan Zheng
    IJCAI 2020 | [paper]

  • Integrating Sequence and Network Information to Enhance Protein-Protein Interaction Prediction Using Graph Convolutional Networks
    Leilei Liu*, Yi Ma*, Xianglei Zhu, Yaodong Yang, Xiaotian Hao, Li Wang, Jiajie Peng
    BIBM 2019 | [paper]
Academic Service
  • NeurIPS 2022 Top Reviewer
  • Program Chair or Reviewer in NeurIPS, ICML, IJCAI, ICLR, AAAI, CIKM and DAI
  • 基于内在动机的多智能体稀疏奖励环境协作探索方法
  • 基于环境动态分解模型的深度强化学习方法
  • 基于深度强化学习的自动协商智能体设计方法
  • 基于注意力机制与强化学习的多智能体游戏AI设计方法
  • 基于对比学习和互信息的元强化学习方法
  • 面向连续-离散混合决策的游戏AI智能体强化学习方法
  • 基于层次深度强化学习的复杂游戏AI设计方法
  • 基于图神经网络和强化学习的物流调度规划方法
  • 一种订单分配方法及装置