Prajwal Koirala

Cornell University. 124 Hoy Road, Ithaca, NY 14850.

prof_pic.jpeg

I am a Ph.D. student in the College of Engineering at Cornell University, broadly interested in robotics, machine learning, and robot learning. My research centers on developing intelligent and reliable robotic systems that can operate safely and efficiently in uncertain, dynamic environments. I am particularly fascinated by problems at the intersection of perception, decision-making, and control, including how machine learning can be integrated with principled models to improve safety, robustness, and generalization in real-world robotics.

Before joining Cornell, I received my Master of Science from Iowa State University, where I worked on reinforcement learning and safety-critical control for autonomous systems under the guidance of Dr. Cody Fleming and in frequent collaboration with Dr. Soumik Sarkar. My research included developing offline reinforcement learning algorithms that integrate safety constraints into data-driven decision-making, resulting in publications at leading conferences in machine learning, robotics, and controls (ICLR, CoRL, CDC, among others). I also gained teaching experience as a Graduate Teaching Assistant, conducting lab sessions in system dynamics and control and received multiple Research Excellence Awards for my contributions during my time at Iowa State.

News

Aug 22, 2025 Thrilled to begin my Ph.D. in Robotics at Cornell University!
Excited to explore cutting-edge research in safe and intelligent autonomy. Supported in my first semester by the Cornell Fellowship.
Jul 15, 2025 Paper accepted to Conference on Decision and Control 2025, Rio de Janerio. “FAWAC: Feasibility Informed Advantage Weighted Regression for Persistent Safety in Offline Reinforcement Learning” Coauthored with Dr. Zhanhong Jiang, Dr. Soumik Sarkar and Dr. Cody Fleming. Arxiv.
Jun 26, 2025 New manuscript out: “Flow-Based Single-Step Completion for Efficient and Expressive Policy Learning”. Check it out on Arxiv.
Jun 17, 2025 Defended my MS thesis. Title - "Towards safe and efficient offline reinforcement learning - learning safety constraints and expressive policies via generative modeling"

Selected Publications

Find a complete list of the publications in my Google Scholar profile .
  1. ICLR
    2025
    Latent Safety-Constrained Policy Approach for Safe Offline Reinforcement Learning
    Prajwal Koirala, Zhanhong Jiang, Soumik Sarkar, and 1 more author
    arXiv preprint arXiv:2412.08794, 2024
  2. CoRL
    2024
    Solving offline reinforcement learning with decision tree regression
    Prajwal Koirala and Cody Fleming
    In 8th Conference on Robot Learning, 2024