Home

Quadruped Robot Locomotion using Deep Reinforcement Learning

This project is the final project of ESE 650 Learning in Robotics at the University of Pennsylvania. In this project, I used Deep Reinforcement Learning (DRL) to train an agent to control the locomotion of a quadruped robot. The DRL algorithm used in this project is Proximal Policy Optimization (PPO). The simulation environment was developed us...

Read more

VIO-based Quadrotor

This project contains seven assignments and a cumulative final assignment in MEAM620 Advanced Robotics at the University of Pennsylvania. In this course, I implemented a geometric nonlinear controller, two trajectory generators that are based on Dijkstra and A*, a complementary filter for attitude estimation based on data from a six-axis IMU, a...

Read more

Interaction Simulation using Reinforcement Learning

This project aims at simulating interaction in a virtual environment using Reinforcement Learning and Unity ML-Agents. It was supervised by Dr. Suvranu De, the head of the Department of MANE (Mechanical, Aerospace, and Nuclear Engineering) at Rensselaer Polytechnic Institute and the director of CeMSIM (Center for Modeling, Simulation, and Imagin...

Read more

VCP (Virtual Chemical Plant)

In this project, I developed two VR simulations with Dr. Ronald Hedden, a professor in the Department of Chemical Engineering at Rensselaer Polytechnic Institute, for education in process control and thermodynamics using Unity, C#, Blender, and MATLAB. I applied my knowledge of game development, 3D modeling, heat transfer, fluid flow, thermodyna...

Read more