Aaron Hao Tan

I am a Ph.D. candidate, advised by Dr. Goldie Nejat, at the University of Toronto Robotics Institute, where I work on giving robot teams the ability to anticipate the world via deep MARL, and generative AI.

I was recently nominated by the University of Toronto as a PhD Apple Scholar in AI/ML, 2023 (1 of 3 university wide). During my internship at General Motors, I worked on rider sweat prediction for the ARIV E-Bike project.

Updated: June 2024

Email  /  CV  /  Resume  /  Google Scholar

I have worked on the entire mobile robotics stack from novel hardware design, to multi-robot perception and control.

We present a novel robot exploration map prediction method called Confidence-Aware Contrastive Conditional Consistency Model (4CNet), to predict (foresee) unknown spatial configurations in unknown unstructured multi- robot environments with irregularly shaped obstacles.

We propose NavFormer, a novel end-to-end DL architecture consisting of a dual-visual encoder module and a transformer-based navigation network to address for the first time the problem of TDN in unknown and dynamic environments.

The first Macro Action Decentralized Exploration Network (MADE-Net) using multi-agent deep reinforcement learning to address the challenges of communication dropouts during multi-robot exploration in unseen, unstructured, and cluttered environments.

The first extensive investigation of mobile robot inference problems in unknown environments with limited sensor and communication range and propose a new taxonomy to classify the different environment and task inference methods for single- and multi-robot systems.

The development of a novel sim-to-real pipeline for a mobile robot to effectively learn how to navigate real-world 3D rough terrain environments.

A 1:6 scale, multi-wheeled mobile robotic platform with independent suspension, steering and actuation for off-terrain operations.

I was acknowledged in the development of a smart clothing system using low-cost, energy-efficient strain sensors to measure elbow and shoulder joint angles. A novel neural network architecture was used to enhance the accuracy of the sensor signal mapping.

We propose a novel two-step deep learning (DL) method based on our extended ResNet-50 model. It can detect and classify whether face masks are missing, are worn correctly or incorrectly, or the face is covered by other means (e.g., a hand or hair).

We propose a novel process for a 6-DOF static one-armed robotic manipulator to address the challenges of pillow placement on a small-scale bed.

The first application of deep learning to the classification of homonymous defects on automated perimetry.

A competition designed to answer: how can robots respond and interact in an ethical manner when delivery objects within a domestic setting? Placed First.

Implemented image and position-based visual servoing on a Clearpath Husky and UR5 Manipulator.

• Accelerating the scholarship application process via LLM agents to help students secure funding while focusing on their studies.

• Selected by Microsoft Startup Hub Program, receiving grants worth $150k.

• An all-in-one service built in to iMessage aimed at lowering the barrier of entry for LLMs and Generative AI.

• Launched multi-modal conversations with proprietary model before 4 months before GPT-4V.

source code