PAIRS Lab

Research

Our focus on

Physical AI

Physical AI refers to AI embedded in physical systems that perceive, reason, and act in the real world through a continuous loop of sensing, decision-making, action, and feedback.

PAIRS Lab develops trustworthy and scalable Physical AI that operates safely and robustly, protects people, uses data and resources efficiently, and continually adapts to broader tasks. We address barriers to long-horizon, widespread deployment toward a human–machine ecosystem in which people and intelligent physical systems coexist, collaborate, and co-evolve.

↑ Research directions

01Operate under extremes

Robust Perception and Autonomous Navigation

Our research focuses on robust perception and autonomous navigation for safety-critical applications, including firefighting, disaster response, and emergency rescue. We develop learning-based and end-to-end navigation methods that combine multimodal perception with hazard-aware decision-making. By integrating complementary sensing modalities such as thermal imaging and radar, we aim to enable safe, adaptive, and reliable navigation despite poor visibility, extreme heat, dynamic hazards, and degraded sensor performance.

Selected research and lab demonstrations

Published work and ongoing prototypes are identified separately, with original sources linked when available.
Real-world demo

2026

End-to-End Goal-Initialized Navigation

GUIDE learns directional awareness from depth and proprioceptive history, enabling a legged robot to navigate cluttered environments without continuous goal updates or prior maps.

Explore GUIDE
Adverse-weather demo

NeurIPS 2024

All-Weather 3D Occupancy with 4D Radar

RadarOcc uses 4D imaging radar to estimate dense 3D occupancy in adverse weather and lighting conditions where camera- and LiDAR-based perception can degrade.

Explore RadarOcc
Scene Flow
Segmentation
Ego-Motion

CVPR 2023 Highlight

4D Radar Scene Flow Estimation

Hidden Gems learns scene flow from sparse 4D radar through cross-modal supervision, supporting motion segmentation and ego-motion estimation in dynamic driving scenes.

Explore Hidden Gems
Fire rescue

Ongoing lab prototype · Not linked to a publication

FireNav: Hazard-Aware Navigation in Fire-ground Environment

FireNav combines controllable fire simulation with synchronized thermal and 4D radar observations to benchmark PointGoal Navigation, evaluating goal completion and collision avoidance alongside peak temperature and cumulative heat exposure.

Related outputs: [GUIDE · 2026] [HyperDet · 2026] [Wavelet Radar-Camera Fusion · 2026] [Robust Spatial Perception · RSS Pioneers 2025] [RadarOcc · NeurIPS 2024] [Backdraft Forecasting · EAAI 2024] [RaTrack · ICRA 2024] [Hidden Gems · CVPR 2023] [All-Day UAV Tracking · TMC 2023] [RaFlow · RA-L 2022] [Ad2Attack · ICRA 2022]

↑ Research directions

02Remember and act

Long-Horizon Manipulation and Agentic Robotics

Our research focuses on long-horizon manipulation and agentic robotics, integrating perception, memory, task planning, and policy learning to enable robots to decompose goals, coordinate skills, and execute multi-step tasks. We investigate agents that monitor progress, adapt plans, and recover from failures under partial observability and changing environments. By coupling high-level reasoning with closed-loop control informed by visual and physical feedback, we aim to enable reliable and adaptive manipulation in the real world.

Selected research and lab demonstrations

Published work and ongoing prototypes are identified separately, with original sources linked when available.
Real-robot demo

CVPR 2026

Progress-Aware Long-Horizon Manipulation

PALM combines structured affordance reasoning with continuous subtask progress estimation to maintain coherent behavior across multi-step manipulation tasks.

Explore PALM
Lab demonstration

Ongoing lab prototype · Not linked to a publication

Sequential Block Stacking with a Single Arm

This lab demonstration follows a single robotic arm as it places blocks in sequence. The setup provides a focused testbed for perception, action sequencing, task-state tracking, and reliable execution as we develop longer and more adaptive manipulation behaviors.

Related outputs: [PALM · CVPR 2026] [Dexterous Manipulation Survey · T-ASE 2025]

↑ Research directions

03Sense motion and contact

Human Motion and Physical Interaction Sensing

We develop multimodal sensing systems to understand human motion and physical interactions. By combining millimeter-wave radar, vision, wearable sensors, and force measurements, we capture movement, muscle activity, and interaction forces. Through synchronized data acquisition, sensor calibration, and multimodal learning, we build physically grounded representations to support robot learning, human–computer interaction, and rehabilitation.

Selected research and lab demonstrations

Published work and ongoing prototypes are identified separately, with original sources linked when available.
Lab demonstration

Ongoing lab prototype · Not linked to a publication

Wrist-Worn Muscle-Activity Sensing

This lab demonstration shows a wrist-worn sensing setup collecting multichannel surface electromyography and inertial signals during hand gestures. The prototype supports our exploration of compact wearable measurements that connect muscle activation with motion and physical interaction.

Dataset demo

CVPR 2026

Multimodal Human Motion Capture and Mesh Reconstruction

M4Human synchronizes mmWave radar, RGB-D, and marker-based motion capture at scale, supporting radar-based reconstruction of articulated 3D human meshes.

Explore M4Human
Adverse-condition demo

SenSys 2025

Thermal Egocentric Hand Pose

ThermoHands captures articulated 3D hand motion from egocentric thermal images during object interactions, including conditions affected by darkness, glare, and handwear.

Explore ThermoHands
milliFlow human motion sensing research preview Research preview

ECCV 2024

mmWave Radar Human Motion Sensing

milliFlow estimates human scene flow from sparse mmWave radar point clouds, providing motion representations without relying on conventional visible-light imagery.

View milliFlow

Related outputs: [AI-based Motor Assessment · TNSRE 2026] [M4Human · CVPR 2026] [ThermoHands · SenSys 2025] [milliFlow · ECCV 2024]

↑ Research directions

04Synthesize and scale

Generative Simulation and Robot Learning

Our research focuses on generative simulation and robot learning through a real–sim–real pipeline. We reconstruct real-world scenes and use generative models to create diverse virtual environments. Physics-based simulation provides interaction data for policy learning, and we investigate the transfer of learned policies to real robots. We aim to reduce data collection costs and improve generalization to new objects, tasks, environments, and robot platforms.

Selected research and lab demonstrations

Published work and ongoing prototypes are identified separately, with original sources linked when available.
Physics-aware generation

2026

Seeking Physics in Diffusion Noise

Seeking Physics uncovers physical-plausibility signals in intermediate diffusion features, then uses a lightweight verifier to select and guide denoising trajectories toward more physically consistent generated videos.

Explore Seeking Physics
Generation demo

ECCV 2026

Camera-Conditioned Radar Data Generation

RadarGen synthesizes automotive radar point clouds from multi-view cameras while preserving geometry, motion, and occlusion structure, illustrating a data-generation pipeline grounded in real scenes.

Explore RadarGen
Lab demonstration

Ongoing lab prototype · Not linked to a publication

TacFoundry: Touch-Aware Real-to-Sim Asset Generation from Video

TacFoundry turns ordinary videos into touchable, simulation-ready objects. It reconstructs 3D geometry, replays real gripper motions in a physics simulator, and generates simulated tactile observations using a learned sensor model.

Lab demonstration

Ongoing lab prototype · Not linked to a publication

WorldForge: Learning Physics from Real-World Feedback

WorldForge is an agentic Real2Sim2Real framework that learns physical properties from real-world robot interactions and failures to continuously refine simulation. It enables the simulator and robot policy to co-evolve, with the aim of improving sim-to-real transfer.

Related outputs: [Physion-Eval · 2026] [Seeking Physics in Diffusion Noise · 2026] [RadarGen · ECCV 2026]