Hao-Yu (Max) Hsu

I am a second-year M.S. (thesis) student in Computer Science at UIUC, advised by Prof. Shenlong Wang. My research interests lie in 3D vision, including 3D generation, 3D reconstruction and neural rendering. I am honored to receive Siebel Scholars Award, Class of 2025.

Before coming to UIUC, I worked as a research assistant at Vision & Learning Lab at National Taiwan University for two years. I am fortunate to have been advised by Prof. Yu-Chiang Frank Wang on novel view synthesis and point cloud completion, and Prof. Shao-Hua Sun on object assembly with robot learning.

I received my Bachelor's degree in Electrical Engineering from National Tsing Hua University in 2021 with the highest honor.

Email  /  CV  /  Google Scholar  /  Github  /  Twitter  /  LinkedIn

profile photo

Selected Publications

(* denotes equal contribution)
AutoVFX: Physically Realistic Video Editing from Natural Language Instructions
Hao-Yu Hsu, Zhi-Hao Lin, Albert J. Zhai, Hongchi Xia, Shenlong Wang
3DV, 2025
paper / project page / code

A system that generates dynamic, physically realistic visual effects (VFX) on a single video solely from text-based editing instructions.

SPoVT: Semantic Prototype Variational Transformer for Dense Point Cloud Semantic Completion
Sheng-Yu Huang*, Hao-Yu Hsu*, Yu-Chiang Frank Wang
NeurIPS, 2022
paper / project page / code / video

A point cloud semantic completion framework to complete partial point clouds of 3D objects with variational Transformer.

NeurMiPs: Neural Mixture of Planar Experts for View Synthesis
Zhi-Hao Lin, Wei-Chiu Ma*, Hao-Yu Hsu*, Yu-Chiang Frank Wang, Shenlong Wang
CVPR, 2022
paper / project page / code / video

Use a novel 3D planar representation to model the geometry and appearance of a scene for view synthesis.

Other Publications

Interpreting Latent Representation In Neural Radiance Fields for Manipulating Object Semantics
Yu-Shan Huang, Sheng-Yu Huang, Hao-Yu Hsu, Yu-Chiang Frank Wang
ICIP, 2023
paper

A method for semantic-aware manipulation on generative NeRF by controlling latent representation.

Education

University of Illinois at Urbana-Champaign
M.S. in Computer Science, 2023 - present
Awarded Siebel Scholar, Class of 2025 [news link]

National Tsing Hua University
B.S. in Electrical Engineering, 2017 - 2021
Graduated with the highest honor, Rank: 1/102, GPA: 4.23/4.3

Experience

Shenlong's Lab, UIUC CS
Graduate Student, Aug. 2023 - present
Advisor: Prof. Shenlong Wang

Robot Learning Lab, National Taiwan University
Research Assistant, Jun. 2022 - Feb. 2023
Advisor: Prof. Shao-Hua Sun

Vision & Learning Lab, National Taiwan University
Research Assistant, Sep. 2021 - Feb. 2023
Advisor: Prof. Yu-Chiang Frank Wang

Teaching Experience

UIUC CS (CS 233: Computer Architecture, Spring 2024 | CS543: Computer Vision, Fall 2024)

NTHU EE (EE 2405: Embedded System Laboratory, Spring 2019)


Credits to Jon Barron for this awesome website template.