Neural Lighting Simulation for Urban Scenes
Neural Information Processing Systems (NeurIPS) 2023
Ava Pun*, Gary Sun*, Jingkang Wang*, Yun Chen, Ze Yang, Sivabalan Manivasagam, Wei-Chiu Ma, Raquel Urtasun
Different outdoor illumination conditions drastically alter the appearance of urban scenes, and can harm the performance of image-based robot perception systems if they have not been seen during training. Towards this goal, we propose LightSim, a neural lighting camera simulation system that enables diverse, realistic, and controllable data generation. LightSim automatically builds relightable digital twins at scale from collected raw sensor data…