L2COcc: Lightweight Camera-Centric Semantic Scene Completion via Distillation of LiDAR Model

Ruoyu Wang*, Yukai Ma*, Yi Yao, Sheng Tao, Zongzhi Zhu, Haoang Li, Yong Liu, Xingxing Zuo,
Zhejiang University, Technical University of Munich
IROS 2025 (being submitted)

*Indicates Equal Contribution

Abstract

Semantic Scene Completion (SSC) constitutes a pivotal element in autonomous driving perception systems, tasked with inferring the 3D semantic occupancy of a scene from sensory data.To improve accuracy, prior research has implemented various computationally demanding and memory-intensive 3D operations, imposing significant computational requirements on the platform during training and testing.This paper proposes L2COcc, a lightweight camera-centric SSC framework that also accommodates LiDAR inputs.With our proposed efficient voxel transformer (EVT) and three types of cross-modal knowledge modules (FSD, TPVD, PAD), our method substantially reduce computational burden while maintaining high accuracy. The experimental evaluations demonstrate that our proposed method surpasses the current state-of-the-art vision-based SSC methods regarding accuracy on both the SemanticKITTI and SSCBench-KITTI-360 benchmarks, respectively. Additionally, our method is more lightweight, exhibiting a reduction in both memory consumption and inference time by over 23%.

Introduction Video

Method

Experience

-->

Visualizations

BibTeX

@misc{wang2025l2cocclightweightcameracentricsemantic,
      title={L2COcc: Lightweight Camera-Centric Semantic Scene Completion via Distillation of LiDAR Model}, 
      author={Ruoyu Wang and Yukai Ma and Yi Yao and Sheng Tao and Haoang Li and Zongzhi Zhu and Yong Liu and Xingxing Zuo},
      year={2025},
      eprint={2503.12369},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2503.12369}, 
}