Abstract
A method for optimizing occlusion used in an augmented reality system comprising a depth camera and a two-dimensional camera comprises the steps of: capturing, by the depth camera, a scene and an object in the scene to obtain initial depth data, and capturing, by the two-dimensional camera, the scene and the object to obtain two-dimensional image data; inpainting the initial depth data to obtain inpainted depth data; performing a depth buffer calculation according to the inpainted depth data and a virtual model to obtain an occlusion relationship between the object and the virtual model, and generating an occluded partial image according to the two-dimensional image data and the virtual model; estimating a partially approximated polygon according to the occluded partial image; and generating an occluded result according to the partially approximated polygon, the two-dimensional image data and the virtual model.