Abstract
This paper describes an automatic detecting and recognizing road sign system based on color images. The system consists of two phases. In the detection phase, we find the relative position of road sign in the original distant image by using a priori knowledge, shape and color information, to capture the closer view image. Then we extract the internal content of road sign from a closer view image by using conventional template-matching. In the recognition phase, there are two stages: training and testing. In the training stage, the system finds a set of best matching pursuit filter bases for each road sign. In the testing stage, the system projects the input unknown road sign to different set of the matching pursuit filter bases (corresponding to different road signs) to find the best match.