We propose a novel and robust color object detection and localization algorithm. Without a priori information about the number of objects, our method can detect all the objects with similar color feature in template. An improved histogram backprojection algorithm is used to find the object candidate regions. The weighted histogram intersection is used to verify the presence of objects. With the color feature in template, our method can detect and locate the objects accurately, get the number of objects, estimate their scales and orientations. Our experimental results on outdoor images obtained under different environments verify the effectiveness of our algorithm.