This document presents a search-based face annotation framework that uses an unsupervised label refinement (ULR) approach to improve the quality of labels for weakly labeled facial images found online. It addresses challenges associated with existing image recognition methods, proposing a novel algorithm that enhances label quality and improves scalability through clustering-based approximations. Experimental results demonstrate the effectiveness of the proposed technique, with plans for future work to tackle issues like duplicate names and explore advanced learning techniques.