in this paper, we propoese an adaptive appearance model for a visual tracking application. in appearance-base visual tracking, we solve the vilter drift prooblem caused by the adaptitaion toward non-targets. simulated annealing method is proposed to give the adaptive propertt in apprerance subspace learning so that the filter drift probem is able to be effectively avoided. experimental results from real-video sequence illustrate the robust performance of the proposed idea.