This paper presents a lip and smile detection method basd-on the normalized RGB chromaticity diagram is proposed to extract the lip. The projection technique is empolyed for detecting the smile state. From the experiment results, the proposed method achieves the lip detection rate of 97% and the smile detection rate of 94%.