Eigen faces

I am working on face detection and recognition. My face detection algo using viola-jones is working perfectly. However face recognition using eigen vectors is not working properly. It is not able to recognize faces accurately. If i decrease the threshold then it is not recognizing the face and if i increase then is recognizing it improperly. What improvement should i do in eigen faces?? please help?