Even if you lead a very busy life, carving out some time for exercise can help you decrease the growth of facial hair. Being overweight ups your chances of getting unwanted hair on your chin or upper lip, and starting slowly with moderate or low-impact exercises, such as swimming or walking, can help you keep unwanted hair at bay.