Do the sex chromosomes ( X and Y )have effects on face and skin color?

No only your sex (gender). Your face and skin color are determined by alleles and the dominant allele is expressed. There is a recessive allele which is not expressed. The recessive allele is carried but the shown allele is carried in your phenotype and thats what you look like.