We formulate face localization as a Maximum A Posteriori Probability(MAP) problem of finding the best estimation of human face configuration in a given image. The a prior distribution for intrinsic face configuration is defined by Active Shape Model(ASM). The likelihood model for local facial features is parameterized as Mixture of Gaussians in feature space. A hierarchical CONDENSATION framework is then proposed to estimate the face configuration parameter. In order to improve the discriminative power of likelihood distribution in feature space, a new feature subspace, Fisher Boosting feature space, is proposed and compared against PCA subspace and biased PCA subspace. Experiments show that, Fisher Boosting algorithm can generate strong classifier with less number of weaker classifiers comparing to conventional Adaboosting algorithm as illustrated in a toy problem, that the face localization with Fisher Boosting feature subspace outperforms that with PCA feature subspaces in localization accuracy and convergence rate, and that the design of hierarchical CONDENSATION framework alleviates the local minima problem which is frequently encountered by previous ASM optimization algorithms.