Dimensionality Reduction
Paper
Principal Component Analysis
Theory
Lindsay I. Smith (2002). A Tutorial on Principal Components Analysis.
Hui Zou, Trevor Hastie and Robert Tibshirani (2006). Sparse Principal Component Analysis. Journal of Computational and Graphical Statistics, 15(2), 262-286.
Application
Matthew A. Turk and Alex P. Pentland (1991). Face Recognition using Eigenfaces. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 586--591, Maui, Hawaii, USA.
Matthew A. Turk and Alex P. Pentland (1991). Eigenfaces for Recognition, Journal of Cognitive Neuroscience, Vol. 3, 71-86.
Linear Discriminant Analysis
Max Welling (note). Fisher Linear Discriminant Analysis. Department of Computer Science, University of Toronto.
Latent Semantic Analysis
Scott Deerwester, Susan T. Dumais, George W. Furnas, Thomas K. Landauer and Richard Harshman (1990). Indexing by Latent Semantic Analysis. Journal of the American Society of Information Science, Vol. 41, 391-407.
Christos H. Papadimitriou, Prabhakar Raghavan, Hisao Tamaki and Santosh Vempala (1998). Latent Semantic Indexing: A Probabilistic Analysis. In Proceedings of the Seventeenth ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, 159-168, Seattle, WA, USA.
Thomas K. Landauer, Peter W. Foltz and Darrell Laham (1998). Introduction to Latent Semantic Analysis. Discourse Processes, 25, 259-284.
Locality Preserving Projections
Xiafei He and Partha Niyogi (2003). Locality Preserving Projections. Advances in Neural Information Processing Systems 16, Vancouver, British Columbia, Canada. (TR version)
Xiaofei He, Deng Cai, Haifeng Liu and Wei-Ying Ma (2004). Locality Preserving Indexing for Document Representation. In Proceedings of the Twenty-seventh Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 96-103, Sheffield, United Kingdom.
Deng Cai and Xiaofei He (2005). Orthogonal Locality Preserving Indexing. In Proceedings of the Twenty-Eighth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 3-10, Salvador, Brazil.
Probabilistic Principal Component Analysis
Michael E. Tipping and Christopher M. Bishop (1999). Probabilistic Principal Component Analysis. Journal of the Royal Statistical Society, Serie B, Vol. 61, 611-622.
Shipeng Yu, Kai Yu, Volker Tresp, Hans-Peter Kriegel and Mingrui Wu (2006). Supervised Probabilistic Principal Component Analysis. Proceedings of the Twelveth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 464-473, Philadelphia, PA, USA.
Probabilistic Latent Semantic Analysis
Thomas Hofmann (1999). Probabilistic Latent Semantic Analysis. In Proceedings of the Fifteenth Annual Conference on Uncertainty in Artificial Intelligence, 289-296, San Francisco, CA, USA.
Thomas Hofmann (1999). Probabilistic Latent Semantic Indexing. In Proceedings of the Twenty-second ACM SIGIR International Conference on Research and Development in Information Retrieval, 50--57, Berkeley, California, USA.
Slide
Berlin Chen. Discriminative Feature Extraction and Dimension Reduction - PCA, LDA and LSA. Graduate Institute of Computer Science & Information Engineering, National Taiwan Normal University.