From explained variance of correlated components to PCA without orthogonality constraints
| hal.structure.identifier | Institut de Mathématiques de Bordeaux [IMB] | |
| hal.structure.identifier | Méthodes avancées d’apprentissage statistique et de contrôle [ASTRAL] | |
| dc.contributor.author | CHAVENT, Marie | |
| hal.structure.identifier | Simulation for the Environment: Reliable and Efficient Numerical Algorithms [SERENA] | |
| dc.contributor.author | CHAVENT, Guy | |
| dc.date.accessioned | 2024-04-04T02:30:08Z | |
| dc.date.available | 2024-04-04T02:30:08Z | |
| dc.identifier.uri | https://oskar-bordeaux.fr/handle/20.500.12278/190240 | |
| dc.description.abstractEn | Block Principal Component Analysis (Block PCA) of a data matrix A, where loadings Z are determined by maximization of the froebonius norm of AZ over unit norm orthogonal loadings, is difficult to use for the design of sparse PCA by l1 regularization, due to the difficulty of taking care of both the orthogonality constraint on loadings and the non differentiable l1 penalty. Our objective in this paper is to relax the orthogonality constraint on loadings by introducing new objective functions expvar(Y) which measure the part of the variance of the data matrix A explained by correlated components Y = AZ. So we propose first a comprehensive study of mathematical and numerical properties of expvar(Y) for two existing definitions Zou et al. [2006], Shen and Huang [2008] and four new definitions. Then we show that only two of these explained variance are fit to use as objective function in block PCA formulations rid of orthogonality constraints. | |
| dc.language.iso | en | |
| dc.rights.uri | http://creativecommons.org/licenses/by/ | |
| dc.subject.en | PCA | |
| dc.subject.en | Sparsity | |
| dc.subject.en | Dimension reduction | |
| dc.subject.en | Explained variance | |
| dc.subject.en | Orthogonality constraints | |
| dc.subject.en | Block optimization | |
| dc.title.en | From explained variance of correlated components to PCA without orthogonality constraints | |
| dc.type | Document de travail - Pré-publication | |
| dc.subject.hal | Statistiques [stat]/Autres [stat.ML] | |
| bordeaux.hal.laboratories | Institut de Mathématiques de Bordeaux (IMB) - UMR 5251 | * |
| bordeaux.institution | Université de Bordeaux | |
| bordeaux.institution | Bordeaux INP | |
| bordeaux.institution | CNRS | |
| hal.identifier | hal-04442489 | |
| hal.version | 1 | |
| hal.origin.link | https://hal.archives-ouvertes.fr//hal-04442489v1 | |
| bordeaux.COinS | ctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.au=CHAVENT,%20Marie&CHAVENT,%20Guy&rft.genre=preprint |
Fichier(s) constituant ce document
| Fichiers | Taille | Format | Vue |
|---|---|---|---|
|
Il n'y a pas de fichiers associés à ce document. |
|||