Optimal Projected Variance Group-Sparse Block PCA
| hal.structure.identifier | Université de Bordeaux [UB] | |
| hal.structure.identifier | Institut de Mathématiques de Bordeaux [IMB] | |
| hal.structure.identifier | Quality control and dynamic reliability [CQFD] | |
| dc.contributor.author | CHAVENT, Marie | |
| hal.structure.identifier | Retraité | |
| dc.contributor.author | CHAVENT, Guy | |
| dc.date.accessioned | 2024-04-04T02:47:31Z | |
| dc.date.available | 2024-04-04T02:47:31Z | |
| dc.identifier.uri | https://oskar-bordeaux.fr/handle/20.500.12278/191651 | |
| dc.description.abstractEn | We address the problem of defining a group sparse formulation for Principal Components Analysis (PCA) - or its equivalent formulations as Low Rank approximation or Dictionary Learning problems - which achieves a compromise between maximizing the variance explained by the components and promoting sparsity of the loadings. So we propose first a new definition of the variance explained by non necessarily orthogonal components, which is optimal in some aspect and compatible with the principal components situation. Then we use a specific regularization of this variance by the group-L1 norm to define a Group Sparse Maximum Variance (GSMV) formulation of PCA. The GSMV formulation achieves our objective by construction, and has the nice property that the inner non smooth optimization problem can be solved analytically, thus reducing GSMV to the maximization of a smooth and convex function under unit norm and orthogonality constraints, which generalizes Journee et al. (2010) to group sparsity. Numerical comparison with deflation on synthetic data shows that GSMV produces steadily slightly better and more robust results for the retrieval of hidden sparse structures, and is about three times faster on these examples. Application to real data shows the interest of group sparsity for variables selection in PCA of mixed data (categorical/numerical) . | |
| dc.language.iso | en | |
| dc.subject.en | PCA | |
| dc.subject.en | Sparsity | |
| dc.subject.en | Dimension reduction | |
| dc.subject.en | Variance | |
| dc.subject.en | Mixed data | |
| dc.subject.en | Orthogonal constraints | |
| dc.subject.en | Block optimization | |
| dc.title.en | Optimal Projected Variance Group-Sparse Block PCA | |
| dc.type | Document de travail - Pré-publication | |
| dc.subject.hal | Statistiques [stat]/Autres [stat.ML] | |
| dc.identifier.arxiv | 1705.00461 | |
| bordeaux.hal.laboratories | Institut de Mathématiques de Bordeaux (IMB) - UMR 5251 | * |
| bordeaux.institution | Université de Bordeaux | |
| bordeaux.institution | Bordeaux INP | |
| bordeaux.institution | CNRS | |
| hal.identifier | hal-03125264 | |
| hal.version | 1 | |
| hal.origin.link | https://hal.archives-ouvertes.fr//hal-03125264v1 | |
| bordeaux.COinS | ctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.au=CHAVENT,%20Marie&CHAVENT,%20Guy&rft.genre=preprint |
Fichier(s) constituant ce document
| Fichiers | Taille | Format | Vue |
|---|---|---|---|
|
Il n'y a pas de fichiers associés à ce document. |
|||