File Download
There are no files associated with this item.
Links for fulltext
(May Require Subscription)
- Publisher Website: 10.1016/j.jfranklin.2023.02.011
- Scopus: eid_2-s2.0-85149291628
- WOS: WOS:000956319700001
- Find via
Supplementary
- Citations:
- Appears in Collections:
Article: Pursuit of a discriminative representation for multiple subspaces via sequential games
Title | Pursuit of a discriminative representation for multiple subspaces via sequential games |
---|---|
Authors | |
Issue Date | 2023 |
Citation | Journal of the Franklin Institute, 2023, v. 360, n. 6, p. 4135-4171 How to Cite? |
Abstract | We consider the problem of learning discriminative representations for data in a high-dimensional space with distribution supported on or around multiple low-dimensional linear subspaces. That is, we wish to compute a linear injective map of the data such that the features lie on multiple orthogonal subspaces. Instead of solving this learning problem using multiple instances of principal component analysis (PCA), we cast it as a sequential game using the closed-loop transcription (CTRL) framework recently proposed for learning discriminative and generative representations for general low-dimensional submanifolds. We prove that the equilibrium solutions to the game indeed give the correct representations. Our approach unifies classical methods of learning subspaces with modern machine learning practice, by showing that subspace learning problems may be provably solved using the modern toolkit of representation learning. In addition, our work provides the first theoretical justification for the CTRL framework in the important special case of linear subspaces. We support our theoretical findings with compelling empirical evidence. We also generalize the sequential game formulation to more general representation learning problems. Our code is publicly available on GitHub. |
Persistent Identifier | http://hdl.handle.net/10722/327788 |
ISSN | 2023 Impact Factor: 3.7 2023 SCImago Journal Rankings: 1.191 |
ISI Accession Number ID |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Pai, Druv | - |
dc.contributor.author | Psenka, Michael | - |
dc.contributor.author | Chiu, Chih Yuan | - |
dc.contributor.author | Wu, Manxi | - |
dc.contributor.author | Dobriban, Edgar | - |
dc.contributor.author | Ma, Yi | - |
dc.date.accessioned | 2023-05-08T02:26:48Z | - |
dc.date.available | 2023-05-08T02:26:48Z | - |
dc.date.issued | 2023 | - |
dc.identifier.citation | Journal of the Franklin Institute, 2023, v. 360, n. 6, p. 4135-4171 | - |
dc.identifier.issn | 0016-0032 | - |
dc.identifier.uri | http://hdl.handle.net/10722/327788 | - |
dc.description.abstract | We consider the problem of learning discriminative representations for data in a high-dimensional space with distribution supported on or around multiple low-dimensional linear subspaces. That is, we wish to compute a linear injective map of the data such that the features lie on multiple orthogonal subspaces. Instead of solving this learning problem using multiple instances of principal component analysis (PCA), we cast it as a sequential game using the closed-loop transcription (CTRL) framework recently proposed for learning discriminative and generative representations for general low-dimensional submanifolds. We prove that the equilibrium solutions to the game indeed give the correct representations. Our approach unifies classical methods of learning subspaces with modern machine learning practice, by showing that subspace learning problems may be provably solved using the modern toolkit of representation learning. In addition, our work provides the first theoretical justification for the CTRL framework in the important special case of linear subspaces. We support our theoretical findings with compelling empirical evidence. We also generalize the sequential game formulation to more general representation learning problems. Our code is publicly available on GitHub. | - |
dc.language | eng | - |
dc.relation.ispartof | Journal of the Franklin Institute | - |
dc.title | Pursuit of a discriminative representation for multiple subspaces via sequential games | - |
dc.type | Article | - |
dc.description.nature | link_to_subscribed_fulltext | - |
dc.identifier.doi | 10.1016/j.jfranklin.2023.02.011 | - |
dc.identifier.scopus | eid_2-s2.0-85149291628 | - |
dc.identifier.volume | 360 | - |
dc.identifier.issue | 6 | - |
dc.identifier.spage | 4135 | - |
dc.identifier.epage | 4171 | - |
dc.identifier.isi | WOS:000956319700001 | - |