File Download

There are no files associated with this item.

  Links for fulltext
     (May Require Subscription)
Supplementary

Article: Stochastically constrained best arm identification with Thompson sampling

TitleStochastically constrained best arm identification with Thompson sampling
Authors
KeywordsBest feasible arm identification
Rate of posterior convergence
Thompson sampling
Top-two algorithm
Issue Date1-Jun-2025
PublisherElsevier
Citation
Automatica, 2025, v. 176 How to Cite?
Abstract

We consider the problem of the best arm identification in the presence of stochastic constraints, where there is a finite number of arms associated with multiple performance measures. The goal is to identify the arm that optimizes the objective measure subject to constraints on the remaining measures. We will explore the popular idea of Thompson sampling (TS) as a means to solve it. To the best of our knowledge, it is the first attempt to extend TS to this problem. We will design a TS-based sampling algorithm, establish its asymptotic optimality in the rate of posterior convergence, and demonstrate its superior performance using numerical examples.


Persistent Identifierhttp://hdl.handle.net/10722/355126
ISSN
2023 Impact Factor: 4.8
2023 SCImago Journal Rankings: 3.502

 

DC FieldValueLanguage
dc.contributor.authorYang, Le-
dc.contributor.authorGao, Siyang-
dc.contributor.authorLi, Cheng-
dc.contributor.authorWang, Yi-
dc.date.accessioned2025-03-27T00:35:36Z-
dc.date.available2025-03-27T00:35:36Z-
dc.date.issued2025-06-01-
dc.identifier.citationAutomatica, 2025, v. 176-
dc.identifier.issn0005-1098-
dc.identifier.urihttp://hdl.handle.net/10722/355126-
dc.description.abstract<p>We consider the problem of the best arm identification in the presence of stochastic constraints, where there is a finite number of arms associated with multiple performance measures. The goal is to identify the arm that optimizes the objective measure subject to constraints on the remaining measures. We will explore the popular idea of Thompson sampling (TS) as a means to solve it. To the best of our knowledge, it is the first attempt to extend TS to this problem. We will design a TS-based sampling algorithm, establish its asymptotic optimality in the rate of posterior convergence, and demonstrate its superior performance using numerical examples.</p>-
dc.languageeng-
dc.publisherElsevier-
dc.relation.ispartofAutomatica-
dc.subjectBest feasible arm identification-
dc.subjectRate of posterior convergence-
dc.subjectThompson sampling-
dc.subjectTop-two algorithm-
dc.titleStochastically constrained best arm identification with Thompson sampling-
dc.typeArticle-
dc.identifier.doi10.1016/j.automatica.2025.112223-
dc.identifier.scopuseid_2-s2.0-85218896760-
dc.identifier.volume176-
dc.identifier.eissn1873-2836-
dc.identifier.issnl0005-1098-

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats