File Download
There are no files associated with this item.
Links for fulltext
(May Require Subscription)
- Publisher Website: 10.1145/346152.346320
- Scopus: eid_2-s2.0-0039929595
- Find via
Supplementary
-
Citations:
- Scopus: 0
- Appears in Collections:
Article: Analysis of Optimal Thread Pool Size
Title | Analysis of Optimal Thread Pool Size |
---|---|
Authors | |
Issue Date | 2000 |
Publisher | Association for Computing Machinery, Inc. |
Citation | Operating Systems Review, 2000, v. 34 n. 2, p. 42-55 How to Cite? |
Abstract | The success of e-commerce, messaging middleware, and other Internet-based applications depends in part on the ability of network servers to respond in a timely and reliable manner to simultaneous service requests. Multithreaded systems, due to their efficient use of system resources and the popularity of shared-memory multi-processor architectures, have become the server implementation of choice. However, creating and destroying a thread is far from free, requiring run-time memory allocation and deallocation. These overheads become especially onerous during periods of high load and can be a major factor behind system slowdowns. A thread-pool architecture addresses this problem by prespawning and then managing a pool of threads. Threads in the pool are reused, so that thread creation and destruction overheads are incurred only once per thread, and not once per request. However, efficient thread management for a given system load highly depends on the thread pool size, which is currently determined heuristically. In this paper, we characterize several system resource costs associated with thread pool size. If the thread pool is too large, and threads go unused, then processing and memory resources are wasted maintaining the thread pool. If the thread pool is too small, then additional threads must be created and destroyed on the fly to handle new requests. We analytically determine the optimal thread pool size to maximize the expected gain of using a thread. |
Persistent Identifier | http://hdl.handle.net/10722/224291 |
ISSN | 2023 SCImago Journal Rankings: 0.527 |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Ling, Y | - |
dc.contributor.author | Mullen, T | - |
dc.contributor.author | Lin, X | - |
dc.date.accessioned | 2016-03-31T07:08:58Z | - |
dc.date.available | 2016-03-31T07:08:58Z | - |
dc.date.issued | 2000 | - |
dc.identifier.citation | Operating Systems Review, 2000, v. 34 n. 2, p. 42-55 | - |
dc.identifier.issn | 0163-5980 | - |
dc.identifier.uri | http://hdl.handle.net/10722/224291 | - |
dc.description.abstract | The success of e-commerce, messaging middleware, and other Internet-based applications depends in part on the ability of network servers to respond in a timely and reliable manner to simultaneous service requests. Multithreaded systems, due to their efficient use of system resources and the popularity of shared-memory multi-processor architectures, have become the server implementation of choice. However, creating and destroying a thread is far from free, requiring run-time memory allocation and deallocation. These overheads become especially onerous during periods of high load and can be a major factor behind system slowdowns. A thread-pool architecture addresses this problem by prespawning and then managing a pool of threads. Threads in the pool are reused, so that thread creation and destruction overheads are incurred only once per thread, and not once per request. However, efficient thread management for a given system load highly depends on the thread pool size, which is currently determined heuristically. In this paper, we characterize several system resource costs associated with thread pool size. If the thread pool is too large, and threads go unused, then processing and memory resources are wasted maintaining the thread pool. If the thread pool is too small, then additional threads must be created and destroyed on the fly to handle new requests. We analytically determine the optimal thread pool size to maximize the expected gain of using a thread. | - |
dc.language | eng | - |
dc.publisher | Association for Computing Machinery, Inc. | - |
dc.relation.ispartof | Operating Systems Review | - |
dc.rights | Operating Systems Review. Copyright © Association for Computing Machinery, Inc. | - |
dc.rights | ©ACM, YYYY. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in PUBLICATION, {VOL#, ISS#, (DATE)} http://doi.acm.org/10.1145/nnnnnn.nnnnnn | - |
dc.title | Analysis of Optimal Thread Pool Size | - |
dc.type | Article | - |
dc.identifier.email | Lin, X: xlin@hkueee.hku.hk | - |
dc.identifier.doi | 10.1145/346152.346320 | - |
dc.identifier.scopus | eid_2-s2.0-0039929595 | - |
dc.identifier.hkuros | 54441 | - |
dc.identifier.volume | 34 | - |
dc.identifier.issue | 2 | - |
dc.identifier.spage | 42 | - |
dc.identifier.epage | 55 | - |
dc.publisher.place | United States | - |
dc.identifier.issnl | 0163-5980 | - |