File Download
There are no files associated with this item.
Links for fulltext
(May Require Subscription)
- Publisher Website: 10.1109/GLOCOM.2017.8254038
- Scopus: eid_2-s2.0-85046400226
- Find via
Supplementary
-
Citations:
- Scopus: 0
- Appears in Collections:
Conference Paper: Latency Analysis of Flexible Redundant Scheme in MDS-Coded Distributed Storage Systems
Title | Latency Analysis of Flexible Redundant Scheme in MDS-Coded Distributed Storage Systems |
---|---|
Authors | |
Keywords | access latency distributed storage system MDS codes redundant scheme |
Issue Date | 2017 |
Publisher | Institute of Electrical and Electronics Engineers. The Journal's web site is located at http://ieeexplore.ieee.org/xpl/conhome.jsp?punumber=1000308 |
Citation | Proceedings of 2017 IEEE Global Communications Conference (GLOBECOM 2017), Singapore, 4-8 December 2017 How to Cite? |
Abstract | Access latency is the bottle-neck of various web services, and can greatly impact user experience, especially for the data retrieval applications, such as Google search. Many large-scale distributed storage systems are moving to the use of erasure codes to provide low storage overhead and high failure tolerance. Most previous work about coding latency focuses on the case when users desire all the data in a codeword. However, we find that in practical MDS- coded storage systems, the size of a codeword is usually so big that users only desire part of the files in a codeword. Hence, it is significant to analyze the latency in coding systems when users only desire part of a codeword. In this paper, we propose Flexible Redundant Scheme (FRedS) that can deal with the general case in which users only require part of the files from a codeword. In the case of no queueing delay, we give a general and closed-form expression of the coding latency with FRedS. Considering queueing delay, we extend the popular latency bound to analyze the latency performance of FRedS under the general service time distribution. Through extensive simulations using real service time traces from Amazon S3, we validate our latency analysis, demonstrate the tightness of the bounds derived in this work and show the latency comparison of FRedS and the direct read scheme. |
Persistent Identifier | http://hdl.handle.net/10722/262428 |
ISSN |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Shuai, Q | - |
dc.contributor.author | Li, VOK | - |
dc.date.accessioned | 2018-09-28T04:59:10Z | - |
dc.date.available | 2018-09-28T04:59:10Z | - |
dc.date.issued | 2017 | - |
dc.identifier.citation | Proceedings of 2017 IEEE Global Communications Conference (GLOBECOM 2017), Singapore, 4-8 December 2017 | - |
dc.identifier.issn | 2334-0983 | - |
dc.identifier.uri | http://hdl.handle.net/10722/262428 | - |
dc.description.abstract | Access latency is the bottle-neck of various web services, and can greatly impact user experience, especially for the data retrieval applications, such as Google search. Many large-scale distributed storage systems are moving to the use of erasure codes to provide low storage overhead and high failure tolerance. Most previous work about coding latency focuses on the case when users desire all the data in a codeword. However, we find that in practical MDS- coded storage systems, the size of a codeword is usually so big that users only desire part of the files in a codeword. Hence, it is significant to analyze the latency in coding systems when users only desire part of a codeword. In this paper, we propose Flexible Redundant Scheme (FRedS) that can deal with the general case in which users only require part of the files from a codeword. In the case of no queueing delay, we give a general and closed-form expression of the coding latency with FRedS. Considering queueing delay, we extend the popular latency bound to analyze the latency performance of FRedS under the general service time distribution. Through extensive simulations using real service time traces from Amazon S3, we validate our latency analysis, demonstrate the tightness of the bounds derived in this work and show the latency comparison of FRedS and the direct read scheme. | - |
dc.language | eng | - |
dc.publisher | Institute of Electrical and Electronics Engineers. The Journal's web site is located at http://ieeexplore.ieee.org/xpl/conhome.jsp?punumber=1000308 | - |
dc.relation.ispartof | IEEE Global Communications Conference (GLOBECOM) | - |
dc.rights | IEEE Global Communications Conference (GLOBECOM). Copyright © Institute of Electrical and Electronics Engineers. | - |
dc.subject | access latency | - |
dc.subject | distributed storage system | - |
dc.subject | MDS codes | - |
dc.subject | redundant scheme | - |
dc.title | Latency Analysis of Flexible Redundant Scheme in MDS-Coded Distributed Storage Systems | - |
dc.type | Conference_Paper | - |
dc.identifier.email | Li, VOK: vli@eee.hku.hk | - |
dc.identifier.authority | Li, VOK=rp00150 | - |
dc.description.nature | link_to_subscribed_fulltext | - |
dc.identifier.doi | 10.1109/GLOCOM.2017.8254038 | - |
dc.identifier.scopus | eid_2-s2.0-85046400226 | - |
dc.identifier.hkuros | 292187 | - |
dc.publisher.place | United States | - |
dc.identifier.issnl | 2334-0983 | - |