Logo image
Maximize cloud storage data transfer throughput through data partition, compression, re-transmission, parallelism and adaptation
Thesis

Maximize cloud storage data transfer throughput through data partition, compression, re-transmission, parallelism and adaptation

Lin, Yu Tsuen
Masters, 國立清華大學, 資訊系統與應用研究所
2015

Abstract

自動調校 吞吐量 壓縮 雲端儲存器 裝箱問題 Auto-tuning throughput compression cloud storage AWS bin-packing
Nowadays the number of enterprises and users stored their data in cloud storage in- creased dramatically. How to speed up uploading is an important issue. Uploading speed will be variant with different machine specification,network bandwidth, data type, etc. In this thesis, we will address the lower uploading throughput problems by experiments . According to these problems,we make policies to solve correspond- ing problems and implement the tool named Fast Cloud Transfer Tool. Our tool can automatically reconfigure the upload setting during the uploading procedure to achieve expected throughput. We also discuss how the failure will impact on uploading throughput and find optimal part size. Our evaluations on different data type can achieve x3 to x85 speedup, on different latency destination can achieve x15 to x717 speedup compared to other existing tool.

Metrics

1 Record Views

Details

Logo image