Skip to main navigation Skip to search Skip to main content

Block placement in distributed file systems based on block access frequency

  • Southwest University
  • Huaihua University

Research output: Contribution to journalArticlepeer-review

11 Citations (Scopus)

Abstract

This paper proposes a new data placement policy to allocate data blocks across storage servers of the distributed/parallel file systems, for yielding even block access workload distribution. To this end, we first analyze the history of block access sequence of a specific application and then introduce a k-partition algorithm to divide data blocks into multiple groups, by referring their access frequency. After that, each group has almost the same access workloads, and we can thus distribute these block groups onto storage servers of the distributed file system, to achieve the goal of uniformly assigning data blocks when running the application. In summary, this newly proposed data placement policy can yield not only an even data distribution but also the block data access balance. The experimental results show that the proposed scheme can greatly reduce I/O time and better improve utilization of storage servers when running the database-relevant applications, compared with the commonly used block data placement strategy, i.e., the round-robin placement policy.

Original languageEnglish
Article number8400509
Pages (from-to)38411-38420
Number of pages10
JournalIEEE Access
Volume6
DOIs
Publication statusPublished - 29 Jun 2018

Keywords

  • Distributed file systems
  • I/O performance
  • block access balance
  • data re-distribution
  • k-partition

Fingerprint

Dive into the research topics of 'Block placement in distributed file systems based on block access frequency'. Together they form a unique fingerprint.

Cite this