A novel approach to data deduplication over the engineering-oriented cloud systems
Article
| Article Title | A novel approach to data deduplication over the engineering-oriented cloud systems |
|---|---|
| ERA Journal ID | 41720 |
| Article Category | Article |
| Authors | Sun, Zhe (Author), Shen, Jun (Author) and Yong, Jianming (Author) |
| Journal Title | Integrated Computer Aided Engineering |
| Journal Citation | 20 (1), pp. 45-57 |
| Number of Pages | 13 |
| Year | 2013 |
| Place of Publication | Amsterdam, Netherlands |
| ISSN | 1069-2509 |
| 1875-8835 | |
| Digital Object Identifier (DOI) | https://doi.org/10.3233/ICA-120418 |
| Web Address (URL) | http://ro.uow.edu.au/infopapers/2543 |
| Abstract | This paper presents a duplication-less storage system over the engineering-oriented cloud computing platforms. Our deduplication storage system, which manages data and duplication over the cloud system, consists of two major components, a front-end deduplication application and a mass storage system as back-end. Hadoop distributed file system (HDFS) is a common distribution file system on the cloud, which is used with Hadoop database (HBase). We use HDFS to build up a mass storage system and employ HBase to build up a fast indexing system. With a deduplication application, a scalable and parallel deduplicated cloud storage system can be effectively built up. We further use VMware to generate a simulated cloud environment. The simulation results demonstrate that our deduplication storage system is sufficiently accurate and efficient for distributed and cooperative data intensive engineering applications. |
| Keywords | cloud storage; data deduplication; Hadoop database; Hadoop distributed file system |
| ANZSRC Field of Research 2020 | 430201. Archival, repository and related studies |
| 460912. Knowledge and information management | |
| 461299. Software engineering not elsewhere classified | |
| Public Notes | File reproduced in accordance with the copyright policy of the publisher/author. |
| Byline Affiliations | University of Wollongong |
| School of Information Systems | |
| Institution of Origin | University of Southern Queensland |
https://research.usq.edu.au/item/q1z29/a-novel-approach-to-data-deduplication-over-the-engineering-oriented-cloud-systems
Download files
Published Version
| Sun_Shjen_Yong_ICAE_v20n1_PV.pdf | ||
| File access level: Anyone | ||
Other Documentation
| DeduplicationForICAE(revised)V4[1].doc | ||
| File access level: Anyone | ||
1815
total views903
total downloads1
views this month0
downloads this month