Large volumes of short reads of genomic data are generated by high-throughput sequencing instruments. The FASTQ format is widely accepted as the input format of genomic reads and has presented challenges in data storage, management, and transfer. The performance of this type of serial algorithms such as G-SQZ and DSRC is limited by the single processor and the memory in a single computer. Utilizing data parallelism, the circular dual queues of buffers, memory mapping integrated with superblocks, pipeline parallelism with multi threads, and so on, we present the parallel compression and decompression methods for DNA sequence reads in FASTQ format based on the parallel computer architectures of the cluster and the SMP. Experimental results for the parallel DSRC algorithm clearly show the efficiency of using the powerful computing resources from multi computing nodes and multi cores of each node. The speedups vary from 46 to 62 for parallel compression and vary from 40 to 58 for parallel decompression by using 10 nodes of the cluster in Tianhe-1A super computer. Test results on the SMP machine are also pleasant. The methods could be applied to any serial compressing algorithms of DNA sequence reads in FASTQ format only if they have the traits of index and superblocks.
목차
Abstract 1. Introduction 2. Methods 2.1. Data Parallelism 2.2. Circular Dual Queues of Buffers 2.3. Pipeline Parallelism with Multi Threads 2.4. Memory Mapping Integrated with Superblocks 3. Implementation and Results 3.1. Experimental Results on Cluster of Tianhe-1A 3.2. Experimental Results on SMP Machine 4. Discussion 5. Conclusion Acknowledgements References
Jingjing Zheng [ Parallel Software and Computational Science Lab, Institute of Software, Chinese Academy of Sciences, Beijing 100190, China ]
Ting Wang [ Parallel Software and Computational Science Lab, Institute of Software, Chinese Academy of Sciences, Beijing 100190, China, Research Center of Parallel Software Cloud Application, Institute of Software Application Technology, Guangzhou & Chinese Academy of Sciences, Guangzhou 511458, China ]
보안공학연구지원센터(IJHIT) [Science & Engineering Research Support Center, Republic of Korea(IJHIT)]
설립연도
2006
분야
공학>컴퓨터학
소개
1. 보안공학에 대한 각종 조사 및 연구
2. 보안공학에 대한 응용기술 연구 및 발표
3. 보안공학에 관한 각종 학술 발표회 및 전시회 개최
4. 보안공학 기술의 상호 협조 및 정보교환
5. 보안공학에 관한 표준화 사업 및 규격의 제정
6. 보안공학에 관한 산학연 협동의 증진
7. 국제적 학술 교류 및 기술 협력
8. 보안공학에 관한 논문지 발간
9. 기타 본 회 목적 달성에 필요한 사업
간행물
간행물명
International Journal of Hybrid Information Technology
간기
격월간
pISSN
1738-9968
수록기간
2008~2016
십진분류
KDC 505DDC 605
이 권호 내 다른 논문 / International Journal of Hybrid Information Technology Vol.7 No.4