Earticle

초록

영어

Distributed computing systems have evolved over decades to support various types of scientific applications and overall computing paradigms have been categorized into HTC (High-Throughput Computing) to support bags of tasks which are usually long running, HPC (High-Performance Computing) for processing tightly-coupled communication-intensive tasks on top of dedicated clusters of workstations or Supercomputers, and Data-intensive Computing leveraging distributed storage systems and parallel processing frameworks. Many-Task Computing (MTC) aims to bridge the gap between traditional HTC and HPC by building efficient middleware systems throughout employing lightweight task dispatching mechanisms, minimizing data movements, leveraging data-aware scheduling, and proposing of next generation Exascale storage systems. Recent emerging applications requiring millions or even billions of tasks to be processed with relatively short per task execution times have driven this new computing paradigm. In this paper, we investigate concepts and technologies of MTC and propose guidelines for building an efficient and effective middleware system to fully support MTC applications. Throughout our short survey about challenges, systems and applications of MTC, we argue that a next generation distributed middleware system must effectively leverage distributed file systems, parallel processing frameworks, decentralized data/compute management systems, and dynamic load balancing techniques to solve the most challenging and complex scientific problems.

목차

Abstract
 1. Introduction
 2. MTC: Challenges, Systems and Applications
 3. Conclusion
 References

키워드

저자

• Jik-Soo Kim [ National Institute of Supercomputing and Networking, Korea Institute of Science and Technology Information (KISTI) ]
• Sangwan Kim [ National Institute of Supercomputing and Networking, Korea Institute of Science and Technology Information (KISTI) ]
• Seokkyoo Kim [ National Institute of Supercomputing and Networking, Korea Institute of Science and Technology Information (KISTI) ]
• Seoyoung Kim [ National Institute of Supercomputing and Networking, Korea Institute of Science and Technology Information (KISTI) ]
• Seungwoo Rho [ National Institute of Supercomputing and Networking, Korea Institute of Science and Technology Information (KISTI) ]
• Ok-Hwan Byeon [ National Institute of Supercomputing and Networking, Korea Institute of Science and Technology Information (KISTI) ]
• Soonwook Hwang [ National Institute of Supercomputing and Networking, Korea Institute of Science and Technology Information (KISTI) ]

참고문헌

발행기관

간행물

표지보기 관심저널 등록

• 간행물명

  International Journal of Software Engineering and Its Applications

• 간기

  월간

• pISSN

  1738-9984

• 수록기간

  2008~2016

• 등재여부

  SCOPUS

• 십진분류

  KDC 505 DDC 605