Earticle

초록

영어

Although in past few decades, lots of research has been done on searching documents in textual data and there have been many commercial systems for retrieving data on the Web. Fast retrieving desired documents from massive textual corpora is still challenging. Indexing is the most commonly used way to improve the performance of retrieving; particularly an effective index structure can help retrieving data more quickly and effectively. This work proposes a novel index structure, named as L−INDEX, to conceptually index massive set of textual data. L-INDEX employs Form Concept Analysis to discover the relationships between documents and expresses the discovered relationships with lattice. To make our approach more applicable to process massive set of data, the structure is implemented in MapReduce environment which can fulfill computing tasks in an efficient distributed way. A set of algorithms is developed for creating, maintaining, storing L-INDEX and searching documents through it as well. A serial of experiments is conducted to verify the performance of our approach by comparing it with some other popular existing indexing structures. The experimental results demonstrate that the proposed approach can index massive set of textual data with an effective structure which supports querying tasks in an efficient way.

목차

Abstract
 1. Introduction
 2. Related Work
  2.1. Traditional Index Structures
  2.2. General Distributed Index Structures
  2.3. Indexing in MapReduce
 3. FCA and Problem Description
  3.1. Introducing FCA
  3.2. Basic Theory
  3.3. Problem Description
 4. Generating Formal Concepts in MapReduce
  4.1. Storage of Document Context
  4.2. Map Function: LMap
  4.3. Reduce Function: LReduce
 5. Establishing, Maintaining and Searching on L-INDEX
  5.1. Establishment of L-INDEX
  5.2. Maintenance of L-INDEX
  5.3. Searching on L-INDEX
 6. Experimental Evalua
  6.1. Experimental Settings
  6.2. Factors Affect the Performance of Establishing L-INDEX
  6.3. Performance of Maintaining L-INDEX
  6.4. Retrieving on L-INDEX
 7. Conclusion
 Acknowledgements
 References

키워드

저자

• Dunlu Peng [ School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China ]
• Kai Duan [ School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China, The First Research Institute of Telecommunications Technology, Shanghai, 200000, China ]
• Lei Xie [ School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China ]

참고문헌

발행기관

간행물

표지보기 관심저널 등록

• 간행물명

  International Journal of Grid and Distributed Computing

• 간기

  격월간

• pISSN

  2005-4262

• 수록기간

  2008~2016

• 십진분류

  KDC 505 DDC 605