Web Text Retrieval with a P2P Query-Driven Index (CROSBI ID 531961)
Prilog sa skupa u zborniku | izvorni znanstveni rad | međunarodna recenzija
Podaci o odgovornosti
Skobeltsyn, Gleb ; Luu, Toan ; Podnar Žarko, Ivana ; Rajman, Martin ; Aberer, Karl
engleski
Web Text Retrieval with a P2P Query-Driven Index
In this paper, we present a query-driven indexing/retrieval strategy for efficient full text retrieval from large document collections distributed within a structured P2P network. Our indexing strategy is based on two important properties: (1) the generated distributed index stores posting lists for carefully chosen indexing term combinations, and (2) the posting lists containing too many document references are truncated to a bounded number of their top-ranked elements. These two properties guarantee acceptable storage and bandwidth requirements, essentially because the number of indexing term combinations remains scalable and the transmitted posting lists never exceed a constant size. However, as the number of generated term combinations can still become quite large, we also use term statistics extracted from available query logs to index only such combinations that are frequently present in user queries. Thus, by avoiding the generation of superfluous indexing term combinations, we achieve an additional substantial reduction in bandwidth and storage consumption. As a result, the generated distributed index corresponds to a constantly evolving query-driven indexing structure that efficiently follows current information needs of the users. More precisely, our theoretical analysis and experimental results indicate that, at the price of a marginal loss in retrieval quality for rare queries, the generated index size and network tra± c remain manageable even for web-size document collections. Furthermore, our experiments show that at the same time the achieved retrieval quality is fully comparable to the one obtained with a state-of-the-art centralized query engine.
P2P; DHT; Text Retrieval; Query-Driven Indexing; TREC
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
Podaci o prilogu
679 - 686-x.
2007.
objavljeno
Podaci o matičnoj publikaciji
Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Clarke, Charles L. A. ; Fuhr, Norbert ; Kando, Noriko
New York (NY): The Association for Computing Machinery (ACM)
978-1-59593-597-7
Podaci o skupu
SIGIR '07: 30th annual international ACM SIGIR conference on Research and development in information retrieval
predavanje
23.07.2007-27.07.2007
Amsterdam, Nizozemska