Information Retrieval System

ISBN-13: 9783639377798 / Angielski / Miękka / 2011 / 92 str.

Nidhi Tyagi

Opis

The World Wide Web is an interlinked collection of billions of documents formatted using HTML. Due to the growing and dynamic nature of the web, it has become a challenge to traverse all URLs in the web documents and handle these URLs, so it has become imperative to parallelize a crawling process. The crawler process is further being parallelized in the form ecology of crawler workers that parallely download information from the web. This paper proposes a novel architecture of parallel crawler, which is based on domain specific crawling, makes crawling task more effective, scalable and load-sharing among the different crawlers which parallel download web pages related to different domains specific URLs.

O autorze

Er. Nidhi Tyagi received her bachelor's degree (BE) in Computer Science & Engineering from Pune University. The author holds masters of Computer Engineering degree from Shobhit University, Meerut. She has more ten years of teaching experience and her areas of interest are Information Retrieval Systems, Data Mining and Database Management Systems.