Search Engine Implementation Using Evolutionary Technique

Abstract

In this project, I presented a prototype of a search engine which makes heavy use of the structure present in hypertext. It is designed to crawl and index the given documents efficiently and produce satisfying search results. To engineer a search engine is a challenging task. Search engines index tens to hundreds of millions of web pages involving a comparable number of distinct terms. They answer tens to millions of queries every day. Despite the importance of largescale search engines on the web, very little academics research has been done on them. Furthermore, due to rapid advance in technology and web proliferation, creating a web search engine today is very different from four years ago. This report provides an in-depth description of our web search engine. Apart from the problems of scaling traditional search techniques to data of this magnitude, there are new unique technical challenges involved with using the additional information present in hypertext to produce better search results. This report provides you with the details of how to build a practical system which can exploit the additional information present in hypertext.