Design of a Hidden WEB Crawler Based Search Engine

The World Wide Web is a global information medium of interlinked hypertext documents accessed via computers connected to the internet. Most of the users rely on traditional search engines to search the information on the web. These search engines deal with the Surface Web which is a set of Web pages directly accessible through hyperlinks and ignores a large part of the Web called Hidden Web which is hidden to present-day search engines. It lies behind search forms and this part of the web containing an almost endless amount of sources providing high quality information stored in specialized databases, can be found in the depths of the WWW. In this book, design and implementation of ¿Hidden Web Crawler Based Search Engine (HWCBSE)¿ has been reported. This prototype is capable of extracting, collecting and integrating the result records of various Hidden web databases efficiently and accurately.