A proposed Web Indexing Model Based on Metadata

The World Wide Web contains large volumes of Web pages that are poorly characterized in terms of both metadata and structure descriptions. Metadata is the data that describe data, for Web pages, it may provide a significant amount of information about the Web without examining its content and serves a variety of purposes. At the other side, the search engine needs to scrape all Web pages of the target Website, when a new Web page is first available, it will typically take several days—for the page to be detected and indexed by the search engine. Until a page has been indexed, the users cannot find information about it on search engine results. This represents a time and resource-consuming operation and heavy network bandwidth consumption involved with the retrieval of the mark-up code of these Web pages which finally affects the users by increasing the time taken for new content or a content modification to be reflected in the search engines results. For instance, Web-related metadata can improve search efficiency and the quality of the search results. This thesis proposes an approach called Multilateral Web Indexing Model (MWIM), which aims to describe a solution to the previous.