Study of Web Page Change Detection to Reduce Network Load

Abstract: With continuously growing of the Web size, it is becoming extremely difficult to search it for relevant information. Larger part of the bandwidth and internet traffic is consumed by the Web crawlers that collect pages for indexing by different search engines. Web page change detection refers to the process of monitoring a website or web page for any modifications, updates, or new content. The load on the remote server is also caused by crawlers by using its CPU cycles and memory.