View of a instantaneously captured, “sharp” site. To a site capture would accidentally see, instead of the ideal The expected number of page changes that a time-travel access Blur is a stochastic notion that reflects The quality notions of blur and coherence are formalized in the paper. The site capture(number pages that did not change during theĬapture). The revisiting order aims to maximize the “coherence” of Their initial downloads to check for intermediate changes.
Visit–revisit strategies revisit pages after Single-visit crawls download every page of a siteĮxactly once in an order that aims to minimize the “blur” inĬapturing the site. Our framework includes single-visit and visit–revisitĬrawls.
PI SITECAPTURE ARCHIVE
Quality-conscious scheduling strategies for archive crawling. We define data quality measures, characterize their properties, and develop a suite of SHARC framework for assessing the data quality in WebĪrchives and for tuning capturing strategies toward better Ideally, crawlers should gather coherent captures ofĮntire Web sites, but the politeness etiquette and completeness requirement mandate very slow, long-duration crawling
Data quality is crucial for these purposes.
Received: 27 August 2010 / Accepted: 3 February 2011 / Published online: 2 March 2011Ībstract Web archives preserve the history of borndigital content and offer great potential for sociologists, business analysts, and legal experts on intellectual property andĬompliance issues. The SHARC framework for data quality in Web archiving
0 kommentar(er)
