Changes between Version 9 and Version 10 of ApertureDataSource

Timestamp:

10/12/05 13:25:56 (19 years ago)

Author:

anonymous

Comment:

--

ApertureDataSource

@@ -54 +54 @@
 The !AccessData instance used in !DataCrawlerBase maintains the information
 about which objects have been scanned before. This instance is passed to the
-!DataAccessor as this is the best place to do this detection. First, this prevents object creation when the resource has not been modified since the last scan (DataAccessor returns null). Furthermore, this allows the !HttpDataAccessor to use HTTP-specific functionality to let
-the webserver decide on whether the resource has changed since the last scan,
-preventing an unchanged file from being transported to the crawling side in
-the first place.
+!DataAccessor as this is the best place to do this detection:
+
+ * This prevents object creation when the resource has not been modified since the last scan (DataAccessor returns null).
+
+ * This allows for more sophisticated optimizations, e.g. the !HttpDataAccessor uses HTTP-specific functionality so that the webserver can decide whether the resource has changed since the last scan. This prevents an unchanged web page from being transported to the crawling side in the first place.
 
 == HypertextCrawler ==