atextcrawler crawls and indexes selected websites. It starts from a few seed sites and follows their external links. Criteria defined in plugin code determine which linked sites (and which of their resources) are (recursively) added to the pool.

ibu d26d23348b Initial empty commit		2021-11-29 09:15:28 +00:00