From 57ffdfad4c01ed79d461a18540bdf839eb263ae3 Mon Sep 17 00:00:00 2001 From: Michael Peter Christen Date: Wed, 3 Jul 2013 14:50:06 +0200 Subject: added a crawl option to obey html-meta-robots-noindex. This is on by default. --- htroot/QuickCrawlLink_p.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) (limited to 'htroot/QuickCrawlLink_p.html') diff --git a/htroot/QuickCrawlLink_p.html b/htroot/QuickCrawlLink_p.html index 9d9a9d1b9..b2cfa73d3 100644 --- a/htroot/QuickCrawlLink_p.html +++ b/htroot/QuickCrawlLink_p.html @@ -15,7 +15,7 @@ If you click on it while browsing, the currently viewed website will be inserted into the YaCy crawling queue for indexing.

- Crawl with YaCy + Crawl with YaCy

:: -- cgit v1.2.3