diff options
| author | orbiter <mc@yacy.net> | 2013-06-29 20:28:14 +0200 |
|---|---|---|
| committer | orbiter <mc@yacy.net> | 2013-06-29 20:28:14 +0200 |
| commit | 7c6ccc426cb5d2de7832f3d0eda4e93e89891bd1 (patch) | |
| tree | 30c83db8155e17c7982e912e7d2713010d3158d4 | |
| parent | 5de4267a9d1ddca420884b38ba417411114ddd24 (diff) | |
set crawlingQ to true by default because most webpages are dynamic and
crawlingQ should only be switched off in case of crawler traps
| -rw-r--r-- | defaults/yacy.init | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/defaults/yacy.init b/defaults/yacy.init index a6a2a1024..c20767fc3 100644 --- a/defaults/yacy.init +++ b/defaults/yacy.init @@ -536,7 +536,7 @@ indexMedia=true # Filter for crawling; may be used to restrict a crawl to a specific domain # URLs are only indexed and further crawled if they match this filter crawlingFilter=.* -crawlingQ=false +crawlingQ=true storeHTCache=true storeTXCache=true |