diff options
| author | orbiter <mc@yacy.net> | 2013-06-29 20:28:14 +0200 |
|---|---|---|
| committer | orbiter <mc@yacy.net> | 2013-06-29 20:28:14 +0200 |
| commit | 7c6ccc426cb5d2de7832f3d0eda4e93e89891bd1 (patch) | |
| tree | 30c83db8155e17c7982e912e7d2713010d3158d4 /COPYRIGHT | |
| parent | 5de4267a9d1ddca420884b38ba417411114ddd24 (diff) | |
set crawlingQ to true by default because most webpages are dynamic and
crawlingQ should only be switched off in case of crawler traps
Diffstat (limited to 'COPYRIGHT')
0 files changed, 0 insertions, 0 deletions