diff options
| author | Michael Peter Christen <mc@yacy.net> | 2014-07-18 12:43:01 +0200 |
|---|---|---|
| committer | Michael Peter Christen <mc@yacy.net> | 2014-07-18 12:43:01 +0200 |
| commit | 2de159719b4612dde3e86c96bf66ccd52093b6e6 (patch) | |
| tree | 25ed45a1893be69d8ad0b78db60e2758e34c1b00 /test/net | |
| parent | bf1b6b93e7949aec0fe5b0f8e2d2114ed59be9c2 (diff) | |
added an option to set 'obey nofollow' for links with rel="nofollow"
attribute in the <a> tag for each crawl. This introduces a lot of
changes because it extends the usage of the AnchorURL Object type which
now also has a different toString method that the underlying
DigestURL.toString. It is therefore not advised to use .toString at all
for urls, just just toNormalform(false) instead.
Diffstat (limited to 'test/net')
| -rw-r--r-- | test/net/yacy/search/snippet/TextSnippetTest.java | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/test/net/yacy/search/snippet/TextSnippetTest.java b/test/net/yacy/search/snippet/TextSnippetTest.java index 0c92f581f..e6b4330d6 100644 --- a/test/net/yacy/search/snippet/TextSnippetTest.java +++ b/test/net/yacy/search/snippet/TextSnippetTest.java @@ -34,7 +34,7 @@ public class TextSnippetTest { doc = new SolrDocument();
DigestURL url = new DigestURL("http://localhost/page.html");
doc.addField(CollectionSchema.id.name(), ASCII.String(url.hash()));
- doc.addField(CollectionSchema.sku.name(),url.toString());
+ doc.addField(CollectionSchema.sku.name(), url.toNormalform(false));
// for testcases add other fields
// fields involved in snippet extraction:
// url, title, keywords, author, text_t
|