yacy/source/de/anomic/crawler/Balancer.java, branch master YaCy search server with some extra patches https://git.fennell.dev/yacy/atom?h=master 2012-09-21T13:48:16Z refactoring 2012-09-21T13:48:16Z Michael Peter Christen mc@yacy.net 2012-09-21T13:48:16Z urn:sha1:00c1c777fa048d5c8b1001d6bf9c5f57ebd40202 Abstraction of HandleMap and HandleSet 2012-07-27T10:13:53Z Michael Peter Christen mc@yacy.net 2012-07-27T10:13:53Z urn:sha1:16877377719195227d8af174f0902497e2cdf59a removed a crawler overhead (terminated loop which searches greatest 2012-07-14T11:11:04Z Michael Peter Christen mc@yacy.net 2012-07-14T11:11:04Z urn:sha1:9b48c9fe2e2d81e29c7c594596859ae23bc0ccf4 stack that has zero-waiting urls). This should cause a slightly faster crawl for crawl stacks with many different domains in the crawl queue. replaced more size() > 0 by !isEmpty() 2012-07-12T09:12:21Z orbiter mc@yacy.net 2012-07-12T09:12:21Z urn:sha1:bbfa497a3c9c7717a0e2aeb6c98d2557f7b75bfa removed unused method parameters 2012-07-05T08:23:07Z Michael Peter Christen mc@yacy.net 2012-07-05T08:23:07Z urn:sha1:0301aba1e90b423271039f3b9bf8ae0ef99454cd generalized localhost naming. 2012-06-25T22:08:25Z Michael Peter Christen mc@yacy.net 2012-06-25T22:08:25Z urn:sha1:96aeb127e305d25c4af7710e84b36f2a9e23d3ed this is also a preparation for a better IPv6 implementation. hack against 100% cpu during crawl delete 2012-05-23T13:45:07Z Michael Peter Christen mc@yacy.net 2012-05-23T13:45:07Z urn:sha1:acc19e190dd0869dd9773102241fd0181749cb3a enhanced crawler/balancer: better remaining waiting-time guessing 2012-05-15T10:24:54Z Michael Peter Christen mc@yacy.net 2012-05-15T10:24:54Z urn:sha1:70505107caf39e8f694892e4ef8e744c29b9b0a7 - Redesigned crawler and parser to accept embedded links from the NOLOAD 2012-04-24T14:07:03Z Michael Peter Christen mc@yacy.net 2012-04-24T14:07:03Z urn:sha1:659178942f2918e8150e70b209364425575b5a53 queue and not from virtual documents generated by the parser. - The parser now generates nice description texts for NOLOAD entries which shall make it possible to find media content using the search index and not using the media prefetch algorithm during search (which was costly) - Removed the media-search prefetch process from image search refactoring: removed dependency from switchboard in Balancer/CrawlQueues 2012-04-21T11:47:48Z Michael Peter Christen mc@yacy.net 2012-04-21T11:47:48Z urn:sha1:a5d7da68a0f0919906fd550321af3d62f0b12c22