yacy/source/de/anomic/plasma/plasmaParser.java, branch masterYaCy search server with some extra patches
https://git.fennell.dev/yacy/atom?h=master2009-07-08T21:48:08Zrefactoring of parsers and document processing2009-07-08T21:48:08Zorbiterorbiter@6c8d7289-2bf4-0310-a012-ef5d649a15422009-07-08T21:48:08Zurn:sha1:dafffd0153dd2258eb281f49bf659084012a0b99
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6182 6c8d7289-2bf4-0310-a012-ef5d649a1542
serialized all logging using concurrency:2009-06-15T21:19:54Zorbiterorbiter@6c8d7289-2bf4-0310-a012-ef5d649a15422009-06-15T21:19:54Zurn:sha1:ce1adf9955ad053d2b69105cb992966ef6ccb236
high-performance search query situations as seen in yacy-metager integration showed deadlock situation caused by synchronization effects inside of sun.java code. It appears that the logger is not completely safe against deadlock situations in concurrent calls of the logger. One possible solution would be a outside-synchronization with 'synchronized' statements, but that would further apply blocking on all high-efficient methods that call the logger. It is much better to do a non-blocking hand-over of logging lines and work off log entries with a concurrent log writer. This also disconnects IO operations from logging, which can also cause IO operation when a log is written to a file. This commit not only moves the logger from kelondro to yacy.logging, it also inserts the concurrency methods to realize non-blocking logging.
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@6078 6c8d7289-2bf4-0310-a012-ef5d649a1542
more fixes (character encoding, parser exceptions, http client failure, blob writing)2009-05-02T07:43:03Zorbiterorbiter@6c8d7289-2bf4-0310-a012-ef5d649a15422009-05-02T07:43:03Zurn:sha1:057ce14c8ea35f65aec5bb29264e4f9fd7d9aef1
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5914 6c8d7289-2bf4-0310-a012-ef5d649a1542
set of small fixes2009-04-29T21:36:20Zorbiterorbiter@6c8d7289-2bf4-0310-a012-ef5d649a15422009-04-29T21:36:20Zurn:sha1:d3f8aa5a2a49cfc570f23b06a08a053f677dee47
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5903 6c8d7289-2bf4-0310-a012-ef5d649a1542
fix for mediawikiIndex surrogate producer + added concurrency2009-04-25T21:52:21Zorbiterorbiter@6c8d7289-2bf4-0310-a012-ef5d649a15422009-04-25T21:52:21Zurn:sha1:2e3186189b9a21207314838cc3741d9fa730689d
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5880 6c8d7289-2bf4-0310-a012-ef5d649a1542
more explaining error message in case of IOExceptions during html parsing2009-04-23T21:18:01Zorbiterorbiter@6c8d7289-2bf4-0310-a012-ef5d649a15422009-04-23T21:18:01Zurn:sha1:1bcc1450cb5d0454a730400217ab10f00fe5cadd
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5864 6c8d7289-2bf4-0310-a012-ef5d649a1542
- fix for join method with new generalized RWI data structure (caused by latest commit)2009-04-15T10:26:24Zorbiterorbiter@6c8d7289-2bf4-0310-a012-ef5d649a15422009-04-15T10:26:24Zurn:sha1:8a243500361bbba4a7a9977929c22a15c0f1d0b0
- added more functions to mediawiki parser
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5806 6c8d7289-2bf4-0310-a012-ef5d649a1542
- refactoring of the http client2009-02-19T16:24:46Zorbiterorbiter@6c8d7289-2bf4-0310-a012-ef5d649a15422009-02-19T16:24:46Zurn:sha1:c12bb8a6d0b947763995b89481ba3bc23e13facb
- added a protection against memory leaks for the access tracker
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5621 6c8d7289-2bf4-0310-a012-ef5d649a1542
more memory leak fixing hacks2009-02-11T13:31:10Zorbiterorbiter@6c8d7289-2bf4-0310-a012-ef5d649a15422009-02-11T13:31:10Zurn:sha1:411f2212f261de28de0cbc53a71676dae02c00e9
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5599 6c8d7289-2bf4-0310-a012-ef5d649a1542
moved logging partially to kelondro2009-01-31T01:06:56Zorbiterorbiter@6c8d7289-2bf4-0310-a012-ef5d649a15422009-01-31T01:06:56Zurn:sha1:94110df85a997041a3290b68f5258cfd3403ce0d
git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@5545 6c8d7289-2bf4-0310-a012-ef5d649a1542