yacy/htroot/IndexImportMediawiki_p.java, branch master YaCy search server with some extra patches https://git.fennell.dev/yacy/atom?h=master 2022-10-02T21:22:12Z moved all remaining servlet classes to new location 2022-10-02T21:22:12Z Michael Peter Christen mc@yacy.net 2022-10-02T21:22:12Z urn:sha1:adbda4c71b38cff4acdd14afb899c48eb26363f8 always use HTTPClient by 'try with resources' pattern to free up 2021-10-31T22:06:23Z sgaebel sgaebel@localhost.localdomain 2021-10-31T17:47:10Z urn:sha1:cdf901270cb2a8d09c3673aa3b2464ba067efe56 resources Fixed unsafe conccurent access to generic SimpleDateFormat instances 2018-06-28T12:59:23Z luccioman luccioman@users.noreply.github.com 2018-06-28T12:59:23Z urn:sha1:e97580dfc713d7572dd95c3f4d4cc19a2d46b6a2 SimpleDateFormat must not be used by concurrent threads without synchronization for parsing or formating dates as it is not thread-safe (internally holds a calendar instance that is not synchronized). Prefer now DateTimeFormatter when possible as it is thread-safe without concurrent access performance bottleneck (does not internally use synchronization locks). Record recrawl calls to make them schedulable 2018-01-10T16:05:53Z luccioman luccioman@users.noreply.github.com 2018-01-10T16:05:53Z urn:sha1:0c9e0b3566031da00e35f2f318780d6787b8c2c8 Added MediaWiki dump import scheduling feature. 2017-05-03T16:53:01Z luccioman luccioman@users.noreply.github.com 2017-05-03T16:53:01Z urn:sha1:a87281b4988bcf20934b5a6d95a66b297f00fbff Checking the last modified date by default to prevent unnecessary long running operations. Improved MediaWiki dump import monitoring. 2017-05-02T07:38:45Z luccioman luccioman@users.noreply.github.com 2017-05-02T07:38:45Z urn:sha1:10c03c6c641df3c1c915d582560fec520de55f77 When import thread is terminated : - now stop refreshing and stay on the monitoring page to give user a feedback after a long running import - added link to the next monitoring step : results from surrogates reader - added link to new import On the new import page, added a link on the eventual last import report. Extended Mediawiki dump import to remote URLs. 2017-04-14T12:32:44Z luccioman luccioman@users.noreply.github.com 2017-04-14T12:32:44Z urn:sha1:f66438442ecbb1d1ec29839780c4e19ecc36f923 When using a public HTTP URL in /IndexImportMediawiki_p.html, the remote file now is directly streamed and processed, allowing import of several GB dumps even with a low memory remote peer, and without need to manually download the dump file first. Improved error reports on various wiki dump prerequisites failure cases. 2017-04-11T06:21:34Z luccioman luccioman@users.noreply.github.com 2017-04-11T06:21:34Z urn:sha1:7edddd7b0d8b9087a60de7675fc8d237f6bccef5 Also added some JavaDoc. fix for mediawiki import 2015-01-11T23:35:47Z Michael Peter Christen mc@yacy.net 2015-01-11T23:35:47Z urn:sha1:3b51636ecbc8580b5ff8a5e3e94ac92d2baad6a9 catch input file not found in Mediawiki import 2014-07-10T21:58:47Z reger reger18@arcor.de 2014-07-10T21:58:47Z urn:sha1:7057e0b3e2cf8d49b5a2f9fea6cd5388b7a862e6