diff options
| author | reger <reger18@arcor.de> | 2017-03-31 00:58:11 +0200 |
|---|---|---|
| committer | reger <reger18@arcor.de> | 2017-03-31 00:58:11 +0200 |
| commit | 510f11d3745e14841420781376b733fd248d51f3 (patch) | |
| tree | 529bf1e9b155aeadc97c50917d23484fada497f5 /.classpath | |
| parent | 5b5b9d5d96d8930eb7d2166520b0f5630b5f45bd (diff) | |
Implement surrogate import from Warc archives (as first option handle
warc = Web ARChive File Format.
Warc files with extension .warc or compressed warc.gz can be placed in the
DATA/surrogate/in and contained responses are imported to the index.
The used library is stream based so we can easily extend it later to use
and load warc's from the net.
Diffstat (limited to '.classpath')
| -rw-r--r-- | .classpath | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/.classpath b/.classpath index 1cb896603..c36811f6e 100644 --- a/.classpath +++ b/.classpath @@ -99,5 +99,9 @@ <classpathentry kind="lib" path="lib/imageio-bmp-3.3.1.jar"/> <classpathentry kind="lib" path="lib/jsonic-1.2.0.jar"/> <classpathentry kind="lib" path="lib/langdetect.jar"/> + <classpathentry kind="lib" path="lib/jwat-common-1.0.4.jar"/> + <classpathentry kind="lib" path="lib/jwat-gzip-1.0.4.jar"/> + <classpathentry kind="lib" path="lib/jwat-archive-common-1.0.4.jar"/> + <classpathentry kind="lib" path="lib/jwat-warc-1.0.4.jar"/> <classpathentry kind="output" path="gen"/> </classpath> |