summaryrefslogtreecommitdiff
path: root/htroot/IndexExport_p.html
diff options
context:
space:
mode:
authorMichael Peter Christen <mc@yacy.net>2025-08-01 15:30:46 +0900
committerMichael Peter Christen <mc@yacy.net>2025-08-01 15:30:46 +0900
commitde8fef9bf14e0c56f0aaac9199dd6071d87f1731 (patch)
tree31b1f3ad9bbeef3005fc8095224b44a3a79fb405 /htroot/IndexExport_p.html
parent055a2eaa250e97cbac21e42316db27b76e9c8798 (diff)
YaCy Index Pack Generator - refactoring of the SURROGATE process into a
"PACK" concept.
Diffstat (limited to 'htroot/IndexExport_p.html')
-rw-r--r--htroot/IndexExport_p.html68
1 files changed, 2 insertions, 66 deletions
diff --git a/htroot/IndexExport_p.html b/htroot/IndexExport_p.html
index df58837c2..feb449643 100644
--- a/htroot/IndexExport_p.html
+++ b/htroot/IndexExport_p.html
@@ -40,38 +40,8 @@
<dt class="TableCellDark">Export Format</dt>
<dd>
<dl>
- <dt>Full Data Records:</dt>
- <dd><input type="radio" name="format" value="full-elasticsearch" checked="checked" />
- JSON (Rich and full-text Elasticsearch data, one document per line in one flat JSON file,
- can be bulk-imported to elasticsearch. Here is an example for opensearch, using docker:<br />
-Start docker container of opensearch:<br />
-<code>docker run --name opensearch -p 9200:9200 -d -e OPENSEARCH_JAVA_OPTS="-Xms2G -Xmx2G" -e discovery.type=single-node -e DISABLE_SECURITY_PLUGIN=true -v $(pwd)/opensearch_data:/usr/share/opensearch/data opensearchproject/opensearch:latest</code><br />
-Unblock index creation:<br />
-<code>curl -X PUT "http://localhost:9200/_cluster/settings" -H 'Content-Type: application/json' -d'
-{
- "persistent": {
- "cluster.blocks.create_index": null
- }
-}'</code><br />
-Create the search index:<br />
-<code>curl -X PUT "http://localhost:9200/collection1/yacy"</code><br />
-Bulk-upload the index file:<br />
-<code>curl -XPOST "http://localhost:9200/collection1/yacy/_bulk?filter_path=took,errors" -H "Content-Type: application/x-ndjson" --data-binary @yacy_dump_XXX.flatjson</code><br />
-Make a search, get 10 results, search in fields text_t, title, description with boosts:<br />
-<code>curl -X POST "http://localhost:9200/collection1/yacy/_search" -H 'Content-Type: application/json' -d'
-{"size": 10, "query": {"multi_match": {
- "query": "one two three",
- "fields": ["text_t", "title^10", "description^3"], "fuzziness": "AUTO"
-}}}'</code><br />
- <input type="radio" name="format" value="full-solr" />
- XML (Rich and full-text Solr data, one document per line in one large xml file,
- can be processed with shell tools, can be imported with DATA/SURROGATE/in/)
- <br />
- <input type="radio" name="format" value="full-rss" />
- XML (RSS)
- </dd>
<dt>Full URL List:</dt>
- <dd><input type="radio" name="format" value="url-text" /> Plain Text List (URLs only)<br />
+ <dd><input type="radio" name="format" value="url-text" checked="checked"/> Plain Text List (URLs only)<br />
<input type="radio" name="format" value="url-html" /> HTML (URLs with title)</dd>
<dt>Only Domain:</dt>
<dd><input type="radio" name="format" value="dom-text" /> Plain Text List (domains only)<br />
@@ -79,7 +49,6 @@ Make a search, get 10 results, search in fields text_t, title, description with
<dt>Only Text:</dt>
<dd><input type="radio" name="format" value="text-text" /> Fulltext of Search Index Text</dd>
</dl>
- </dd>
<dt>&nbsp;</dt>
<dd><input type="submit" name="lurlexport" value="Export" class="btn btn-primary" style="width:240px;"/>
</dd>
@@ -91,46 +60,13 @@ Make a search, get 10 results, search in fields text_t, title, description with
#(lurlexportfinished)#::
<div class="alert alert-success">Finished export of #[urlcount]# Documents to file <a href="file://#[exportfile]#" target="_">#[exportfile]#</a><br/>
- <em>Import this file by moving it to DATA/SURROGATES/in</em></div>::
+ <em>Import this file by moving it to DATA/PACKS/load</em></div>::
#(/lurlexportfinished)#
#(lurlexporterror)#::
<div class="alert alert-warning">Export to file #[exportfile]# failed: #[exportfailmsg]#</div>::
#(/lurlexporterror)#
- #(dumprestore)#::
- <form action="IndexExport_p.html" method="post" enctype="multipart/form-data" accept-charset="UTF-8">
- <fieldset><legend>Dump and Restore of Solr Index</legend>
- #(dumpRestoreEnabled)#<div class="alert alert-info">This feature is available only when a local embedded Solr is active.</div>::#(/dumpRestoreEnabled)#
- <dl>
- <dt>&nbsp;</dt>
- <dd><input type="submit" name="indexdump" value="Create Dump" class="btn btn-primary" style="width:240px;" #(dumpRestoreEnabled)#disabled="disabled"::#(/dumpRestoreEnabled)#/>
- </dd>
- </dl>
- <dl>
- <dt class="TableCellDark">Dump File</dt>
- <dd><input type="text" name="dumpfile" value="#[dumpfile]#" size="80" maxlength="250" #(dumpRestoreEnabled)#disabled="disabled"::#(/dumpRestoreEnabled)#/>
- </dd>
- <dt>&nbsp;</dt>
- <dd><input type="submit" name="indexrestore" value="Restore Dump" class="btn btn-primary" style="width:240px;" #(dumpRestoreEnabled)#disabled="disabled"::#(/dumpRestoreEnabled)#/>
- </dd>
- </dl>
- </fieldset>
- </form>::
- #(/dumprestore)#
-
- #(indexdump)#::
- <div class="alert alert-success" role="alert">Stored a solr dump to file #[dumpfile]#</div>::
- <div class="alert alert-danger" role="alert">Could not create the Solr dump : no embedded Solr is available.</div>::
- <div class="alert alert-danger" role="alert">An error occurred while trying to create the Solr dump.</div>
- #(/indexdump)#
-
- #(indexRestore)#::
- <div class="alert alert-success" role="alert">Successfully restored Solr index from dump file!</div>::
- <div class="alert alert-danger" role="alert">Could not restore the Solr dump : no embedded Solr is available.</div>::
- <div class="alert alert-danger" role="alert">An error occurred while trying to restore the Solr dump.</div>
- #(/indexRestore)#
-
#%env/templates/footer.template%#
</body>
</html>