diff options
| author | Michael Peter Christen <mc@yacy.net> | 2025-08-01 15:30:46 +0900 |
|---|---|---|
| committer | Michael Peter Christen <mc@yacy.net> | 2025-08-01 15:30:46 +0900 |
| commit | de8fef9bf14e0c56f0aaac9199dd6071d87f1731 (patch) | |
| tree | 31b1f3ad9bbeef3005fc8095224b44a3a79fb405 /htroot/IndexExport_p.html | |
| parent | 055a2eaa250e97cbac21e42316db27b76e9c8798 (diff) | |
YaCy Index Pack Generator - refactoring of the SURROGATE process into a
"PACK" concept.
Diffstat (limited to 'htroot/IndexExport_p.html')
| -rw-r--r-- | htroot/IndexExport_p.html | 68 |
1 files changed, 2 insertions, 66 deletions
diff --git a/htroot/IndexExport_p.html b/htroot/IndexExport_p.html index df58837c2..feb449643 100644 --- a/htroot/IndexExport_p.html +++ b/htroot/IndexExport_p.html @@ -40,38 +40,8 @@ <dt class="TableCellDark">Export Format</dt> <dd> <dl> - <dt>Full Data Records:</dt> - <dd><input type="radio" name="format" value="full-elasticsearch" checked="checked" /> - JSON (Rich and full-text Elasticsearch data, one document per line in one flat JSON file, - can be bulk-imported to elasticsearch. Here is an example for opensearch, using docker:<br /> -Start docker container of opensearch:<br /> -<code>docker run --name opensearch -p 9200:9200 -d -e OPENSEARCH_JAVA_OPTS="-Xms2G -Xmx2G" -e discovery.type=single-node -e DISABLE_SECURITY_PLUGIN=true -v $(pwd)/opensearch_data:/usr/share/opensearch/data opensearchproject/opensearch:latest</code><br /> -Unblock index creation:<br /> -<code>curl -X PUT "http://localhost:9200/_cluster/settings" -H 'Content-Type: application/json' -d' -{ - "persistent": { - "cluster.blocks.create_index": null - } -}'</code><br /> -Create the search index:<br /> -<code>curl -X PUT "http://localhost:9200/collection1/yacy"</code><br /> -Bulk-upload the index file:<br /> -<code>curl -XPOST "http://localhost:9200/collection1/yacy/_bulk?filter_path=took,errors" -H "Content-Type: application/x-ndjson" --data-binary @yacy_dump_XXX.flatjson</code><br /> -Make a search, get 10 results, search in fields text_t, title, description with boosts:<br /> -<code>curl -X POST "http://localhost:9200/collection1/yacy/_search" -H 'Content-Type: application/json' -d' -{"size": 10, "query": {"multi_match": { - "query": "one two three", - "fields": ["text_t", "title^10", "description^3"], "fuzziness": "AUTO" -}}}'</code><br /> - <input type="radio" name="format" value="full-solr" /> - XML (Rich and full-text Solr data, one document per line in one large xml file, - can be processed with shell tools, can be imported with DATA/SURROGATE/in/) - <br /> - <input type="radio" name="format" value="full-rss" /> - XML (RSS) - </dd> <dt>Full URL List:</dt> - <dd><input type="radio" name="format" value="url-text" /> Plain Text List (URLs only)<br /> + <dd><input type="radio" name="format" value="url-text" checked="checked"/> Plain Text List (URLs only)<br /> <input type="radio" name="format" value="url-html" /> HTML (URLs with title)</dd> <dt>Only Domain:</dt> <dd><input type="radio" name="format" value="dom-text" /> Plain Text List (domains only)<br /> @@ -79,7 +49,6 @@ Make a search, get 10 results, search in fields text_t, title, description with <dt>Only Text:</dt> <dd><input type="radio" name="format" value="text-text" /> Fulltext of Search Index Text</dd> </dl> - </dd> <dt> </dt> <dd><input type="submit" name="lurlexport" value="Export" class="btn btn-primary" style="width:240px;"/> </dd> @@ -91,46 +60,13 @@ Make a search, get 10 results, search in fields text_t, title, description with #(lurlexportfinished)#:: <div class="alert alert-success">Finished export of #[urlcount]# Documents to file <a href="file://#[exportfile]#" target="_">#[exportfile]#</a><br/> - <em>Import this file by moving it to DATA/SURROGATES/in</em></div>:: + <em>Import this file by moving it to DATA/PACKS/load</em></div>:: #(/lurlexportfinished)# #(lurlexporterror)#:: <div class="alert alert-warning">Export to file #[exportfile]# failed: #[exportfailmsg]#</div>:: #(/lurlexporterror)# - #(dumprestore)#:: - <form action="IndexExport_p.html" method="post" enctype="multipart/form-data" accept-charset="UTF-8"> - <fieldset><legend>Dump and Restore of Solr Index</legend> - #(dumpRestoreEnabled)#<div class="alert alert-info">This feature is available only when a local embedded Solr is active.</div>::#(/dumpRestoreEnabled)# - <dl> - <dt> </dt> - <dd><input type="submit" name="indexdump" value="Create Dump" class="btn btn-primary" style="width:240px;" #(dumpRestoreEnabled)#disabled="disabled"::#(/dumpRestoreEnabled)#/> - </dd> - </dl> - <dl> - <dt class="TableCellDark">Dump File</dt> - <dd><input type="text" name="dumpfile" value="#[dumpfile]#" size="80" maxlength="250" #(dumpRestoreEnabled)#disabled="disabled"::#(/dumpRestoreEnabled)#/> - </dd> - <dt> </dt> - <dd><input type="submit" name="indexrestore" value="Restore Dump" class="btn btn-primary" style="width:240px;" #(dumpRestoreEnabled)#disabled="disabled"::#(/dumpRestoreEnabled)#/> - </dd> - </dl> - </fieldset> - </form>:: - #(/dumprestore)# - - #(indexdump)#:: - <div class="alert alert-success" role="alert">Stored a solr dump to file #[dumpfile]#</div>:: - <div class="alert alert-danger" role="alert">Could not create the Solr dump : no embedded Solr is available.</div>:: - <div class="alert alert-danger" role="alert">An error occurred while trying to create the Solr dump.</div> - #(/indexdump)# - - #(indexRestore)#:: - <div class="alert alert-success" role="alert">Successfully restored Solr index from dump file!</div>:: - <div class="alert alert-danger" role="alert">Could not restore the Solr dump : no embedded Solr is available.</div>:: - <div class="alert alert-danger" role="alert">An error occurred while trying to restore the Solr dump.</div> - #(/indexRestore)# - #%env/templates/footer.template%# </body> </html> |
