yacy/htroot/api/ymarks/import_ymark.java, branch masterYaCy search server with some extra patches
https://git.fennell.dev/yacy/atom?h=master2021-09-16T20:23:51Zremoved ymarks2021-09-16T20:23:51ZMichael Peter Christenmc@yacy.net2021-09-16T20:23:51Zurn:sha1:63ad8ce6b2a6a2659073c97095b56693e1c706b5
had not been used since a long timeRemoved some unnecessary uses of java.lang.reflect api.2017-08-24T16:47:18Zlucciomanluccioman@users.noreply.github.com2017-08-24T16:47:18Zurn:sha1:4eba88f2ff1466d9fad1e52f52c792eb360e665b
This improves code browsing and readability, making search by references
or call hierarchy IDE features more accurate.Refactoring : use StandardCharsets constants instead of hard-coded2016-01-05T22:37:05Zlucluc@debianluc2016-01-05T22:37:05Zurn:sha1:571bc559376fe271580155539deef61e75284ac1
charset names.added surrogate import process for exported solr dumps.2015-05-30T11:19:59ZMichael Peter Christenmc@yacy.net2015-05-30T11:19:59Zurn:sha1:b43811d38c426ce5237df7d37c88285644e6a544
Just throw your solr dump file into DATA/SURROGATES/in/ and it will be
imported!refactor getBookmark 2015-05-10T22:37:04Zregerreger18@arcor.de2015-05-10T22:37:04Zurn:sha1:609c52e9878840d5938942857f23db4670449815
to consistenly check existance by != null (w/o throwing exception on not found)
- the webgraph shall store all links which appear on a web page and not2013-09-14T22:30:23ZMichael Peter Christenmc@yacy.net2013-09-14T22:30:23Zurn:sha1:5e31bad711f2751ceb8cdc90c7d25ba84e788827
all unique links! This made it necessary, that a large portion of the
parser and link processing classes must be adopted to carry a different
type of link collection which carry a property attribute which are
attached to web anchors.
- introduction of a new URL class, AnchorURL
- the other url classes, DigestURI and MultiProtocolURI had been renamed
and refactored to fit into a new document package schema, document.id
- cleanup of net.yacy.cora.document package and refactoringRedesign of crawler identification and robots steering. A non-p2p user2013-08-22T12:23:47ZMichael Peter Christenmc@yacy.net2013-08-22T12:23:47Zurn:sha1:765943a4b720a4266e246de037a91e3b34fe6b6b
in intranets and the internet can now choose to appear as Googlebot.
This is an essential necessity to be able to compete in the field of
commercial search appliances, since most web pages are these days
optimized only for Google and no other search platform any more. All
commercial search engine providers have a built-in fake-Google User
Agent to be able to get the same search index as Google can do. Without
the resistance against obeying to robots.txt in this case, no
competition is possible any more. YaCy will always obey the robots.txt
when it is used for crawling the web in a peer-to-peer network, but to
establish a Search Appliance (like a Google Search Appliance, GSA) it is
necessary to be able to behave exactly like a Google crawler.
With this change, you will be able to switch the user agent when portal
or intranet mode is selected on per-crawl-start basis. Every crawl start
can have a different user agent.fix for default boolean post values: the default value MUST NOT be TRUE,2013-07-31T08:49:26ZMichael Peter Christenmc@yacy.net2013-07-31T08:49:26Zurn:sha1:76afcccaafb4afbfb35b8951f578836b8ef808c7
because it's normal that a boolean value is missing in the post argument
if a checkbox is not selected.
Added also some style enhancements to IndexFederated, removed the Solr
attachment manual and replaced it with a link to the wiki which explains
this in more detail.always use a default value for boolean options to have transparency for2013-07-25T10:17:29ZMichael Peter Christenmc@yacy.net2013-07-25T10:17:29Zurn:sha1:4c242f9af9116a77361201c26d58ea08263c2885
the outcome if the attribute is missing in servletsAdded 'final' for all exception blocks as this helps the Java compiler2013-07-17T16:31:30ZRoland Haederroland@mxchange.org2013-07-17T16:31:30Zurn:sha1:841a28ae767e9b5c84eaa9826cbaa029a0be5c70
to optimize memory usage
Conflicts:
source/net/yacy/search/Switchboard.java