Skip to content

Latest commit

 

History

History
73 lines (46 loc) · 2.57 KB

CHANGES.md

File metadata and controls

73 lines (46 loc) · 2.57 KB
Raw

This file records changes to the SolrTextTagger. It has Solr & Java version compatibility info too.

NOTE: There are two independent recommended version of the tagger: the latest 2.x and latest 1.x. 1.x has a key feature (as seen below) that didn't make it to 2.x. If you don't need that feature then use 2.x.

The .travis.yml file shows the testing version matrix on master. Older releases will show older tested releases working at those times.

Version 2.4-SNAPSHOT (unreleased)

Compatible with Solr 6.0, 6.1, ...?

Compiled for Java 1.8.

Version 2.3, July 20th, 2016

Compatible with Solr 5.3, 5.4, 5.5. Unofficially, Solr 6.x seems to work too.

Compiled for Java 1.7.

Version 2.2, December 16th, 2015

Compatible with Solr 5.2

Compiled for Java 1.7.

Version 2.1, August 12th, 2015

Compatible with Solr 5.0 thru 5.1.

Compiled for Java 1.7.

Version 2.0, January 26th, 2015

Compatible with Solr 4.3 thru 4.10.

Compiled for Java 1.6.

This is a major release that fundamentally changes the underlying engine from working directly off of an FST to one working off a Lucene TermsEnum configured to be backed by an FST. The schema and configuration has changed some accordingly, but the tagger request API hasn't changed. The tagger's codebase shrunk too as Lucene manages more of the complexity. The internal name entries are now encoded as a char delimited phrase instead of a word dictionary with word ID phrases. This approach reduced the memory and disk requirements substantially from 1.x. 40% less?

IMPORTANT: One feature not yet ported from 1.x is support for index-time expanding synonyms and the catenate options of WordDelimiterFilter (or other analysis resulting in tokens at the same position). Consequently, don't do those things in your index analysis chain :-/

  • 'xmlOffsetAdjust' option. See README.md

  • 'htmlOffsetAdjust' option. See README.md

  • 'nonTaggableTags' option. See README.md

  • Removed deprecated NoSerializeEmbeddedSolrServer & EmbeddedSolrUpdater (#21)

Version 1.2 (and prior), October 2nd 2013

Compatible with Solr 4.2 thru 4.4; later 4.x releases may or may not work.

Compiled for Java 1.6.

  • Supports index-time expanding synonyms and the catenate options of WordDelimiterFilter, or most other analysis at index time wherein tokens are generated at the same position. Multi-word synonyms are not supported unless you normalize at index & query to a single-word variant (i.e. "domain name system" -> "dns"). Internally, this done by PhraseBuilder and is tested in PosIncPosLenTaggerTest. Thanks to Rupert Westenthaler! (#10)