summaryrefslogtreecommitdiffstats
path: root/linguistics
Commit message (Collapse)AuthorAgeFilesLines
* Revert "Merge pull request #17754 from ↵Jon Bratseth2021-05-058-13/+336
| | | | | | | vespa-engine/revert-17747-bratseth/special-tokens-take-2" This reverts commit a2c9cd4bc04f1a3eaa31524b3970b96be5c2eda9, reversing changes made to 8c61a373af0066fbdf1cca354c24b197c7347321.
* Revert "Reapply "Bratseth/special tokens""Jon Bratseth2021-05-058-336/+13
|
* Revert "Merge pull request #17746 from ↵Jon Bratseth2021-05-058-13/+336
| | | | | | | vespa-engine/revert-17738-revert-17737-revert-17736-bratseth/special-tokens" This reverts commit 491856b396d003885e159345fe3f533f0fa35933, reversing changes made to 3720186303f4aef1d185525eaf61092097a64ec9.
* Revert "Revert "Revert "Bratseth/special tokens"""Jon Bratseth2021-05-058-336/+13
|
* Revert "Revert "Bratseth/special tokens""Jon Bratseth2021-05-048-13/+336
|
* Revert "Bratseth/special tokens"Jon Bratseth2021-05-048-336/+13
|
* Avoid config in simple tokenizerJon Bratseth2021-05-041-7/+4
|
* Expose tokens as mapJon Bratseth2021-05-044-12/+17
|
* Wire in (but don't use) SpecialTokensJon Bratseth2021-05-046-18/+40
|
* Move specialtokens to linguisticsJon Bratseth2021-05-044-0/+299
|
* No functional changesJon Bratseth2021-04-141-37/+26
|
* No functional changesJon Bratseth2021-04-1413-128/+84
|
* No functional changesJon Bratseth2021-02-032-1/+20
|
* Add a testJon Bratseth2020-11-121-3/+0
|
* Allow no argument to install_config_definitionsHarald Musum2020-09-121-1/+1
| | | | | Use src/main/resources/configdefinitions as default when no argument is given
* Use full name in config definition file namesHarald Musum2020-09-102-1/+1
|
* handle plugin tokenizer returning tokens with empty original stringArne Juul2020-08-242-1/+55
|
* Minor unification of tests.Henning Baldersheim2020-08-123-25/+36
|
* Update ABI specJon Bratseth2020-06-261-1/+2
|
* Surrogate aware gram splittingJon Bratseth2020-06-252-33/+122
|
* SpareCapacityMaintainer sketchJon Bratseth2020-06-126-66/+35
|
* variables in lambdas must be finalArne Juul2020-04-242-10/+16
|
* Apply suggestions from code reviewArne H Juul2020-04-243-7/+7
| | | Co-Authored-By: Jon Bratseth <bratseth@oath.com>
* add more tracing and debug logging of stemmingArne Juul2020-04-244-1/+25
|
* Add/corect copyright headersJon Bratseth2020-01-032-0/+2
|
* Install more config definition files.Tor Egge2019-11-291-0/+2
|
* Build tensors purely with floatsJon Bratseth2019-04-261-1/+1
|
* Move bound builder double array into double subclassJon Bratseth2019-04-261-1/+1
|
* Allow destructive changes in manually deployed zonesJon Bratseth2019-04-011-1/+1
|
* Nonfunctional changes onlyJon Bratseth2019-01-241-1/+1
|
* Update abi specs for 7.gjoranv2019-01-211-8/+3
|
* Generate html5 javadocgjoranv2019-01-211-7/+7
|
* Remove deprecated method (again)Jon Bratseth2019-01-212-16/+0
|
* Make SimpleLinguistics simple againJon Bratseth2019-01-214-104/+32
| | | | | - Remove SimpleLinguistics config and optional use of Optimaize - Add Optimaize to OpennlpLinguistics; on by default and config to disable
* 6-SNAPSHOT -> 7-SNAPSHOTArnstein Ressem2019-01-211-2/+2
|
* Remove deprecated apis in linguistics.gjoranv2019-01-214-68/+0
|
* Revert "Revert "Enable ABI checking on modules with public APIs""Ilpo Ruotsalainen2019-01-092-0/+660
| | | | This reverts commit cd470d8ac8a58c943748f028a37d864507628e99.
* Revert "Enable ABI checking on modules with public APIs"Håkon Hallingstad2019-01-042-660/+0
|
* Move abi-check-plugin configuration to parent.Ilpo Ruotsalainen2018-12-211-12/+0
| | | | | Instead of configuring in each module separately, put all configuration to parent and let the relevant modules just enable the plugin.
* Enable abi-check-plugin on relevant modules.Ilpo Ruotsalainen2018-12-182-0/+672
|
* Deprecated methods and add OptimaizeDetectorJon Bratseth2018-11-018-6/+161
|
* Prepare for removal of deprecated membersJon Bratseth2018-10-163-4/+8
|
* Reduce code duplicationHenning Baldersheim2018-10-052-15/+14
|
* Do not create huge optimaize structures when not necessary.Henning Baldersheim2018-10-052-1/+9
|
* Add copyright headerJon Bratseth2018-10-012-0/+2
|
* Defer loading the huge optimaize knowledgepool until you really need it. ↵Henning Baldersheim2018-09-101-20/+32
| | | | This cuts min memory footprint by 100MB+.
* Send global constantsJon Bratseth2018-09-063-1/+4
|
* Add missing newline at end of fileBjørn Christian Seime2018-07-261-1/+2
|
* Add config for simple-linguisticsBjørn Christian Seime2018-07-263-8/+45
| | | | Add a config parameter for enabling/disabling optimaize detector
* Exclude guava and slf4j-api in container-coregjoranv2018-07-251-6/+0
| | | | | | | | .. to prevent embedding them in container-disc and potentially other bundles. - Must be compile scope in linguistics because they're needed to run tests in modules depending on linguistics, e.g. indexinglanguage.