aboutsummaryrefslogtreecommitdiffstats
path: root/linguistics/src/test/java/com/yahoo/language/process
Commit message (Expand)AuthorAgeFilesLines
* Replace all usages of Arrays.asList with List.of where possible.Henning Baldersheim2024-04-124-25/+22
* Update copyrightJon Bratseth2023-10-0910-10/+10
* Don't remove indexable symbols when stemmingJon Bratseth2023-06-021-2/+2
* Always treat each symbol as a separate tokenJon Bratseth2023-05-221-0/+11
* Compute code points in whole string only when neededjonmv2022-12-061-1/+14
* Determine token types considering all charactersJon Bratseth2022-08-161-7/+16
* Update Verizon Media copyright notices.gjoranv2021-10-071-1/+1
* Update 2017 copyright notices.gjoranv2021-10-079-9/+9
* Revert "Merge pull request #17754 from vespa-engine/revert-17747-bratseth/spe...Jon Bratseth2021-05-051-0/+40
* Revert "Reapply "Bratseth/special tokens""Jon Bratseth2021-05-051-40/+0
* Revert "Merge pull request #17746 from vespa-engine/revert-17738-revert-17737...Jon Bratseth2021-05-051-0/+40
* Revert "Revert "Revert "Bratseth/special tokens"""Jon Bratseth2021-05-051-40/+0
* Revert "Revert "Bratseth/special tokens""Jon Bratseth2021-05-041-0/+40
* Revert "Bratseth/special tokens"Jon Bratseth2021-05-041-40/+0
* Expose tokens as mapJon Bratseth2021-05-041-5/+3
* Move specialtokens to linguisticsJon Bratseth2021-05-041-0/+42
* No functional changesJon Bratseth2021-04-144-15/+11
* No functional changesJon Bratseth2021-02-031-0/+19
* handle plugin tokenizer returning tokens with empty original stringArne Juul2020-08-241-0/+51
* Minor unification of tests.Henning Baldersheim2020-08-121-10/+18
* Surrogate aware gram splittingJon Bratseth2020-06-251-9/+37
* Remove deprecated apis in linguistics.gjoranv2019-01-211-27/+0
* add opennlp stemmers - revert previous changesJefim Matskin2018-07-181-2/+1
* add lang detection and opennlp stemmersJefim Matskin2018-07-171-0/+3
* Fix author tag for SimonBjørn Christian Seime2018-07-056-6/+6
* Update copyright headersJon Bratseth2017-06-1410-10/+10
* Revert "Update copyright headers"Jon Bratseth2017-06-1410-10/+10
* Update copyright headersJon Bratseth2017-06-1410-10/+10
* Revert "Copyright header"Jon Bratseth2017-06-1310-10/+10
* Copyright headerJon Bratseth2017-06-1310-10/+10
* PublishJon Bratseth2016-06-1510-0/+760