aboutsummaryrefslogtreecommitdiffstats
path: root/linguistics/src/main/java/com/yahoo/language/opennlp/OpenNlpTokenizer.java
Commit message (Expand)AuthorAgeFilesLines
* Split out opennlp-linguisticsHenning Baldersheim2022-11-261-99/+0
* Determine token types considering all charactersJon Bratseth2022-08-161-23/+5
* Update 2018 copyright notices.gjoranv2021-10-071-1/+1
* Linguistics cleanupJon Bratseth2021-09-211-2/+1
* Revert "Merge pull request #17754 from vespa-engine/revert-17747-bratseth/spe...Jon Bratseth2021-05-051-1/+8
* Revert "Reapply "Bratseth/special tokens""Jon Bratseth2021-05-051-8/+1
* Revert "Merge pull request #17746 from vespa-engine/revert-17738-revert-17737...Jon Bratseth2021-05-051-1/+8
* Revert "Revert "Revert "Bratseth/special tokens"""Jon Bratseth2021-05-051-8/+1
* Revert "Revert "Bratseth/special tokens""Jon Bratseth2021-05-041-1/+8
* Revert "Bratseth/special tokens"Jon Bratseth2021-05-041-8/+1
* Wire in (but don't use) SpecialTokensJon Bratseth2021-05-041-1/+8
* No functional changesJon Bratseth2021-04-141-88/+51
* SpareCapacityMaintainer sketchJon Bratseth2020-06-121-0/+1
* variables in lambdas must be finalArne Juul2020-04-241-5/+8
* Apply suggestions from code reviewArne H Juul2020-04-241-4/+4
* add more tracing and debug logging of stemmingArne Juul2020-04-241-0/+8
* Add copyright headerJon Bratseth2018-10-011-0/+1
* add opennlp stemmers - revert previous changesJefim Matskin2018-07-181-0/+135