Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | Update ABI spec | Jon Bratseth | 2021-09-17 | 1 | -20/+46 | |
| | ||||||
* | Cleanup | Jon Bratseth | 2021-09-17 | 5 | -9/+2 | |
| | ||||||
* | Refactor to separate classes | Jon Bratseth | 2021-09-17 | 8 | -203/+279 | |
| | ||||||
* | Encoder interface | Jon Bratseth | 2021-09-16 | 3 | -4/+55 | |
| | ||||||
* | Encode to sparse tensor | Jon Bratseth | 2021-09-16 | 3 | -0/+17 | |
| | ||||||
* | Encode to dense tensor | Jon Bratseth | 2021-09-16 | 3 | -4/+36 | |
| | ||||||
* | Use a result builder | Jon Bratseth | 2021-09-16 | 1 | -21/+53 | |
| | ||||||
* | Make SentencePieceEncoder configurable | Jon Bratseth | 2021-09-16 | 6 | -56/+283 | |
| | ||||||
* | Merge pull request #19130 from vespa-engine/bratseth/sp-export | Jo Kristian Bergum | 2021-09-14 | 2 | -0/+79 | |
|\ | | | | | Make public | |||||
| * | Add to abi spec | Jon Bratseth | 2021-09-14 | 1 | -0/+72 | |
| | | ||||||
| * | Make public | Jon Bratseth | 2021-09-14 | 1 | -0/+7 | |
| | | ||||||
* | | Merge pull request #19131 from vespa-engine/bratseth/sp-simplify | Jon Bratseth | 2021-09-14 | 1 | -13/+7 | |
|\ \ | | | | | | | Slight algorithm simplification | |||||
| * | | Slight algorithm simplification | Jon Bratseth | 2021-09-14 | 1 | -6/+4 | |
| | | | ||||||
| * | | Slight algorithm simplification | Jon Bratseth | 2021-09-14 | 1 | -6/+3 | |
| | | | ||||||
| * | | Slight algorithm simplification | Jon Bratseth | 2021-09-14 | 1 | -11/+10 | |
| |/ | ||||||
* / | More unit tests | Jon Bratseth | 2021-09-14 | 1 | -1/+20 | |
|/ | ||||||
* | Pure Java sentencepiece implementation | Jon Bratseth | 2021-09-13 | 7 | -2/+731 | |
| | ||||||
* | we want to compare Linguistics objects for equivalence | Arne Juul | 2021-08-04 | 4 | -1/+9 | |
| | ||||||
* | Require replacements to be applied during tokenization | Jon Bratseth | 2021-06-15 | 3 | -12/+11 | |
| | ||||||
* | Revert "Merge pull request #17754 from ↵ | Jon Bratseth | 2021-05-05 | 8 | -13/+336 | |
| | | | | | | | vespa-engine/revert-17747-bratseth/special-tokens-take-2" This reverts commit a2c9cd4bc04f1a3eaa31524b3970b96be5c2eda9, reversing changes made to 8c61a373af0066fbdf1cca354c24b197c7347321. | |||||
* | Revert "Reapply "Bratseth/special tokens"" | Jon Bratseth | 2021-05-05 | 8 | -336/+13 | |
| | ||||||
* | Revert "Merge pull request #17746 from ↵ | Jon Bratseth | 2021-05-05 | 8 | -13/+336 | |
| | | | | | | | vespa-engine/revert-17738-revert-17737-revert-17736-bratseth/special-tokens" This reverts commit 491856b396d003885e159345fe3f533f0fa35933, reversing changes made to 3720186303f4aef1d185525eaf61092097a64ec9. | |||||
* | Revert "Revert "Revert "Bratseth/special tokens""" | Jon Bratseth | 2021-05-05 | 8 | -336/+13 | |
| | ||||||
* | Revert "Revert "Bratseth/special tokens"" | Jon Bratseth | 2021-05-04 | 8 | -13/+336 | |
| | ||||||
* | Revert "Bratseth/special tokens" | Jon Bratseth | 2021-05-04 | 8 | -336/+13 | |
| | ||||||
* | Avoid config in simple tokenizer | Jon Bratseth | 2021-05-04 | 1 | -7/+4 | |
| | ||||||
* | Expose tokens as map | Jon Bratseth | 2021-05-04 | 4 | -12/+17 | |
| | ||||||
* | Wire in (but don't use) SpecialTokens | Jon Bratseth | 2021-05-04 | 6 | -18/+40 | |
| | ||||||
* | Move specialtokens to linguistics | Jon Bratseth | 2021-05-04 | 4 | -0/+299 | |
| | ||||||
* | No functional changes | Jon Bratseth | 2021-04-14 | 1 | -37/+26 | |
| | ||||||
* | No functional changes | Jon Bratseth | 2021-04-14 | 13 | -128/+84 | |
| | ||||||
* | No functional changes | Jon Bratseth | 2021-02-03 | 2 | -1/+20 | |
| | ||||||
* | Add a test | Jon Bratseth | 2020-11-12 | 1 | -3/+0 | |
| | ||||||
* | Allow no argument to install_config_definitions | Harald Musum | 2020-09-12 | 1 | -1/+1 | |
| | | | | | Use src/main/resources/configdefinitions as default when no argument is given | |||||
* | Use full name in config definition file names | Harald Musum | 2020-09-10 | 2 | -1/+1 | |
| | ||||||
* | handle plugin tokenizer returning tokens with empty original string | Arne Juul | 2020-08-24 | 2 | -1/+55 | |
| | ||||||
* | Minor unification of tests. | Henning Baldersheim | 2020-08-12 | 3 | -25/+36 | |
| | ||||||
* | Update ABI spec | Jon Bratseth | 2020-06-26 | 1 | -1/+2 | |
| | ||||||
* | Surrogate aware gram splitting | Jon Bratseth | 2020-06-25 | 2 | -33/+122 | |
| | ||||||
* | SpareCapacityMaintainer sketch | Jon Bratseth | 2020-06-12 | 6 | -66/+35 | |
| | ||||||
* | variables in lambdas must be final | Arne Juul | 2020-04-24 | 2 | -10/+16 | |
| | ||||||
* | Apply suggestions from code review | Arne H Juul | 2020-04-24 | 3 | -7/+7 | |
| | | | Co-Authored-By: Jon Bratseth <bratseth@oath.com> | |||||
* | add more tracing and debug logging of stemming | Arne Juul | 2020-04-24 | 4 | -1/+25 | |
| | ||||||
* | Add/corect copyright headers | Jon Bratseth | 2020-01-03 | 2 | -0/+2 | |
| | ||||||
* | Install more config definition files. | Tor Egge | 2019-11-29 | 1 | -0/+2 | |
| | ||||||
* | Build tensors purely with floats | Jon Bratseth | 2019-04-26 | 1 | -1/+1 | |
| | ||||||
* | Move bound builder double array into double subclass | Jon Bratseth | 2019-04-26 | 1 | -1/+1 | |
| | ||||||
* | Allow destructive changes in manually deployed zones | Jon Bratseth | 2019-04-01 | 1 | -1/+1 | |
| | ||||||
* | Nonfunctional changes only | Jon Bratseth | 2019-01-24 | 1 | -1/+1 | |
| | ||||||
* | Update abi specs for 7. | gjoranv | 2019-01-21 | 1 | -8/+3 | |
| |