Commit message (Expand) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Update 2020 Oath copyrights. | gjoranv | 2021-10-27 | 2 | -2/+2 |
* | Update 2019 Oath copyrights. | gjoranv | 2021-10-27 | 1 | -1/+1 |
* | Update Verizon Media copyright notices. | gjoranv | 2021-10-07 | 3 | -3/+3 |
* | Update 2018 copyright notices. | gjoranv | 2021-10-07 | 3 | -3/+3 |
* | Update 2017 copyright notices. | gjoranv | 2021-10-07 | 70 | -70/+70 |
* | Encapsulate in a context | Jon Bratseth | 2021-10-01 | 2 | -16/+65 |
* | Pass destination | Jon Bratseth | 2021-09-30 | 2 | -8/+14 |
* | encode -> embed | Jon Bratseth | 2021-09-28 | 3 | -64/+64 |
* | Separate component from linguistics | Jon Bratseth | 2021-09-25 | 17 | -1206/+0 |
* | Linguistics cleanup | Jon Bratseth | 2021-09-21 | 18 | -45/+29 |
* | Add 'encode' expression | Jon Bratseth | 2021-09-19 | 2 | -1/+35 |
* | Provide a (non-working) encoder by default | Jon Bratseth | 2021-09-17 | 1 | -1/+1 |
* | Update ABI spec | Jon Bratseth | 2021-09-17 | 1 | -20/+46 |
* | Cleanup | Jon Bratseth | 2021-09-17 | 5 | -9/+2 |
* | Refactor to separate classes | Jon Bratseth | 2021-09-17 | 8 | -203/+279 |
* | Encoder interface | Jon Bratseth | 2021-09-16 | 3 | -4/+55 |
* | Encode to sparse tensor | Jon Bratseth | 2021-09-16 | 3 | -0/+17 |
* | Encode to dense tensor | Jon Bratseth | 2021-09-16 | 3 | -4/+36 |
* | Use a result builder | Jon Bratseth | 2021-09-16 | 1 | -21/+53 |
* | Make SentencePieceEncoder configurable | Jon Bratseth | 2021-09-16 | 6 | -56/+283 |
* | Merge pull request #19130 from vespa-engine/bratseth/sp-export | Jo Kristian Bergum | 2021-09-14 | 2 | -0/+79 |
|\ | |||||
| * | Add to abi spec | Jon Bratseth | 2021-09-14 | 1 | -0/+72 |
| * | Make public | Jon Bratseth | 2021-09-14 | 1 | -0/+7 |
* | | Merge pull request #19131 from vespa-engine/bratseth/sp-simplify | Jon Bratseth | 2021-09-14 | 1 | -13/+7 |
|\ \ | |||||
| * | | Slight algorithm simplification | Jon Bratseth | 2021-09-14 | 1 | -6/+4 |
| * | | Slight algorithm simplification | Jon Bratseth | 2021-09-14 | 1 | -6/+3 |
| * | | Slight algorithm simplification | Jon Bratseth | 2021-09-14 | 1 | -11/+10 |
| |/ | |||||
* / | More unit tests | Jon Bratseth | 2021-09-14 | 1 | -1/+20 |
|/ | |||||
* | Pure Java sentencepiece implementation | Jon Bratseth | 2021-09-13 | 7 | -2/+731 |
* | we want to compare Linguistics objects for equivalence | Arne Juul | 2021-08-04 | 4 | -1/+9 |
* | Require replacements to be applied during tokenization | Jon Bratseth | 2021-06-15 | 3 | -12/+11 |
* | Revert "Merge pull request #17754 from vespa-engine/revert-17747-bratseth/spe... | Jon Bratseth | 2021-05-05 | 8 | -13/+336 |
* | Revert "Reapply "Bratseth/special tokens"" | Jon Bratseth | 2021-05-05 | 8 | -336/+13 |
* | Revert "Merge pull request #17746 from vespa-engine/revert-17738-revert-17737... | Jon Bratseth | 2021-05-05 | 8 | -13/+336 |
* | Revert "Revert "Revert "Bratseth/special tokens""" | Jon Bratseth | 2021-05-05 | 8 | -336/+13 |
* | Revert "Revert "Bratseth/special tokens"" | Jon Bratseth | 2021-05-04 | 8 | -13/+336 |
* | Revert "Bratseth/special tokens" | Jon Bratseth | 2021-05-04 | 8 | -336/+13 |
* | Avoid config in simple tokenizer | Jon Bratseth | 2021-05-04 | 1 | -7/+4 |
* | Expose tokens as map | Jon Bratseth | 2021-05-04 | 4 | -12/+17 |
* | Wire in (but don't use) SpecialTokens | Jon Bratseth | 2021-05-04 | 6 | -18/+40 |
* | Move specialtokens to linguistics | Jon Bratseth | 2021-05-04 | 4 | -0/+299 |
* | No functional changes | Jon Bratseth | 2021-04-14 | 1 | -37/+26 |
* | No functional changes | Jon Bratseth | 2021-04-14 | 13 | -128/+84 |
* | No functional changes | Jon Bratseth | 2021-02-03 | 2 | -1/+20 |
* | Add a test | Jon Bratseth | 2020-11-12 | 1 | -3/+0 |
* | Allow no argument to install_config_definitions | Harald Musum | 2020-09-12 | 1 | -1/+1 |
* | Use full name in config definition file names | Harald Musum | 2020-09-10 | 2 | -1/+1 |
* | handle plugin tokenizer returning tokens with empty original string | Arne Juul | 2020-08-24 | 2 | -1/+55 |
* | Minor unification of tests. | Henning Baldersheim | 2020-08-12 | 3 | -25/+36 |
* | Update ABI spec | Jon Bratseth | 2020-06-26 | 1 | -1/+2 |