| Commit message (Expand) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | Update copyright | Jon Bratseth | 2023-10-09 | 1 | -1/+1 |
| * | Add skipping of control tokens | Lester Solbakken | 2023-02-10 | 1 | -0/+12 |
| * | Add decoding of sentencepiece token sequence to text | Lester Solbakken | 2023-02-10 | 1 | -0/+8 |
| * | BERT -> WordPiece, make subword prefix configurable | Jon Bratseth | 2021-12-17 | 1 | -21/+17 |
| * | Add a BERT embedder | Jon Bratseth | 2021-12-16 | 1 | -6/+0 |
| * | encode -> embed | Jon Bratseth | 2021-09-28 | 1 | -9/+9 |
| * | Separate component from linguistics | Jon Bratseth | 2021-09-25 | 1 | -0/+89 |
 |
index : vespa | |
| An engine for low-latency computation over large data sets |
| aboutsummaryrefslogtreecommitdiffstats |
path: root/linguistics-components/src/test/java/com/yahoo/language/sentencepiece/SentencePieceTest.java