aboutsummaryrefslogtreecommitdiffstats
path: root/linguistics-components/src/test/java/com/yahoo/language/tools/EmbedderTester.java
Commit message (Expand)AuthorAgeFilesLines
* Update copyrightJon Bratseth2023-10-091-1/+1
* Add skipping of control tokensLester Solbakken2023-02-101-1/+0
* Add decoding of sentencepiece token sequence to textLester Solbakken2023-02-101-0/+8
* Test segmentation with subwordsJon Bratseth2021-12-171-1/+4
* BERT -> WordPiece, make subword prefix configurableJon Bratseth2021-12-171-0/+59