summaryrefslogtreecommitdiffstats
path: root/linguistics-components/src/main/java/com/yahoo/language/sentencepiece/SentencePieceEmbedder.java
Commit message (Expand)AuthorAgeFilesLines
* Update copyrightJon Bratseth2023-10-091-1/+1
* Add skipping of control tokensLester Solbakken2023-02-101-3/+14
* Add decoding of sentencepiece token sequence to textLester Solbakken2023-02-101-0/+19
* Use '@Inject' from 'annotations' in multiple bundlesBjørn Christian Seime2022-05-061-1/+1
* BERT -> WordPiece, make subword prefix configurableJon Bratseth2021-12-171-2/+6
* Add a BERT embedderJon Bratseth2021-12-161-37/+8
* Add custom `@Beta` annotationBjørn Christian Seime2021-12-031-1/+1
* Encapsulate in a contextJon Bratseth2021-10-011-9/+7
* Update linguisticvs-componentsJon Bratseth2021-09-301-3/+9
* encode -> embedJon Bratseth2021-09-281-0/+219