summaryrefslogtreecommitdiffstats
path: root/linguistics/src/main/java/com/yahoo/language/sentencepiece
Commit message (Expand)AuthorAgeFilesLines
* Separate component from linguisticsJon Bratseth2021-09-258-490/+0
* Linguistics cleanupJon Bratseth2021-09-211-1/+1
* Provide a (non-working) encoder by defaultJon Bratseth2021-09-171-1/+1
* CleanupJon Bratseth2021-09-175-9/+2
* Refactor to separate classesJon Bratseth2021-09-177-201/+278
* Encoder interfaceJon Bratseth2021-09-161-2/+14
* Encode to sparse tensorJon Bratseth2021-09-161-0/+10
* Encode to dense tensorJon Bratseth2021-09-161-4/+13
* Use a result builderJon Bratseth2021-09-161-21/+53
* Make SentencePieceEncoder configurableJon Bratseth2021-09-161-6/+30
* Merge pull request #19130 from vespa-engine/bratseth/sp-exportJo Kristian Bergum2021-09-141-0/+7
|\
| * Make publicJon Bratseth2021-09-141-0/+7
* | Slight algorithm simplificationJon Bratseth2021-09-141-6/+4
* | Slight algorithm simplificationJon Bratseth2021-09-141-6/+3
* | Slight algorithm simplificationJon Bratseth2021-09-141-11/+10
|/
* Pure Java sentencepiece implementationJon Bratseth2021-09-131-0/+332