diff options
| author | Bjørn Christian Seime <bjorncs@yahooinc.com> | 2023-06-08 15:48:28 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-06-08 15:48:28 +0200 |
| commit | adf6ed430f5d86def123f03cc6a967d035255f14 (patch) | |
| tree | 6f2a920a73760691f4c9290469003a7905b9dab2 /configdefinitions | |
| parent | eae78b80d5d94e4cff9eb112637be20eb998712d (diff) | |
| parent | 7ae3e26016c32175aaf437ac09fca48457eb338e (diff) | |
Merge pull request #27349 from vespa-engine/bjorncs/disable-padding
Bjorncs/disable padding
Diffstat (limited to 'configdefinitions')
| -rw-r--r-- | configdefinitions/src/vespa/hugging-face-tokenizer.def | 5 |
1 files changed, 3 insertions, 2 deletions
diff --git a/configdefinitions/src/vespa/hugging-face-tokenizer.def b/configdefinitions/src/vespa/hugging-face-tokenizer.def index 18b3631e494..bc0d5300de5 100644 --- a/configdefinitions/src/vespa/hugging-face-tokenizer.def +++ b/configdefinitions/src/vespa/hugging-face-tokenizer.def @@ -9,5 +9,6 @@ model[].language string model[].path model addSpecialTokens bool default=true -maxLength int default=-1 -truncation bool default=false
\ No newline at end of file +maxLength int default=512 +truncation bool default=true +padding bool default=false |