diff options
| author | Arnstein Ressem <aressem@gmail.com> | 2023-05-12 10:05:12 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-05-12 10:05:12 +0200 |
| commit | 2bb74878879b3acb1919fd658b8f2c476d8129d6 (patch) | |
| tree | a10aa176e159797be725968c936521082239b935 /linguistics-components/src/main/resources | |
| parent | 4fcbaf3415490b0563b50d492ce87ce06e8b966a (diff) | |
Revert "Bjorncs/huggingface tokenizer"
Diffstat (limited to 'linguistics-components/src/main/resources')
| -rw-r--r-- | linguistics-components/src/main/resources/configdefinitions/language.huggingface.hugging-face-tokenizer.def | 11 |
1 files changed, 0 insertions, 11 deletions
diff --git a/linguistics-components/src/main/resources/configdefinitions/language.huggingface.hugging-face-tokenizer.def b/linguistics-components/src/main/resources/configdefinitions/language.huggingface.hugging-face-tokenizer.def deleted file mode 100644 index a3e54ea38da..00000000000 --- a/linguistics-components/src/main/resources/configdefinitions/language.huggingface.hugging-face-tokenizer.def +++ /dev/null @@ -1,11 +0,0 @@ -# Copyright Yahoo. Licensed under the terms of the Apache 2.0 license. See LICENSE in the project root. - -namespace=language.huggingface - -# The language a model is for, one of the language tags in com.yahoo.language.Language. -# Use "unknown" for models to be used with any language. -model[].language string -# The path to the model relative to the application package root -model[].path path - -addSpecialTokens bool default=true
\ No newline at end of file |