diff options
| author | Bjørn Christian Seime <bjorncs@yahooinc.com> | 2023-05-11 16:24:23 +0200 |
|---|---|---|
| committer | Bjørn Christian Seime <bjorncs@yahooinc.com> | 2023-05-11 16:41:54 +0200 |
| commit | 9498a63f89a08f862c2f6a4a7c17441a6365e69a (patch) | |
| tree | 740f62e276306a329a6f382ca40ef87182226700 /model-integration/src/main/resources | |
| parent | a7e91df672012078a9ab6566c6ee604460a4dcc5 (diff) | |
Handle models requiring token type ids
Diffstat (limited to 'model-integration/src/main/resources')
| -rw-r--r-- | model-integration/src/main/resources/configdefinitions/hugging-face-embedder.def | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/model-integration/src/main/resources/configdefinitions/hugging-face-embedder.def b/model-integration/src/main/resources/configdefinitions/hugging-face-embedder.def index 1dccea0ddf6..97515818f14 100644 --- a/model-integration/src/main/resources/configdefinitions/hugging-face-embedder.def +++ b/model-integration/src/main/resources/configdefinitions/hugging-face-embedder.def @@ -12,6 +12,7 @@ transformerMaxTokens int default=512 # Input names transformerInputIds string default=input_ids transformerAttentionMask string default=attention_mask +transformerTokenTypeIds string default=token_type_ids # Output name transformerOutput string default=last_hidden_state |