diff options
| author | Jo Kristian Bergum <bergum@yahooinc.com> | 2024-01-06 10:54:58 +0100 |
|---|---|---|
| committer | Jo Kristian Bergum <bergum@yahooinc.com> | 2024-01-06 10:54:58 +0100 |
| commit | 18ae21bce56e018cef2c17d03e63617530af59ae (patch) | |
| tree | 3c1dcee63395fee2e476be9ce33e2437262b00d7 /config-model/src/main/resources/schema | |
| parent | e4da75db4556a3cd72b034c4406027f9bba73918 (diff) | |
handle multilingual models better
Diffstat (limited to 'config-model/src/main/resources/schema')
| -rw-r--r-- | config-model/src/main/resources/schema/common.rnc | 5 |
1 files changed, 3 insertions, 2 deletions
diff --git a/config-model/src/main/resources/schema/common.rnc b/config-model/src/main/resources/schema/common.rnc index 919253977ca..14fae90678d 100644 --- a/config-model/src/main/resources/schema/common.rnc +++ b/config-model/src/main/resources/schema/common.rnc @@ -138,9 +138,10 @@ ColBertEmbedder = element transformer-mask-token { xsd:integer }? & element transformer-input-ids { xsd:string }? & element transformer-attention-mask { xsd:string }? & - element transformer-token-type-ids { xsd:string }? & + element transformer-pad-token { xsd:integer }? & + element query-token-id { xsd:integer }? & + element document-token-id { xsd:integer }? & element transformer-output { xsd:string }? & - element normalize { xsd:boolean }? & OnnxModelExecutionParams & StartOfSequence & EndOfSequence |