aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
...
* | | | | Merge pull request #27834 from ↵Bjørn Christian Seime2023-07-193-24/+13
|\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | vespa-engine/vekterli/defer-side-channel-safe-array-ops-to-bc Defer side channel-safe array checks to existing BC utils
| * | | | | Defer side channel-safe array checks to existing BC utilsTor Brede Vekterli2023-07-193-24/+13
| |/ / / / | | | | | | | | | | | | | | | Use constant-time array compare for TokenCheckHash equality checks.
* | | | | Merge pull request #27830 from vespa-engine/balder/make-do-with-fieldspecbaseeHenning Baldersheim2023-07-1911-58/+60
|\ \ \ \ \ | | | | | | | | | | | | We only need the FieldSpecBase. No need to carry and copy the name ar…
| * | | | | We only need the FieldSpecBase. No need to carry and copy the name around.Henning Baldersheim2023-07-1911-58/+60
| | | | | |
* | | | | | Merge pull request #27831 from vespa-engine/bjorncs/reapplyBjørn Christian Seime2023-07-193-105/+83
|\ \ \ \ \ \ | |_|/ / / / |/| | | / / | | |_|/ / | |/| | | Bjorncs/reapply
| * | | | Proper modelling of client auth settingBjørn Christian Seime2023-07-192-13/+18
| | | | |
| * | | | Control whether proxy protocol is enabledBjørn Christian Seime2023-07-192-6/+10
| | | | |
| * | | | Verify connector config when application has mTLS disabledBjørn Christian Seime2023-07-191-4/+16
| | | | |
| * | | | Use builder pattern to make connector configuration more readableBjørn Christian Seime2023-07-193-104/+73
| |/ / / | | | | | | | | | | | | Prepare for serving token endpoint on separate port
* | | | Merge pull request #27829 from vespa-engine/bjorncs/testBjørn Christian Seime2023-07-191-4/+16
|\ \ \ \ | |/ / / |/| | | Verify connector config when application has mTLS disabled
| * | | Verify connector config when application has mTLS disabledBjørn Christian Seime2023-07-191-4/+16
|/ / /
* | | Merge pull request #27823 from ↵Henning Baldersheim2023-07-1912-127/+126
|\ \ \ | |_|/ |/| | | | | | | | vespa-engine/balder/prefer-helper-to-inheritance-and-add-noexcept - Add noexcept and some constexpr.
| * | Remove incorrect constexpr.Henning Baldersheim2023-07-191-1/+1
| | |
| * | - Add noexcept and some constexpr.Henning Baldersheim2023-07-1913-128/+127
| | | | | | | | | | | | - Use BitWord as helper class instead of inheriting in many static methods.
* | | Merge pull request #27826 from ↵Tor Egge2023-07-193-3/+78
|\ \ \ | |_|/ |/| | | | | | | | vespa-engine/toregge/unpack-interleaved-features-for-streaming-search Unpack interleaved features for streaming search.
| * | Unpack interleaved features for streaming search.Tor Egge2023-07-193-3/+78
| |/
* | Merge pull request #27820 from vespa-engine/mpolden/add-warningMartin Polden2023-07-191-4/+14
|\ \ | | | | | | Log GPU configuration
| * | Log when GPU configuration is successfulMartin Polden2023-07-191-3/+8
| | |
| * | Log warning when failing to use GPUMartin Polden2023-07-191-1/+6
| | |
* | | Merge pull request #27819 from ↵Harald Musum2023-07-191-0/+8
|\ \ \ | | | | | | | | | | | | | | | | vespa-engine/hmusum/throw-another-exception-when-allocated-host-already-taken Don't throw InvalidApplicationException when there are node allocatio…
| * | | Use Exceptions.toMessageString()Harald Musum2023-07-191-1/+4
| | | |
| * | | Don't throw InvalidApplicationException when there are node allocation issuesHarald Musum2023-07-191-0/+5
| | | |
* | | | Merge pull request #27824 from ↵Arnstein Ressem2023-07-191-0/+14
|\ \ \ \ | | | | | | | | | | | | | | | | | | | | vespa-engine/hmusum/add-flags-for-sessions-data-reading-and-writing Add flags for reading and writing session data as one blob
| * | | | Add flags for reading and writing session data as one blobHarald Musum2023-07-191-0/+14
| | |_|/ | |/| |
* | | | Merge pull request #27821 from ↵Bjørn Christian Seime2023-07-193-71/+113
|\ \ \ \ | |/ / / |/| | | | | | | | | | | vespa-engine/revert-27799-bjorncs/token-data-plane-separate-port Revert "Use builder pattern to make connector configuration more readable"
| * | | Revert "Use builder pattern to make connector configuration more readable"Bjørn Christian Seime2023-07-193-71/+113
|/ / /
* | | Merge pull request #27802 from vespa-engine/jdk21-prep-4gjoranv2023-07-1912-39/+31
|\ \ \ | | | | | | | | jdk21: Avoid calling superclass methods from subclass ctors
| * | | jdk21: set methods final in vespajlibgjoranv2023-07-175-8/+16
| | | | | | | | | | | | | | | | + fix import issues
| * | | jdk21: declare method final in testutilgjoranv2023-07-171-1/+2
| | | |
| * | | jdk21: declare methods final in jdisc_coregjoranv2023-07-171-2/+2
| | | |
| * | | jdk21: Avoid calling superclass methods from subclass ctorsgjoranv2023-07-175-28/+11
| | | |
* | | | Merge pull request #27816 from vespa-engine/toregge/backport-to-clang-15Tor Brede Vekterli2023-07-194-7/+8
|\ \ \ \ | |_|/ / |/| | | Backport to clang 15.
| * | | Backport to clang 15.Tor Egge2023-07-194-7/+8
|/ / /
* | | Merge pull request #27813 from vespa-engine/balder/gc-unused-interfacesTor Egge2023-07-1834-239/+157
|\ \ \ | | | | | | | | Balder/gc unused interfaces
| * | | Drop non ancient non const GetSize/GetPositionHenning Baldersheim2023-07-1833-171/+146
| | | |
| * | | GC unused OpenExistingHenning Baldersheim2023-07-183-37/+1
| | | |
| * | | GC unused SetFileNameHenning Baldersheim2023-07-183-32/+11
| | |/ | |/|
* | | Merge pull request #27812 from vespa-engine/mpolden/fix-credential-pathsBjørn Christian Seime2023-07-183-11/+49
|\ \ \ | |/ / |/| | Fix credentials paths for hosted
| * | Fix credentials paths for hostedMartin Polden2023-07-183-11/+49
| | |
* | | Merge pull request #27811 from vespa-engine/mpolden/tweak-throttlingMartin Polden2023-07-183-33/+25
|\ \ \ | | | | | | | | More throttle tweaking
| * | | More throttle tweakingMartin Polden2023-07-183-33/+25
| |/ / | | | | | | | | | | | | | | | Our busiest prod zone provisions 26 hosts/hour on average, on a typical release day. In CD, the highest rate is 33 hosts/hour. Added a feature flag to simplify further tweaking, defaulting to 40.
* | | Merge pull request #27765 from vespa-engine/balder/refactor-query-building-1Tor Egge2023-07-188-39/+76
|\ \ \ | | | | | | | | Balder/refactor query building 1
| * | | If a range is represented as a StringTerm we can not handle it with a DWA.Henning Baldersheim2023-07-133-2/+6
| | | |
| * | | Separate out non templated code, and avoid magic pre include LOG_SETUP.Henning Baldersheim2023-07-136-31/+60
| | | |
| * | | Separate with methodName rather than subtle boolean with default valueHenning Baldersheim2023-07-131-7/+11
| | | |
* | | | Merge pull request #27810 from vespa-engine/vekterli/levenshtein-dfaTor Egge2023-07-1818-3/+2663
|\ \ \ \ | | | | | | | | | | Implement Levenshtein DFA with successor string generation
| * | | | Implement Levenshtein DFAs with successor string generationTor Brede Vekterli2023-07-1818-3/+2663
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This implements code for building and evaluating Levenshtein Deterministic Finite Automata, where the resulting DFA efficiently matches all possible source strings that can be transformed to the target string within k max edits. This allows for O(n) matching of strings. We currently support k in {1, 2}. Additionally, when matching using a DFA, in the case where the source string does _not_ match, we can generate the _successor_ string; the next matching string that is lexicographically _greater_ than the source string. This string has the invariant that there are no possibly matching strings within k edits ordered after the source string but before the successor. This lets us do possibly massive leaps forward in an ordered dictionary, turning a scan for matches into a sublinear operation. Matching and successor generation is fully Unicode-aware. All input strings are expected to be in UTF-8 (without nulls), and the generated successor is also encoded as UTF-8. Internally, matching is done on UTF-32 code points and the DFA itself is built around UTF-32. UTF-8 decoding of source strings is done in a streaming fashion and does not require any allocations. This commit includes a templated core Levenshtein DFA matching (and successor generation) algorithm and two separate DFA implementations that can be used; one explicit and one implicit. The explicit DFA is an immutable DAG built up-front that represents all DFA states and transitions as explicit nodes and edges in a graph. This is currently the fastest to evaluate, but the build time and memory usage means its usage should be preferred for shorter strings (up to a few hundred chars). The implicit DFA does not build any graph up-front, but rather evaluates state transitions on-demand for any given source string. This is currently slower than the explicit DFA, but its O(1) memory usage (aside from the memory used by the target string itself) means that it can be used for arbitrary string lengths. This code currently exists as a freestanding vespalib utility, and is not yet wired to any production code (fuzzy matching or similar). Future optimizations: * Redesign sparse state representation and stepping logic to be much less branching, in turn making the code much less likely to stall the CPU pipeline. * Emit as much as possible of the successor string suffix by copying directly from the target string UTF-8 representation instead of following the DFA and encoding UTF-32 to UTF-8 chars.
* | | | | Merge pull request #27792 from vespa-engine/hmusum/groups-allowed-to-be-down-1Harald Musum2023-07-183-102/+173
|\ \ \ \ \ | | | | | | | | | | | | Check redundancy also for groups that are up
| * | | | | Use cluster state to check if disttributors are UPHarald Musum2023-07-181-5/+4
| | | | | |
| * | | | | Check min replication seen from all distributors that are UPHarald Musum2023-07-172-29/+17
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This means we will also check distributors that are on same node as a retired storage node