aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
...
* | | | Merge pull request #27826 from ↵Tor Egge2023-07-193-3/+78
|\ \ \ \ | |_|/ / |/| | | | | | | | | | | vespa-engine/toregge/unpack-interleaved-features-for-streaming-search Unpack interleaved features for streaming search.
| * | | Unpack interleaved features for streaming search.Tor Egge2023-07-193-3/+78
| |/ /
* | | Merge pull request #27820 from vespa-engine/mpolden/add-warningMartin Polden2023-07-191-4/+14
|\ \ \ | | | | | | | | Log GPU configuration
| * | | Log when GPU configuration is successfulMartin Polden2023-07-191-3/+8
| | | |
| * | | Log warning when failing to use GPUMartin Polden2023-07-191-1/+6
| | | |
* | | | Merge pull request #27819 from ↵Harald Musum2023-07-191-0/+8
|\ \ \ \ | | | | | | | | | | | | | | | | | | | | vespa-engine/hmusum/throw-another-exception-when-allocated-host-already-taken Don't throw InvalidApplicationException when there are node allocatio…
| * | | | Use Exceptions.toMessageString()Harald Musum2023-07-191-1/+4
| | | | |
| * | | | Don't throw InvalidApplicationException when there are node allocation issuesHarald Musum2023-07-191-0/+5
| | | | |
* | | | | Merge pull request #27824 from ↵Arnstein Ressem2023-07-191-0/+14
|\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | vespa-engine/hmusum/add-flags-for-sessions-data-reading-and-writing Add flags for reading and writing session data as one blob
| * | | | | Add flags for reading and writing session data as one blobHarald Musum2023-07-191-0/+14
| | |_|/ / | |/| | |
* | | | | Merge pull request #27821 from ↵Bjørn Christian Seime2023-07-193-71/+113
|\ \ \ \ \ | |/ / / / |/| | | | | | | | | | | | | | vespa-engine/revert-27799-bjorncs/token-data-plane-separate-port Revert "Use builder pattern to make connector configuration more readable"
| * | | | Revert "Use builder pattern to make connector configuration more readable"Bjørn Christian Seime2023-07-193-71/+113
|/ / / /
* | | | Merge pull request #27802 from vespa-engine/jdk21-prep-4gjoranv2023-07-1912-39/+31
|\ \ \ \ | | | | | | | | | | jdk21: Avoid calling superclass methods from subclass ctors
| * | | | jdk21: set methods final in vespajlibgjoranv2023-07-175-8/+16
| | | | | | | | | | | | | | | | | | | | + fix import issues
| * | | | jdk21: declare method final in testutilgjoranv2023-07-171-1/+2
| | | | |
| * | | | jdk21: declare methods final in jdisc_coregjoranv2023-07-171-2/+2
| | | | |
| * | | | jdk21: Avoid calling superclass methods from subclass ctorsgjoranv2023-07-175-28/+11
| | | | |
* | | | | Merge pull request #27816 from vespa-engine/toregge/backport-to-clang-15Tor Brede Vekterli2023-07-194-7/+8
|\ \ \ \ \ | |_|/ / / |/| | | | Backport to clang 15.
| * | | | Backport to clang 15.Tor Egge2023-07-194-7/+8
|/ / / /
* | | | Merge pull request #27813 from vespa-engine/balder/gc-unused-interfacesTor Egge2023-07-1834-239/+157
|\ \ \ \ | | | | | | | | | | Balder/gc unused interfaces
| * | | | Drop non ancient non const GetSize/GetPositionHenning Baldersheim2023-07-1833-171/+146
| | | | |
| * | | | GC unused OpenExistingHenning Baldersheim2023-07-183-37/+1
| | | | |
| * | | | GC unused SetFileNameHenning Baldersheim2023-07-183-32/+11
| | |/ / | |/| |
* | | | Merge pull request #27812 from vespa-engine/mpolden/fix-credential-pathsBjørn Christian Seime2023-07-183-11/+49
|\ \ \ \ | |/ / / |/| | | Fix credentials paths for hosted
| * | | Fix credentials paths for hostedMartin Polden2023-07-183-11/+49
| | | |
* | | | Merge pull request #27811 from vespa-engine/mpolden/tweak-throttlingMartin Polden2023-07-183-33/+25
|\ \ \ \ | |_|_|/ |/| | | More throttle tweaking
| * | | More throttle tweakingMartin Polden2023-07-183-33/+25
| |/ / | | | | | | | | | | | | | | | Our busiest prod zone provisions 26 hosts/hour on average, on a typical release day. In CD, the highest rate is 33 hosts/hour. Added a feature flag to simplify further tweaking, defaulting to 40.
* | | Merge pull request #27765 from vespa-engine/balder/refactor-query-building-1Tor Egge2023-07-188-39/+76
|\ \ \ | | | | | | | | Balder/refactor query building 1
| * | | If a range is represented as a StringTerm we can not handle it with a DWA.Henning Baldersheim2023-07-133-2/+6
| | | |
| * | | Separate out non templated code, and avoid magic pre include LOG_SETUP.Henning Baldersheim2023-07-136-31/+60
| | | |
| * | | Separate with methodName rather than subtle boolean with default valueHenning Baldersheim2023-07-131-7/+11
| | | |
* | | | Merge pull request #27810 from vespa-engine/vekterli/levenshtein-dfaTor Egge2023-07-1818-3/+2663
|\ \ \ \ | | | | | | | | | | Implement Levenshtein DFA with successor string generation
| * | | | Implement Levenshtein DFAs with successor string generationTor Brede Vekterli2023-07-1818-3/+2663
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This implements code for building and evaluating Levenshtein Deterministic Finite Automata, where the resulting DFA efficiently matches all possible source strings that can be transformed to the target string within k max edits. This allows for O(n) matching of strings. We currently support k in {1, 2}. Additionally, when matching using a DFA, in the case where the source string does _not_ match, we can generate the _successor_ string; the next matching string that is lexicographically _greater_ than the source string. This string has the invariant that there are no possibly matching strings within k edits ordered after the source string but before the successor. This lets us do possibly massive leaps forward in an ordered dictionary, turning a scan for matches into a sublinear operation. Matching and successor generation is fully Unicode-aware. All input strings are expected to be in UTF-8 (without nulls), and the generated successor is also encoded as UTF-8. Internally, matching is done on UTF-32 code points and the DFA itself is built around UTF-32. UTF-8 decoding of source strings is done in a streaming fashion and does not require any allocations. This commit includes a templated core Levenshtein DFA matching (and successor generation) algorithm and two separate DFA implementations that can be used; one explicit and one implicit. The explicit DFA is an immutable DAG built up-front that represents all DFA states and transitions as explicit nodes and edges in a graph. This is currently the fastest to evaluate, but the build time and memory usage means its usage should be preferred for shorter strings (up to a few hundred chars). The implicit DFA does not build any graph up-front, but rather evaluates state transitions on-demand for any given source string. This is currently slower than the explicit DFA, but its O(1) memory usage (aside from the memory used by the target string itself) means that it can be used for arbitrary string lengths. This code currently exists as a freestanding vespalib utility, and is not yet wired to any production code (fuzzy matching or similar). Future optimizations: * Redesign sparse state representation and stepping logic to be much less branching, in turn making the code much less likely to stall the CPU pipeline. * Emit as much as possible of the successor string suffix by copying directly from the target string UTF-8 representation instead of following the DFA and encoding UTF-32 to UTF-8 chars.
* | | | | Merge pull request #27792 from vespa-engine/hmusum/groups-allowed-to-be-down-1Harald Musum2023-07-183-102/+173
|\ \ \ \ \ | | | | | | | | | | | | Check redundancy also for groups that are up
| * | | | | Use cluster state to check if disttributors are UPHarald Musum2023-07-181-5/+4
| | | | | |
| * | | | | Check min replication seen from all distributors that are UPHarald Musum2023-07-172-29/+17
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This means we will also check distributors that are on same node as a retired storage node
| * | | | | Fix minor issues after code reviewsHarald Musum2023-07-172-3/+1
| | | | | |
| * | | | | Define valid range for groups-allowed-down-ratio in XML schemaHarald Musum2023-07-171-1/+1
| | | | | |
| * | | | | Avoid code duplicationHarald Musum2023-07-161-9/+7
| | | | | |
| * | | | | Check redundancy also for groups that are upHarald Musum2023-07-162-18/+106
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When we allow several groups to go down for maintenance we should check nodes in the groups that are up if they have the required redundancy. They might be up but have not yet synced all buckets after coming up. We want to wait with allowing more nodes to be taken down until that is done.
| * | | | | Split out method for finding min replication per distributorHarald Musum2023-07-141-15/+20
| | | | | |
| * | | | | Separate code at a higher level based on groupes setup or notHarald Musum2023-07-111-71/+66
| | | | | |
* | | | | | Merge pull request #27809 from ↵Tor Egge2023-07-183-78/+38
|\ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | vespa-engine/balder/gc-some-obscure-fastos-file-stdout-stderr-support GC some obscure support in FastOS_File for stderr and stdout.
| * | | | | | GC some obscure support in FastOS_File for stderr and stdout.Henning Baldersheim2023-07-183-78/+38
| | | | | | |
* | | | | | | Merge pull request #27808 from vespa-engine/balder/gc-fastos-rename-interfaceTor Egge2023-07-185-59/+9
|\ \ \ \ \ \ \ | |_|_|/ / / / |/| | | | | | Balder/gc fastos rename interface
| * | | | | | GC unused Rename interface.Henning Baldersheim2023-07-184-41/+0
| | | | | | |
| * | | | | | Use std::filesystem::renameHenning Baldersheim2023-07-181-18/+9
| |/ / / / /
* | | | | | Merge pull request #27807 from vespa-engine/mpolden/empty-hosts-metricMartin Polden2023-07-183-3/+47
|\ \ \ \ \ \ | |/ / / / / |/| | | | | Emit metric counting empty exclusive hosts
| * | | | | Update testMartin Polden2023-07-181-0/+1
| | | | | |
| * | | | | Emit metric counting empty exclusive hostsMartin Polden2023-07-183-3/+46
| | |_|/ / | |/| | |