aboutsummaryrefslogtreecommitdiffstats
path: root/searchcore
Commit message (Collapse)AuthorAgeFilesLines
* Merge pull request #30695 from vespa-engine/havardpe/blueprint-strict-taggingHåvard Pettersen2024-03-2114-65/+83
|\ | | | | tag blueprints with strictness
| * tag blueprints with strictnessHåvard Pettersen2024-03-2014-65/+83
| | | | | | | | | | | | The strict-aware sort function is responsible for propagating and tagging strictness throughout the blueprint tree. Use pre-tagged strictness in fetchPostings, createSearch and createFilterSearch.
* | Reapply add virtual fields to index environment for streaming mode.Tor Egge2024-03-201-0/+2
|/
* Revert "Add virtual fields to index environment for streaming mode."Henning Baldersheim2024-03-191-2/+0
|
* Add virtual fields to index environment for streaming mode.Tor Egge2024-03-191-0/+2
|
* Merge pull request #30611 from ↵Tor Brede Vekterli2024-03-137-98/+166
|\ | | | | | | | | vespa-engine/vekterli/handle-imported-attributes-in-doc-select-fallback-path Use attributes when evaluating selection expression on full documents
| * Use attributes when evaluating selection expression on full documentsTor Brede Vekterli2024-03-127-98/+166
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This addresses an unintended shortcoming in our handling of imported fields, as these are exposed _only_ through attributes. Document selection evaluation is automatically optimized in the backend by pre-filtering documents that can be fully evaluated by exclusively looking at attribute values (this goes for both selection matching and mismatching). This is done by cloning the selection AST and replacing all applicable field value nodes with corresponding attribute references. However, if a document _cannot_ be evaluated from attributes alone, we fall back to reading it fully from the doc store, after which the original selection is evaluated on it. This is the crux of the problem, and prior to this commit an expression using both an imported field and a non-attribute field would fail to be evaluated since the full document evaluation would not have any knowledge of the attribute. This commit makes it so that also the full document evaluation will use a "patched" AST with all possible field references replaced with attribute lookups. Since we reuse an existing patched AST that was not otherwise used in this code path, there is no added overhead with this approach.
* | Merge pull request #30580 from ↵Geir Storli2024-03-122-69/+75
|\ \ | | | | | | | | | | | | vespa-engine/toregge/rewrite-searchcore-fusion-runner-unit-test-to-gtest Rewrite searchcore fusion runner unit test to gtest.
| * | Rewrite searchcore fusion runner unit test to gtest.Tor Egge2024-03-112-69/+75
| |/
* | Merge pull request #30579 from ↵Geir Storli2024-03-122-38/+35
|\ \ | | | | | | | | | | | | vespa-engine/toregge/rewrite-searchcore-disk-index-cleaner-unit-test-to-gtest Rewrite searchcore DiskIndexCleaner unit test to gtest.
| * | Rewrite searchcore DiskIndexCleaner unit test to gtest.Tor Egge2024-03-112-38/+35
| |/
* | Merge pull request #30578 from ↵Geir Storli2024-03-122-31/+9
|\ \ | | | | | | | | | | | | vespa-engine/toregge/rewrite-searchcore-feed-token-unit-test-to-gtest Rewrite searchcore FeedToken unit test to gtest.
| * | Rewrite searchcore FeedToken unit test to gtest.Tor Egge2024-03-112-31/+9
| |/
* | Merge pull request #30577 from ↵Geir Storli2024-03-121-42/+17
|\ \ | | | | | | | | | | | | vespa-engine/toregge/rewrite-searchcore-feed-and-search-unit-test-to-gtest Rewrite searchcore feed and search unit test to gtest.
| * | Rewrite searchcore feed and search unit test to gtest.Tor Egge2024-03-111-42/+17
| |/
* / Rewrite searchcore attribute flush unit test to gtest.Tor Egge2024-03-112-151/+78
|/
* Rename to reflect that is is a configid, not a search cluster.Henning Baldersheim2024-03-051-3/+3
|
* Cache the query stack if using ranking.queryCache and use it for proper ↵Henning Baldersheim2024-02-295-13/+33
| | | | summary handling
* c++11 for loopsHenning Baldersheim2024-02-291-10/+8
|
* know the in-flow when sorting blueprintsHåvard Pettersen2024-02-231-2/+4
| | | | | | also added the option and tagging mechanic needed to force selected blueprints to be strict even in a non-strict context as well as calculating how much time this saves you.
* - Hide recall terms from ranking.Henning Baldersheim2024-02-191-3/+3
| | | | - Add noexcept.
* vespa.summaryFeatures.cached is always 0.0 (false)Henning Baldersheim2024-02-121-1/+0
|
* Use smaller buffer for reading file headers. And GC some unused code.Henning Baldersheim2024-02-093-35/+18
|
* - Complete dumping of 1 index field before progressing to the next.Henning Baldersheim2024-02-083-19/+19
| | | | | - This prevents allocating memory buffers, and file descriptors for all fields concurrently. - It will reduce memory footprint during flush if there are many fields.
* Add low-level benchmark program for search iterators.Geir Storli2024-02-082-7/+7
| | | | | Currently, it can benchmark the following query operators over an attribute vector: Single term, In, WeightedSet, DotProduct, Or.
* Merge pull request #30199 from vespa-engine/havardpe/explicit-flow-defaultsGeir Storli2024-02-062-0/+6
|\ | | | | make default flow stats more explicit
| * make default flow stats more explicitHåvard Pettersen2024-02-062-0/+6
| | | | | | | | | | | | for both simple and complex leafs account for number of inner children in complex leafs account for seek nesting for complex leafs with children
* | Merge pull request #30186 from ↵Geir Storli2024-02-061-3/+15
|\ \ | |/ |/| | | | | vespa-engine/toregge/track-oldest-config-generation-used-for-streaming-search Track oldest config generation used for streaming search.
| * Track oldest config generation used for streaming search.Tor Egge2024-02-051-3/+15
| |
* | Align flow stats calculation for leaf blueprints.Geir Storli2024-02-051-5/+0
|/ | | | | A special case is added for attributes without a known hit estimate, instead of trying to deduce this based on the size of the (legacy) absolute hit estimate.
* Include missing config files.Henning Baldersheim2024-02-051-0/+3
|
* Merge pull request #30158 from ↵Henning Baldersheim2024-02-054-19/+0
|\ | | | | | | | | vespa-engine/balder/disable_queue_limits_for_chained_merges-always-true disable_queue_limits_for_chained_merges has long been true, GC
| * disable_queue_limits_for_chained_merges has long been true, GCHenning Baldersheim2024-02-024-19/+0
| |
* | Merge pull request #30140 from ↵Geir Storli2024-02-051-2/+4
|\ \ | |/ |/| | | | | vespa-engine/havardpe/re-wire-flow-stats-calculation re-wire flow stats in blueprints
| * re-wire flow stats in blueprintsHåvard Pettersen2024-02-021-2/+4
| |
* | Merge pull request #30147 from vespa-engine/geirst/unknown-hit-estimateHenning Baldersheim2024-02-022-4/+4
|\ \ | | | | | | Tag hit estimates from attribute search contexts as unknown when appl…
| * | Tag hit estimates from attribute search contexts as unknown when applicable.Geir Storli2024-02-022-4/+4
| |/
* | Must also gc param description in parallell array.Henning Baldersheim2024-02-021-1/+0
| |
* | GC maxpendingidealstateoperations which has not been wired in for a long time.Henning Baldersheim2024-02-024-10/+0
|/
* GC unused stor-bucketdb and stor-opslogger config.Henning Baldersheim2024-01-301-5/+0
|
* Merge pull request #29976 from ↵Arne H Juul2024-01-241-10/+59
|\ | | | | | | | | vespa-engine/arnej/unit-test-verify-ranksetup-streaming write vsmfields.cfg and add smoke test
| * unit test streaming mode where possibleArne Juul2024-01-191-15/+22
| |
| * write vsmfields.cfg and add smoke testArne Juul2024-01-191-6/+48
| |
* | Merge pull request #30017 from vespa-engine/havardpe/wire-flow-costHenning Baldersheim2024-01-232-6/+6
|\ \ | | | | | | wire in strict flow analysis and strict-aware sorting
| * | wire in strict flow analysis and strict-aware sortingHåvard Pettersen2024-01-222-6/+6
| |/ | | | | | | | | | | | | | | | | | | strict_cost added to all blueprints separate top-down sort step after optimize move relative estimate out of blueprint state optimize all children; to calculate flow stats leaf defaults: matching>0.9: est: 0.5, cost: 1.0, strict_cost: 1.0 matching<=0.9: est: rel_est, cost: 1.0, strict_cost: rel_est
* | Some use cases needs a lower limitHenning Baldersheim2024-01-221-3/+2
| |
* | must not do two_phase_put for partial updateArne Juul2024-01-221-1/+1
|/
* cleanupArne Juul2024-01-171-2/+0
|
* add streaming-mode handlingArne Juul2024-01-174-20/+67
|
* Searchcore version of persistence conformance unit test uses gtest.Tor Egge2024-01-051-1/+0
|