aboutsummaryrefslogtreecommitdiffstats
path: root/searchcore
Commit message (Collapse)AuthorAgeFilesLines
* Speed up persistence conformance test.Tor Egge2022-01-151-1/+7
|
* Subtract transient resource usage from the absolute usage before reporting ↵Geir Storli2022-01-142-4/+19
| | | | | | | to the cluster controller. This ensures that the transient resource usage is covered by the resource headroom on the content node, instead of leading to feed blocked due to natural fluctuations.
* Merge pull request #20782 from ↵Geir Storli2022-01-131-16/+16
|\ | | | | | | | | vespa-engine/toregge/calculate-transient-disk-space-due-to-fusion Consider disk space used by fusion indexes beyond current fusion index or
| * Rename ActiveDiskIndexes to DiskIndexes.Tor Egge2022-01-131-16/+16
| | | | | | | | Rename IndexDiskDirActiveState to IndexDiskDirState.
| * Consider disk space used by fusion indexes beyond current fusion index orTor Egge2022-01-121-2/+2
| | | | | | | | indexes before current fusion index as transient disk space.
* | Set defaults in config defs and ModelContext api to improve bucket merge ↵Geir Storli2022-01-122-4/+5
|/ | | | | | performance on content nodes. These are the same defaults set for the feature flags in https://github.com/vespa-engine/vespa/pull/20759.
* Reduce default summary cache memory from 5% to 4% all over.Henning Baldersheim2022-01-111-1/+1
|
* Merge pull request #20740 from ↵Geir Storli2022-01-1012-55/+80
|\ | | | | | | | | vespa-engine/geirst/prepare-sampling-of-current-transient-disk-usage Prepare for tracking the current transient disk usage across all docu…
| * Prepare for tracking the current transient disk usage across all document dbs.Geir Storli2022-01-1012-55/+80
| | | | | | | | | | The next step will be sampling the total disk usage of all current fusion indexes and report this as the transient disk usage.
* | Merge pull request #20729 from ↵Harald Musum2022-01-102-5/+6
|\ \ | | | | | | | | | | | | vespa-engine/revert-20728-revert-20724-balder/default-disk-bloat-at-25-percent Revert "Revert "Balder/default disk bloat at 25 percent""
| * | Update test after default disk bloat changed from 0.20 to 0.25Henning Baldersheim2022-01-101-3/+4
| | |
| * | Revert "Revert "Balder/default disk bloat at 25 percent""Henning Baldersheim2022-01-101-2/+2
| | |
| * | Revert "Balder/default disk bloat at 25 percent"Harald Musum2022-01-101-2/+2
| | |
| * | Default disk bloat changed from 20% to 25%.Henning Baldersheim2022-01-101-2/+2
| |/
* / Simplify use of search::diskindex::Fusion class.Tor Egge2022-01-092-33/+34
|/
* Sample and track the current transient memory usage across all document dbs.Geir Storli2022-01-0729-243/+113
| | | | | | | | | | | Previously, the transient memory usage was the theoretical worst case needed during loading of attributes. Now, we change this to being a snapshot of the total memory used by all memory indexes. In a simular fashion we plan to track the transient disk usage of all ongoing fusion disk indexes. Eventually, the transient resource usage will be subtracted from the absolute resource usage, before this is reported to the cluster controller in order to decide whether to block feeding. By doing this the transient resource usage is covered by the headroom on the content node, instead of leading to feed blocked due to natural fluctuations.
* Rewrite unit test to use GTest.Geir Storli2022-01-072-53/+54
|
* Remove unused functions.Geir Storli2022-01-071-2/+0
|
* Revert "Revert "Balder/refactor docentry""Henning Baldersheim2022-01-072-30/+31
|
* Revert "Balder/refactor docentry"Arnstein Ressem2022-01-072-31/+30
|
* - Flags -> Enum.Henning Baldersheim2022-01-062-12/+12
| | | | - Consistently use DocEntryList as type for std::vector<spi::DocEntry::UP>
* Only care about size of payload. Also add payload containing only doctype ↵Henning Baldersheim2022-01-061-5/+5
| | | | and gid
* Use enum class for the flags.Henning Baldersheim2022-01-062-13/+14
|
* Simplify by avoid both DocumentSize and PersistedDocumentSize. That is the same.Henning Baldersheim2022-01-062-20/+16
|
* Simplify DocEntry to get a clean interface with multiple implementations, ↵Henning Baldersheim2022-01-062-11/+15
| | | | | | instead of an mutant. Also add tests for the different variations a DocEntry can have.
* Factor out FieldMerger from Fusion.Tor Egge2022-01-051-0/+1
|
* Reduce code visibility and reasons to recompile.Henning Baldersheim2022-01-054-16/+25
|
* Extend proton config for controlling how many buffers to compact atTor Egge2021-12-152-1/+10
| | | | the same time.
* Reduce indexing.reactiontime from 2ms to 1ms.Henning Baldersheim2021-12-131-1/+1
|
* Deinline destructors for AttributeCollectionSpecFactory andTor Egge2021-12-125-0/+7
| | | | AttributeManagerInitializer. Add dependency on searchcore_pcommon.
* Include atomic when needed.Tor Egge2021-12-111-0/+1
|
* Add noexcept specifiers.Tor Egge2021-12-112-2/+2
|
* Before deciding if it is necessary to restart the scan we must wait until ↵Henning Baldersheim2021-12-101-2/+7
| | | | all pending operations are completed.
* Unblock the last pending document.Henning Baldersheim2021-12-101-0/+1
|
* Remove retry parameter not in use anymore.Henning Baldersheim2021-12-108-30/+17
|
* Move operation counting out to separate classHenning Baldersheim2021-12-104-30/+63
|
* Trigger commit from feedhandler insteda of only in AttributeWriter.Henning Baldersheim2021-12-102-2/+1
|
* Let accounting handle multiple commits in flight.Henning Baldersheim2021-12-102-15/+27
|
* Merge pull request #20443 from ↵Geir Storli2021-12-102-6/+7
|\ | | | | | | | | vespa-engine/toregge/calculate-need-for-compaction-when-updating-stats Calculate need for compaction when updating stats.
| * Calculate need for compaction when updating stats.Tor Egge2021-12-092-6/+7
| |
* | Merge pull request #20438 from ↵Henning Baldersheim2021-12-091-0/+4
|\ \ | |/ |/| | | | | vespa-engine/balder/add-init_fun-to-vespalib_Thread-too Add init_fun to vespalib::Thread too to figure out what the thread is…
| * Add init_fun to vespalib::Thread too to figure out what the thread is used for.Henning Baldersheim2021-12-091-0/+4
| |
* | Integrate CompactionStrategy with AddressSpace and MemoryUsage.Tor Egge2021-12-081-3/+1
|/
* Merge pull request #20420 from vespa-engine/toregge/add-compaction-specTor Egge2021-12-081-1/+1
|\ | | | | Add CompactionSpec.
| * Add CompactionSpec.Tor Egge2021-12-081-1/+1
| | | | | | | | | | Pass CompactionStrategy to DataStoreBase::startCompactWorstBuffers in preparation for compacting more buffers in the same compaction round.
* | Merge pull request #20412 from vespa-engine/balder/split-bloat-and-spreadHenning Baldersheim2021-12-088-41/+128
|\ \ | |/ |/| Separate spread and bloat
| * - Add class comments.Henning Baldersheim2021-12-081-3/+10
| | | | | | | | | | - Unify info logging. - Demote some info logging to debug.
| * Separate spread and bloatHenning Baldersheim2021-12-088-41/+121
| |
* | Move CompactionStrategy from searchcommon to vespalib.Tor Egge2021-12-0811-25/+29
|/
* Set AttributeHeader _fileName member when extracting tagsTor Egge2021-12-061-1/+1
| | | | from GenericHeader.