aboutsummaryrefslogtreecommitdiffstats
path: root/searchcore/src
Commit message (Collapse)AuthorAgeFilesLines
* Merge pull request #20740 from ↵Geir Storli2022-01-1012-55/+80
|\ | | | | | | | | vespa-engine/geirst/prepare-sampling-of-current-transient-disk-usage Prepare for tracking the current transient disk usage across all docu…
| * Prepare for tracking the current transient disk usage across all document dbs.Geir Storli2022-01-1012-55/+80
| | | | | | | | | | The next step will be sampling the total disk usage of all current fusion indexes and report this as the transient disk usage.
* | Merge pull request #20729 from ↵Harald Musum2022-01-102-5/+6
|\ \ | | | | | | | | | | | | vespa-engine/revert-20728-revert-20724-balder/default-disk-bloat-at-25-percent Revert "Revert "Balder/default disk bloat at 25 percent""
| * | Update test after default disk bloat changed from 0.20 to 0.25Henning Baldersheim2022-01-101-3/+4
| | |
| * | Revert "Revert "Balder/default disk bloat at 25 percent""Henning Baldersheim2022-01-101-2/+2
| | |
| * | Revert "Balder/default disk bloat at 25 percent"Harald Musum2022-01-101-2/+2
| | |
| * | Default disk bloat changed from 20% to 25%.Henning Baldersheim2022-01-101-2/+2
| |/
* / Simplify use of search::diskindex::Fusion class.Tor Egge2022-01-092-33/+34
|/
* Sample and track the current transient memory usage across all document dbs.Geir Storli2022-01-0728-242/+112
| | | | | | | | | | | Previously, the transient memory usage was the theoretical worst case needed during loading of attributes. Now, we change this to being a snapshot of the total memory used by all memory indexes. In a simular fashion we plan to track the transient disk usage of all ongoing fusion disk indexes. Eventually, the transient resource usage will be subtracted from the absolute resource usage, before this is reported to the cluster controller in order to decide whether to block feeding. By doing this the transient resource usage is covered by the headroom on the content node, instead of leading to feed blocked due to natural fluctuations.
* Rewrite unit test to use GTest.Geir Storli2022-01-072-53/+54
|
* Remove unused functions.Geir Storli2022-01-071-2/+0
|
* Revert "Revert "Balder/refactor docentry""Henning Baldersheim2022-01-072-30/+31
|
* Revert "Balder/refactor docentry"Arnstein Ressem2022-01-072-31/+30
|
* - Flags -> Enum.Henning Baldersheim2022-01-062-12/+12
| | | | - Consistently use DocEntryList as type for std::vector<spi::DocEntry::UP>
* Only care about size of payload. Also add payload containing only doctype ↵Henning Baldersheim2022-01-061-5/+5
| | | | and gid
* Use enum class for the flags.Henning Baldersheim2022-01-062-13/+14
|
* Simplify by avoid both DocumentSize and PersistedDocumentSize. That is the same.Henning Baldersheim2022-01-062-20/+16
|
* Simplify DocEntry to get a clean interface with multiple implementations, ↵Henning Baldersheim2022-01-062-11/+15
| | | | | | instead of an mutant. Also add tests for the different variations a DocEntry can have.
* Factor out FieldMerger from Fusion.Tor Egge2022-01-051-0/+1
|
* Reduce code visibility and reasons to recompile.Henning Baldersheim2022-01-054-16/+25
|
* Extend proton config for controlling how many buffers to compact atTor Egge2021-12-152-1/+10
| | | | the same time.
* Reduce indexing.reactiontime from 2ms to 1ms.Henning Baldersheim2021-12-131-1/+1
|
* Deinline destructors for AttributeCollectionSpecFactory andTor Egge2021-12-125-0/+7
| | | | AttributeManagerInitializer. Add dependency on searchcore_pcommon.
* Include atomic when needed.Tor Egge2021-12-111-0/+1
|
* Add noexcept specifiers.Tor Egge2021-12-112-2/+2
|
* Before deciding if it is necessary to restart the scan we must wait until ↵Henning Baldersheim2021-12-101-2/+7
| | | | all pending operations are completed.
* Unblock the last pending document.Henning Baldersheim2021-12-101-0/+1
|
* Remove retry parameter not in use anymore.Henning Baldersheim2021-12-108-30/+17
|
* Move operation counting out to separate classHenning Baldersheim2021-12-104-30/+63
|
* Trigger commit from feedhandler insteda of only in AttributeWriter.Henning Baldersheim2021-12-102-2/+1
|
* Let accounting handle multiple commits in flight.Henning Baldersheim2021-12-102-15/+27
|
* Merge pull request #20443 from ↵Geir Storli2021-12-102-6/+7
|\ | | | | | | | | vespa-engine/toregge/calculate-need-for-compaction-when-updating-stats Calculate need for compaction when updating stats.
| * Calculate need for compaction when updating stats.Tor Egge2021-12-092-6/+7
| |
* | Merge pull request #20438 from ↵Henning Baldersheim2021-12-091-0/+4
|\ \ | |/ |/| | | | | vespa-engine/balder/add-init_fun-to-vespalib_Thread-too Add init_fun to vespalib::Thread too to figure out what the thread is…
| * Add init_fun to vespalib::Thread too to figure out what the thread is used for.Henning Baldersheim2021-12-091-0/+4
| |
* | Integrate CompactionStrategy with AddressSpace and MemoryUsage.Tor Egge2021-12-081-3/+1
|/
* Merge pull request #20420 from vespa-engine/toregge/add-compaction-specTor Egge2021-12-081-1/+1
|\ | | | | Add CompactionSpec.
| * Add CompactionSpec.Tor Egge2021-12-081-1/+1
| | | | | | | | | | Pass CompactionStrategy to DataStoreBase::startCompactWorstBuffers in preparation for compacting more buffers in the same compaction round.
* | Merge pull request #20412 from vespa-engine/balder/split-bloat-and-spreadHenning Baldersheim2021-12-088-41/+128
|\ \ | |/ |/| Separate spread and bloat
| * - Add class comments.Henning Baldersheim2021-12-081-3/+10
| | | | | | | | | | - Unify info logging. - Demote some info logging to debug.
| * Separate spread and bloatHenning Baldersheim2021-12-088-41/+121
| |
* | Move CompactionStrategy from searchcommon to vespalib.Tor Egge2021-12-0811-25/+29
|/
* Set AttributeHeader _fileName member when extracting tagsTor Egge2021-12-061-1/+1
| | | | from GenericHeader.
* Reduce indexing.reactiontime from 5ms to 2msHenning Baldersheim2021-12-031-1/+1
|
* Iterate outside of the loopHenning Baldersheim2021-12-031-2/+2
|
* Merge pull request #20329 from ↵Arne H Juul2021-12-0230-44/+43
|\ | | | | | | | | vespa-engine/arnej/config-class-should-not-be-public Arnej/config class should not be public
| * more descriptive name for header fileArne H Juul2021-12-0224-24/+24
| |
| * track namespace move in documenttypes.defArne H Juul2021-12-0230-44/+43
| | | | | | | | | | | | | | * For C++ code this introduces a "document::config" namespace, which will sometimes conflict with the global "config" namespace. * Move all forward-declarations of the types DocumenttypesConfig and DocumenttypesConfigBuilder to a common header file.
* | - Use the wakeupservice as main source for frequent regular wakeups.Henning Baldersheim2021-12-022-6/+5
| | | | | | | | | | - Keep a self wakeup of 100ms - Avoid using default arguments to be able to find callsite.
* | Must also wait for the other threads to complete their work as that is also ↵Henning Baldersheim2021-12-011-31/+54
| | | | | | | | tested.