summaryrefslogtreecommitdiffstats
path: root/storage
Commit message (Collapse)AuthorAgeFilesLines
* Remove unused wrapper type for disk count.Tor Egge2020-11-061-1/+0
|
* Remove disk config from ServiceLayerNode and StorageNode.Tor Egge2020-11-062-23/+2
|
* Remove disk distribution from C++ part of vdslib.Tor Egge2020-11-051-9/+1
|
* Merge pull request #15144 from ↵Tor Brede Vekterli2020-11-046-11/+112
|\ | | | | | | | | vespa-engine/vekterli/increase-priority-for-global-bucket-merges Increase priority for global bucket merges
| * Make prioritization of global bucket merges live configurableTor Brede Vekterli2020-11-036-3/+63
| | | | | | | | | | | | Lets an application that is starving default space merges explicitly disable prioritization temporarily. This is a stop-gap before we add more robust and generalized handling of resource exhaustion scenarios.
| * Increase priority for global bucket mergesTor Brede Vekterli2020-11-026-11/+52
| | | | | | | | | | | | | | | | | | To avoid global buckets competing with (and usually being starved by) default bucket space merges, explicitly prioritize default bucket merges above most other load. Increases both distributor-internal maintenance schedulinr priority and persistence-level operation priority.
* | Remove test that mentions an explicit disk state.Tor Egge2020-11-031-4/+0
| |
* | Update log message to not mention partitions.Tor Egge2020-11-031-1/+1
| |
* | Remove diskstate from vdslib.Tor Egge2020-11-039-196/+7
| |
* | Track parameter name in member function definition.Tor Egge2020-11-031-1/+1
| |
* | Remove stray template keyword.Tor Egge2020-11-021-1/+1
| |
* | Merge pull request #15137 from ↵Tor Brede Vekterli2020-11-0210-31/+242
|\ \ | |/ |/| | | | | vespa-engine/toregge/apply-diff-entry-using-async-spi-methods-during-bucket-merge Apply diff entries using async spi methods during bucket merge.
| * Move wait out of check_result.Tor Egge2020-11-026-24/+39
| | | | | | | | | | Pass elapsed time along with result and update metric after having checked the result.
| * Apply diff entries using async spi methods during bucket merge.Tor Egge2020-11-0210-31/+227
| |
* | Update and add commentsTor Brede Vekterli2020-11-023-8/+19
| |
* | Add test for explicit read guard iterator key orderingTor Brede Vekterli2020-10-301-0/+23
| |
* | Add stripe bits config and wire to implementationTor Brede Vekterli2020-10-3016-25/+59
| | | | | | | | | | Default is zero bits, which causes the standard, non-striped implementation to be used.
* | Add striped implementation of B-tree content node bucket databaseTor Brede Vekterli2020-10-3017-76/+517
|/ | | | | | | | | | Abstracts away multiple underlying B-tree DBs that each hold a subset of the super bucket space. Offers ordered iteration via a priority-queue based view over the sub DBs. Not yet ready for prime time, as the striping inherently requires an absolute lower bound on the bucket bits used in the system, which is currently not enforced.
* Use source-only nodes again during bucket merge if hasMask histogram showsTor Egge2020-10-294-54/+99
| | | | that some diff entries are unavailable on all other nodes.
* Merge pull request #15074 from vespa-engine/toregge/keep-unmapped-hasmask-bitsHenning Baldersheim2020-10-295-4/+35
|\ | | | | Keep hasMask bits for nodes not involved in merge operation step
| * Keep hasMask bits for nodes not involved in merge operation step.Tor Egge2020-10-285-4/+35
| |
* | GC unused content bucket btree flagHenning Baldersheim2020-10-281-1/+1
|/
* Rename MaskRemapper to HasMaskRemapper.Tor Egge2020-10-286-60/+116
| | | | | Move HasMaskRemapper to separate file. Add separate unit test for HasMaskRemapper.
* Remove dead code for unused toolTor Brede Vekterli2020-10-281-518/+0
|
* Remove legacy Judy array-backed bucket DB implementationTor Brede Vekterli2020-10-2817-2233/+7
|
* Merge pull request #15041 from ↵Tor Brede Vekterli2020-10-274-11/+268
|\ | | | | | | | | vespa-engine/toregge/add-unit-test-for-bucket-merge-with-partially-filled-diff-from-last-source-only-node Add unit test for bucket merge with partially filled diff
| * Add comments about per-reply masks.Tor Egge2020-10-273-1/+16
| |
| * Add unit test for bucket merge with partially filled diff from last source ↵Tor Egge2020-10-264-11/+253
| | | | | | | | only node.
* | - Honour max merge chunk size in one place.Henning Baldersheim2020-10-266-51/+19
|/ | | | - GC incomplete enable_merge_local_node_choose_docs_optimalization handling.
* Merge pull request #15033 from ↵Geir Storli2020-10-268-23/+245
|\ | | | | | | | | vespa-engine/geirst/async-message-handling-on-schedule Add support for async message handling when scheduling storage messag…
| * Use noexcept and prefix iterator increment.Geir Storli2020-10-263-3/+3
| |
| * Add support for async message handling when scheduling storage messages in ↵Geir Storli2020-10-268-23/+245
| | | | | | | | | | | | | | | | | | FileStorManager. When turned on, the calling thread (e.g. FNET network thread when using Storage API RPC) gets the next async message to handle (if any) as part of scheduling a storage message. This async message is then handled by the calling thread immediately, instead of going via a persistence thread.
* | Merge pull request #15032 from ↵Henning Baldersheim2020-10-261-1/+1
|\ \ | | | | | | | | | | | | vespa-engine/vekterli/avoid-mergehandler-spam-log-level-crash Don't try to access container element prior to adding it when spam logging
| * | Don't try to access container element prior to adding it when spam loggingTor Brede Vekterli2020-10-261-1/+1
| |/
* / Drop immediate commit, as it is gone.Henning Baldersheim2020-10-231-1/+1
|/
* Use default destructor outside class definition.Geir Storli2020-10-221-2/+6
|
* Reduce code duplication by consolidating setup of PersistenceHandler.Geir Storli2020-10-221-39/+38
|
* Reduce code duplication by consolidating setup of FileStorHandler.Geir Storli2020-10-221-160/+76
|
* Reduce code duplication by using TestFileStorComponents in more tests.Geir Storli2020-10-221-121/+39
|
* Test that new repo is reflected in cached value in PersistenceUtil.Henning Baldersheim2020-10-211-1/+15
|
* Add generation counter to StorageComponent to detect if repos have changed ↵Henning Baldersheim2020-10-209-25/+52
| | | | | | and need reload. Happy path where you do not need any reload is a single atomic relaxed load as opposed to at least 3 atomic locked instructions.
* Merge pull request #14970 from vespa-engine/balder/gc-unused-disk-count-codeHenning Baldersheim2020-10-2014-107/+78
|\ | | | | GC unused disk dimension.
| * Use simple assert insteadHenning Baldersheim2020-10-201-3/+1
| |
| * GC unused disk dimension.Henning Baldersheim2020-10-2014-106/+79
| |
* | Fix forward declarations.Tor Egge2020-10-206-6/+6
| |
* | Merge pull request #14979 from vespa-engine/toregge/remove-spi-partitionid-typeHenning Baldersheim2020-10-203-12/+5
|\ \ | | | | | | Remove storage::spi::PartitionId type.
| * | Remove storage::spi::PartitionId type.Tor Egge2020-10-203-12/+5
| |/
* / Allow for faster access of thread local variable.Henning Baldersheim2020-10-202-2/+8
|/ | | | | This is possible since we do not load our code explicit as dynamic library. Also replace __thread by standard c++ linkage thread_local.
* Do not access an object that has been moved away.Henning Baldersheim2020-10-201-1/+1
|
* Take number of response threads and number of network threads into account.Henning Baldersheim2020-10-202-1/+4
|