aboutsummaryrefslogtreecommitdiffstats
path: root/storage
Commit message (Collapse)AuthorAgeFilesLines
* Track parameter name in member function definition.Tor Egge2020-11-031-1/+1
|
* Remove stray template keyword.Tor Egge2020-11-021-1/+1
|
* Merge pull request #15137 from ↵Tor Brede Vekterli2020-11-0210-31/+242
|\ | | | | | | | | vespa-engine/toregge/apply-diff-entry-using-async-spi-methods-during-bucket-merge Apply diff entries using async spi methods during bucket merge.
| * Move wait out of check_result.Tor Egge2020-11-026-24/+39
| | | | | | | | | | Pass elapsed time along with result and update metric after having checked the result.
| * Apply diff entries using async spi methods during bucket merge.Tor Egge2020-11-0210-31/+227
| |
* | Update and add commentsTor Brede Vekterli2020-11-023-8/+19
| |
* | Add test for explicit read guard iterator key orderingTor Brede Vekterli2020-10-301-0/+23
| |
* | Add stripe bits config and wire to implementationTor Brede Vekterli2020-10-3016-25/+59
| | | | | | | | | | Default is zero bits, which causes the standard, non-striped implementation to be used.
* | Add striped implementation of B-tree content node bucket databaseTor Brede Vekterli2020-10-3017-76/+517
|/ | | | | | | | | | Abstracts away multiple underlying B-tree DBs that each hold a subset of the super bucket space. Offers ordered iteration via a priority-queue based view over the sub DBs. Not yet ready for prime time, as the striping inherently requires an absolute lower bound on the bucket bits used in the system, which is currently not enforced.
* Use source-only nodes again during bucket merge if hasMask histogram showsTor Egge2020-10-294-54/+99
| | | | that some diff entries are unavailable on all other nodes.
* Merge pull request #15074 from vespa-engine/toregge/keep-unmapped-hasmask-bitsHenning Baldersheim2020-10-295-4/+35
|\ | | | | Keep hasMask bits for nodes not involved in merge operation step
| * Keep hasMask bits for nodes not involved in merge operation step.Tor Egge2020-10-285-4/+35
| |
* | GC unused content bucket btree flagHenning Baldersheim2020-10-281-1/+1
|/
* Rename MaskRemapper to HasMaskRemapper.Tor Egge2020-10-286-60/+116
| | | | | Move HasMaskRemapper to separate file. Add separate unit test for HasMaskRemapper.
* Remove dead code for unused toolTor Brede Vekterli2020-10-281-518/+0
|
* Remove legacy Judy array-backed bucket DB implementationTor Brede Vekterli2020-10-2817-2233/+7
|
* Merge pull request #15041 from ↵Tor Brede Vekterli2020-10-274-11/+268
|\ | | | | | | | | vespa-engine/toregge/add-unit-test-for-bucket-merge-with-partially-filled-diff-from-last-source-only-node Add unit test for bucket merge with partially filled diff
| * Add comments about per-reply masks.Tor Egge2020-10-273-1/+16
| |
| * Add unit test for bucket merge with partially filled diff from last source ↵Tor Egge2020-10-264-11/+253
| | | | | | | | only node.
* | - Honour max merge chunk size in one place.Henning Baldersheim2020-10-266-51/+19
|/ | | | - GC incomplete enable_merge_local_node_choose_docs_optimalization handling.
* Merge pull request #15033 from ↵Geir Storli2020-10-268-23/+245
|\ | | | | | | | | vespa-engine/geirst/async-message-handling-on-schedule Add support for async message handling when scheduling storage messag…
| * Use noexcept and prefix iterator increment.Geir Storli2020-10-263-3/+3
| |
| * Add support for async message handling when scheduling storage messages in ↵Geir Storli2020-10-268-23/+245
| | | | | | | | | | | | | | | | | | FileStorManager. When turned on, the calling thread (e.g. FNET network thread when using Storage API RPC) gets the next async message to handle (if any) as part of scheduling a storage message. This async message is then handled by the calling thread immediately, instead of going via a persistence thread.
* | Merge pull request #15032 from ↵Henning Baldersheim2020-10-261-1/+1
|\ \ | | | | | | | | | | | | vespa-engine/vekterli/avoid-mergehandler-spam-log-level-crash Don't try to access container element prior to adding it when spam logging
| * | Don't try to access container element prior to adding it when spam loggingTor Brede Vekterli2020-10-261-1/+1
| |/
* / Drop immediate commit, as it is gone.Henning Baldersheim2020-10-231-1/+1
|/
* Use default destructor outside class definition.Geir Storli2020-10-221-2/+6
|
* Reduce code duplication by consolidating setup of PersistenceHandler.Geir Storli2020-10-221-39/+38
|
* Reduce code duplication by consolidating setup of FileStorHandler.Geir Storli2020-10-221-160/+76
|
* Reduce code duplication by using TestFileStorComponents in more tests.Geir Storli2020-10-221-121/+39
|
* Test that new repo is reflected in cached value in PersistenceUtil.Henning Baldersheim2020-10-211-1/+15
|
* Add generation counter to StorageComponent to detect if repos have changed ↵Henning Baldersheim2020-10-209-25/+52
| | | | | | and need reload. Happy path where you do not need any reload is a single atomic relaxed load as opposed to at least 3 atomic locked instructions.
* Merge pull request #14970 from vespa-engine/balder/gc-unused-disk-count-codeHenning Baldersheim2020-10-2014-107/+78
|\ | | | | GC unused disk dimension.
| * Use simple assert insteadHenning Baldersheim2020-10-201-3/+1
| |
| * GC unused disk dimension.Henning Baldersheim2020-10-2014-106/+79
| |
* | Fix forward declarations.Tor Egge2020-10-206-6/+6
| |
* | Merge pull request #14979 from vespa-engine/toregge/remove-spi-partitionid-typeHenning Baldersheim2020-10-203-12/+5
|\ \ | | | | | | Remove storage::spi::PartitionId type.
| * | Remove storage::spi::PartitionId type.Tor Egge2020-10-203-12/+5
| |/
* / Allow for faster access of thread local variable.Henning Baldersheim2020-10-202-2/+8
|/ | | | | This is possible since we do not load our code explicit as dynamic library. Also replace __thread by standard c++ linkage thread_local.
* Do not access an object that has been moved away.Henning Baldersheim2020-10-201-1/+1
|
* Take number of response threads and number of network threads into account.Henning Baldersheim2020-10-202-1/+4
|
* Use existing utility method for creating Mergehandler.Henning Baldersheim2020-10-201-2/+1
|
* Add a registered threadlocal persistence handler.Henning Baldersheim2020-10-202-16/+27
|
* constifyHenning Baldersheim2020-10-202-2/+2
|
* Add a create and register method for creating PersistenceHandlers.Henning Baldersheim2020-10-202-7/+15
|
* Make component menber constHenning Baldersheim2020-10-204-63/+31
|
* Further reduce the semi global tentacles.Henning Baldersheim2020-10-196-26/+40
|
* - Avoid using PersitenceUtil as a global object that can reach everything. ↵Henning Baldersheim2020-10-1918-125/+69
| | | | | | | Only wire in what is needed. - GC unused code and make it explicit what is private and what is public. - Remove some traces of diskCount.
* Merge pull request #14951 from vespa-engine/balder/split-thread-and-handlerHenning Baldersheim2020-10-1924-345/+367
|\ | | | | Split the persistence thread and the message handler.
| * - Add class comments.Henning Baldersheim2020-10-1911-43/+44
| | | | | | | | | | | | - Reduce code visibility. - Clean up some unused members. - Some code unification.