| Commit message (Collapse) | Author | Age | Files | Lines |
|
|
|
|
|
|
|
|
|
|
|
|
| |
If a cluster state bundle contains distribution config, this is
internally propagated via the `StateManager` component to all registered
state listeners. One such state listener is `FileStorManager`, which
updates the content node-internal bucket space repository.
All `SetSystemStateCommand` and internal config-aware components
(`StateManager` and `ChangedBucketOwnershipHandler`) now explicitly
track whether the cluster controller provides distribution config,
or if the internally provided config should be used (including
fallback to internal config if necessary).
|
| |
|
| |
|
| |
|
|\
| |
| |
| |
| | |
vespa-engine/toregge/rename-document-library-to-vespa-document
Rename document library to vespa_document.
|
| | |
|
|\ \
| |/
|/|
| |
| | |
vespa-engine/vekterli/accept-state-bundle-distribution-config-on-distributor
Accept distribution config from cluster controller on distributor
|
| | |
|
| | |
|
|/ |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Move distribution config transforms to vdslib so that the distribution
config bundle can contain derived configs for all bucket spaces in
one central place.
This is part of the prerequisite work needed before we can start
pushing distribution config from the cluster controller and rewiring
how distribution config is propagated and used in the backends.
Also, rename `Distribution::serialize()` to `Distribution::serialized()`
since it returns a const ref to a cached serialized form and does not do
on-demand serialization.
|
|
|
|
| |
Was only used by `DirConfig`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
This adds an entirely new implementation of the internal MessageBus
DocumentAPI protocol, which shall be functionally 1-to-1 compatible
with the existing legacy protocol.
New protobuf schemas have been added to the top-level documentapi
module, which are separated into different domains of responsibility:
* CRUD messages
* Visiting messages
* Data inspection messages
As well as a schema for shared, common message types.
Both C++ and Java protocol implementations separate serialization and
deserialization into a codec abstraction per message type, which
hides the boilerplate required for Protobuf buffer management. The
Java version is a tad more verbose due to generics type-erasure.
This protocol does _not_ currently support lazy (de-)serialization
in Java, as the existing mechanisms for doing so are inherently tied
to the legacy protocol version. Performance tests will decide if we
need to introduce such functionality to the new protocol version.
To avoid having the new protocol go live in production, this commit
changes the semantics of how MessageBus version reporting works (at
least for the near future); instead of reporting the current Vespa
_release_ version, it reports the highest supported _protocol_ version.
This lets us conditionally enable the new protocol by reporting a
MessageBus version greater than or equal to the protocol version _iff_
the protocol should be active.
The new protocol is disabled by default.
Other changes:
* Protocol tests have been moved up one package directory level to
be aligned with the actual package of the classes they test. This
allows for using package-protected constructors in the serialization
tests.
* `DocumentDeserializer` now exposes the underlying document type
repo/manager. This is done to detangle `Document`/`DocumentUpdate`
deserialization from the underlying wire buffer management.
* `RemoveLocationMessage` at long last contains a bucket space,
which was forgotten when we initially added this concept to the
other messages, and where the pain of adding it in later was
too big (not so anymore!).
Unit tests for both C++ and Java have been hoisted from the legacy
test suite, cleaned up and extended with additional cases. The C++
tests use the old unit test kit and should receive a good follow-up
washing and GTest-rewrite.
**Important**: due to how MessageBus protocol versioning works, the
final protocol version is _not_ yet decided, as setting it requires
syncing against our build systems. A follow-up commit will assign
the final version as well as include all required binary test files.
|
| |
|
| |
|
| |
|
|
|
|
| |
- Add explicit implementations for the types needed.
|
| |
|
| |
|
|
|
|
|
|
|
| |
- Use ConstArrayRef to hide implementation.
- Store all 3 node categories in a single vector.
- Use a small_vector that can handle redundancy up to 5 without requiring extra memory allocation.
- Build a hash_map if redundancy/groups > 32 for constant lookup time.
|
|
|
|
|
|
| |
with many vectors with only a single node in them.
Then it is more efficient to use a small_vector that keeps the 4 first entries within. Reduces # allocations and avoids indirection.
|
|\
| |
| | |
Minor code health.
|
| | |
|
| | |
|
|/ |
|
| |
|
| |
|
|
|
|
| |
- Do explicit sort when serializing.
|
| |
|
| |
|
| |
|
| |
|
|\
| |
| | |
Add noexcept and minor style changes
|
| | |
|
|/ |
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
|
|
|
|
| |
Stop using the config value (same as currrent default value, which is true).
Also: distribution config does not have this field, only stor-distribution config has
|
|\
| |
| | |
Simplify and add todo about removing disk_distribution in Vespa 9
|