Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Merge pull request #16729 from vespa-engine/balder/reconsider-buckets-when-safe | Henning Baldersheim | 2021-03-02 | 2 | -0/+2 |
|\ | | | | | Postpone buckets for reconsideration until it is safe. | ||||
| * | Postpone buckets for reconsideration until it is safe. | Henning Baldersheim | 2021-03-01 | 2 | -0/+2 |
| | | |||||
* | | Merge pull request #16723 from vespa-engine/arnej/use-small-vector-more-places | Arne H Juul | 2021-03-02 | 1 | -0/+2 |
|\ \ | |/ |/| | Arnej/use small vector more places | ||||
| * | add push_back aliases | Arne Juul | 2021-03-01 | 1 | -0/+2 |
| | | |||||
* | | Merge pull request #16725 from ↵ | Geir Storli | 2021-03-01 | 6 | -53/+180 |
|\ \ | |/ |/| | | | | | vespa-engine/geirst/avoid-memory-accumulation-in-array-attribute-vectors Avoid memory accumulation in array attribute vectors | ||||
| * | Take dead elements into account (and subtract them) when calculating how ↵ | Geir Storli | 2021-03-01 | 4 | -24/+61 |
| | | | | | | | | | | | | | | | | | | | | | | | | many arrays to allocate in a datastore buffer. This avoids a problem were allocated memory can accumulate over time in components using an ArrayStore. If all documents in an array attribute vector changes from one value class to another, all elements in the buffers of the previous value class are marked dead. Those buffers will eventually be compacted. Without this fix the wanted size of the resulting compacted buffer is calculated too high, and we allocate memory we are not going to use. If we move to yet another value class later, the same problem occurs again and more memory is allocated. | ||||
| * | Simplify how used elements across all active buffers are aggregated. | Geir Storli | 2021-03-01 | 5 | -42/+132 |
| | | | | | | | | | | This also prepares for aggregating dead elements and to take these into account when calculating how many arrays to alloc. | ||||
* | | add constructors from SmallVector | Arne Juul | 2021-03-01 | 1 | -0/+5 |
| | | |||||
* | | add back() methods | Arne Juul | 2021-03-01 | 2 | -0/+22 |
|/ | |||||
* | Merge pull request #16701 from vespa-engine/havardpe/small-vector-convenience | Arne H Juul | 2021-02-27 | 2 | -3/+137 |
|\ | | | | | added some extra convenience, mostly related to construction | ||||
| * | added some extra convenience, mostly related to construction | Håvard Pettersen | 2021-02-26 | 2 | -3/+137 |
| | | |||||
* | | Account for different memory usage with libc++. | Tor Egge | 2021-02-27 | 1 | -0/+5 |
| | | |||||
* | | Merge pull request #16690 from vespa-engine/geirst/refactor-datastore-classes | Geir Storli | 2021-02-26 | 14 | -148/+168 |
|\ \ | |/ |/| | Refactor datastore classes | ||||
| * | Rename 'active' buffer to 'primary' buffer in DataStoreBase. | Geir Storli | 2021-02-26 | 12 | -100/+104 |
| | | | | | | | | | | | | This should avoid confusion with the buffer state ACTIVE. Each buffer type has exactly one primary buffer that is used for allocations when no slots in free lists exist. A buffer type will typically use several buffers to store data, all of them being on state ACTIVE when in use. | ||||
| * | Adjust comments and code style. | Geir Storli | 2021-02-26 | 1 | -26/+31 |
| | | |||||
| * | Improve class and function descriptions. | Geir Storli | 2021-02-25 | 2 | -23/+34 |
| | | |||||
* | | Merge pull request #16678 from vespa-engine/havardpe/small-vector | Håvard Pettersen | 2021-02-26 | 7 | -0/+353 |
|\ \ | | | | | | | small vector | ||||
| * | | update after comments | Håvard Pettersen | 2021-02-26 | 2 | -2/+61 |
| | | | |||||
| * | | small vector | Håvard Pettersen | 2021-02-25 | 7 | -0/+294 |
| |/ | |||||
* | | Add methods to print memory usage. | Henning Baldersheim | 2021-02-25 | 3 | -4/+34 |
| | | |||||
* | | - Ensure that hashtable::clear does not touch capacity of hashtable. | Henning Baldersheim | 2021-02-25 | 3 | -3/+18 |
| | | | | | | | | - No need to deallocate/reallocate on clear. | ||||
* | | Add method the considers elemsize when computing number of elements that ↵ | Henning Baldersheim | 2021-02-25 | 2 | -0/+21 |
|/ | | | | will maximize 2^N bytes block | ||||
* | Include memory and typeinfo when needed. | Tor Egge | 2021-02-22 | 1 | -0/+1 |
| | |||||
* | string.h does not need alloc.h | Henning Baldersheim | 2021-02-21 | 4 | -1/+3 |
| | |||||
* | Mark potentially unused traits member as unused. | Tor Egge | 2021-02-21 | 2 | -2/+2 |
| | |||||
* | Eliminate array bounds warning. | Tor Egge | 2021-02-21 | 2 | -0/+8 |
| | |||||
* | Use constexpr for BTree traits. | Tor Egge | 2021-02-21 | 3 | -12/+12 |
| | |||||
* | Merge pull request #16604 from vespa-engine/toregge/remove-old-swap-files | Henning Baldersheim | 2021-02-20 | 1 | -0/+4 |
|\ | | | | | Remove old swap files when setting up mmap file allocator. | ||||
| * | Remove old swap files when setting up mmap file allocator. | Tor Egge | 2021-02-20 | 1 | -0/+4 |
| | | |||||
* | | Use madvise for file backed memory. | Tor Egge | 2021-02-20 | 1 | -0/+2 |
|/ | |||||
* | Merge pull request #16495 from vespa-engine/arnej/add-size-literals | Arne H Juul | 2021-02-16 | 37 | -76/+180 |
|\ | | | | | add literals for sizes in KB, MB, and GB | ||||
| * | add unit test for size literals | Arne Juul | 2021-02-15 | 3 | -0/+51 |
| | | |||||
| * | swap mismatched sizes | Arne Juul | 2021-02-15 | 1 | -2/+2 |
| | | | | | | | | | | | | * surely 1KalignedHeapAllocator should use 1024, and 4KalignedHeapAllocator should use 4096, instead of the other way around | ||||
| * | 2048 -> 2_Ki | Arne Juul | 2021-02-15 | 1 | -1/+1 |
| | | |||||
| * | revert changes inside strings | Arne Juul | 2021-02-15 | 1 | -1/+1 |
| | | |||||
| * | use size literals in vespalib | Arne Juul | 2021-02-15 | 33 | -76/+108 |
| | | |||||
| * | add literals for sizes in Ki, Mi, Gi, Ti | Arne Juul | 2021-02-15 | 1 | -0/+21 |
| | | |||||
* | | Rename get_memory_allocator to make_memory_allocator in mmap file allocator | Tor Egge | 2021-02-15 | 3 | -5/+5 |
| | | | | | | | | factory. Remove virtual keyword. | ||||
* | | Use mmap file allocator in dense tensor attribute if huge flag is | Tor Egge | 2021-02-15 | 7 | -0/+136 |
|/ | | | | set in config. | ||||
* | Add alloc_aligned member function. | Tor Egge | 2021-02-13 | 2 | -0/+7 |
| | |||||
* | Forward declare MemoryAllocator in vespalib/util/alloc.h. | Tor Egge | 2021-02-13 | 5 | -22/+46 |
| | |||||
* | Move MemoryAllocator to separate header file. | Tor Egge | 2021-02-13 | 5 | -35/+48 |
| | |||||
* | Merge pull request #16501 from vespa-engine/balder/less-assert-in-header-files | Henning Baldersheim | 2021-02-13 | 8 | -74/+94 |
|\ | | | | | Less asserts in header files. | ||||
| * | Less asserts in header files. | Henning Baldersheim | 2021-02-13 | 8 | -74/+94 |
| | | |||||
* | | Factor out MemoryAllocatorObserver. | Tor Egge | 2021-02-13 | 4 | -41/+94 |
|/ | |||||
* | Factor out function for rounding up to page size. | Tor Egge | 2021-02-11 | 5 | -20/+39 |
| | |||||
* | Use vespalib::hash_map instead of std::map. | Tor Egge | 2021-02-11 | 2 | -6/+8 |
| | | | | Simplify rounding function. | ||||
* | Add memory allocator backed by a file. | Tor Egge | 2021-02-10 | 4 | -0/+149 |
| | |||||
* | Add support for setting memory allocator for data store buffer type. | Tor Egge | 2021-02-10 | 6 | -0/+104 |
| | |||||
* | Log at level WARN | Harald Musum | 2021-02-08 | 1 | -3/+3 |
| |