Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Improve buffer allocation strategy in data store by matching underlying ↵ | Geir Storli | 2018-01-26 | 2 | -23/+36 |
| | | | | | | | | allocators. This should reduce the amount of memory wasted in allocations. 1) heap allocation: buffer size is power of 2 to match vespamalloc. 2) mmap allocation: buffer size is multiple of huge page size (2MB) to match mmap allocator. | ||||
* | Add more conservative buffer allocation strategy in datastore buffers. | Geir Storli | 2018-01-19 | 6 | -25/+169 |
| | | | | | | | | | | | This should greatly reduce the memory footprint of multi-value attribute vectors which uses an array store for underlying values. The size of a new buffer is calculated as (simplified): *) before: (size of previous buffer) * 2 *) now: (size of all previous buffers) * allocation grow factor (default = 0.2) In addition we now support resizing of all buffers, not only the first one. | ||||
* | Rewrite to new syntax for test function setup. | Geir Storli | 2018-01-16 | 1 | -74/+23 |
| | |||||
* | Use FreeListAllocator in free list unit test and remove unused function. | Geir Storli | 2018-01-16 | 1 | -20/+32 |
| | |||||
* | Update copyright headers | Jon Bratseth | 2017-06-14 | 8 | -8/+8 |
| | |||||
* | Revert "Update copyright headers" | Jon Bratseth | 2017-06-14 | 8 | -8/+8 |
| | |||||
* | Update copyright headers | Jon Bratseth | 2017-06-14 | 8 | -8/+8 |
| | |||||
* | Revert "Copyright header" | Jon Bratseth | 2017-06-13 | 8 | -8/+8 |
| | |||||
* | Copyright header | Jon Bratseth | 2017-06-13 | 8 | -8/+8 |
| | |||||
* | Checkpount for removing fastos from tests | Henning Baldersheim | 2017-06-01 | 1 | -1/+0 |
| | |||||
* | C++ style fix: Use foo() instead of foo(void) | Tor Egge | 2017-05-24 | 1 | -3/+3 |
| | |||||
* | Revert "Revert "Fix warnings hidden earlier due to including application ↵ | Henning Baldersheim | 2017-05-03 | 2 | -12/+8 |
| | | | | headers as s…"" | ||||
* | Revert "Fix warnings hidden earlier due to including application headers as ↵ | Henning Baldersheim | 2017-05-03 | 2 | -8/+12 |
| | | | | s…" | ||||
* | Fix warnings hidden earlier due to including application headers as system ↵ | Henning Baldersheim | 2017-05-03 | 2 | -12/+8 |
| | | | | includes | ||||
* | add override in searchlib module | Arne H Juul | 2017-04-12 | 1 | -2/+2 |
| | |||||
* | Use a public interface for testing. | Henning Baldersheim | 2017-03-04 | 1 | -19/+16 |
| | |||||
* | Prepare for faster lid mapping: | Tor Egge | 2017-02-07 | 1 | -1/+17 |
| | | | | | - Adjust add method in unique store. - Wrap gid and (currently unused) lid in nested Reference class. | ||||
* | Style fixes and adjusted comments. | Tor Egge | 2017-02-03 | 1 | -4/+2 |
| | | | | | More test cases for reference attribute test. Remove unneeded onAddDoc() method. | ||||
* | Add reference attribute. | Tor Egge | 2017-02-02 | 1 | -0/+46 |
| | |||||
* | Move MemStats struct to searchlib test library. Add class comment. | Tor Egge | 2017-01-30 | 2 | -50/+5 |
| | | | | | | | Stop wrapping EntryType in WrappedEntry. Change Compare to reference value. Add class comment. Remove WrappedCompare. Add freeze() method. | ||||
* | Add unique store, a data store containing refcounted unique values. | Tor Egge | 2017-01-27 | 3 | -0/+239 |
| | |||||
* | Tune compaction, i.e. specify whether to compact on memory, compact on | Tor Egge | 2016-11-29 | 1 | -3/+82 |
| | | | | address space, or compact on both. | ||||
* | Merge pull request #1196 from yahoo/geirst/simplify-allocation-in-data-stores | Tor Egge | 2016-11-29 | 1 | -2/+2 |
|\ | | | | | Geirst/simplify allocation in data stores | ||||
| * | Replace alloc functions in DataStoreT with access to allocators. | Geir Storli | 2016-11-28 | 1 | -2/+2 |
| | | |||||
* | | Add comments. | Tor Egge | 2016-11-28 | 1 | -0/+7 |
| | | |||||
* | | Use active buffer capacity when calculating address space usage limit. | Tor Egge | 2016-11-28 | 1 | -2/+3 |
| | | |||||
* | | Report address space usage for multivalue mapping as number of used/dead | Tor Egge | 2016-11-26 | 1 | -4/+7 |
|/ | | | | clusters, with a 4Gi limit. | ||||
* | Use config for setting up array store instances with optimization for huge ↵ | Geir Storli | 2016-11-24 | 1 | -1/+1 |
| | | | | page size. | ||||
* | Add class for configuring an array store. | Geir Storli | 2016-11-24 | 3 | -0/+82 |
| | |||||
* | Reduce number of buffers in array store from 32k to 8k. | Tor Egge | 2016-11-23 | 1 | -1/+1 |
| | |||||
* | Test data store buffer growth with minSize being 0. | Tor Egge | 2016-11-23 | 1 | -14/+62 |
| | | | | | Test initial resizing of first buffer for type. Test initial memory usage for data store. | ||||
* | Change extra growth when swithing buffer from minClusters to | Tor Egge | 2016-11-23 | 1 | -3/+6 |
| | | | | | max(minClusters, numClustersForNewBuffer) except when switching to the initial buffer. This reduces memory waste when allocating buffers. | ||||
* | Add unit test for data store buffer growth. | Tor Egge | 2016-11-22 | 1 | -3/+58 |
| | |||||
* | Allow usage of all buffers when reporting address space usage. | Geir Storli | 2016-11-21 | 1 | -1/+1 |
| | |||||
* | Expose address space usage in array store and multi-value mapping. | Geir Storli | 2016-11-21 | 1 | -0/+9 |
| | |||||
* | Track memory usage in underlying buffers in ArrayStore. | Geir Storli | 2016-11-18 | 1 | -4/+53 |
| | |||||
* | Make member variables in BufferState private and add public functions where ↵ | Geir Storli | 2016-11-18 | 1 | -3/+3 |
| | | | | needed. | ||||
* | No need to inc generation after trimming of hold lists. | Geir Storli | 2016-11-16 | 1 | -1/+1 |
| | |||||
* | Add support for compacting the worst buffer in an array store. | Geir Storli | 2016-11-16 | 1 | -14/+94 |
| | |||||
* | Test that new underlying buffer is allocated when current is full. | Geir Storli | 2016-11-15 | 1 | -6/+42 |
| | |||||
* | Add remove() function to array store. | Geir Storli | 2016-11-11 | 1 | -0/+24 |
| | |||||
* | Implement basic array store with support for add() and get(). | Geir Storli | 2016-11-10 | 3 | -0/+78 |
| | |||||
* | Move datastore unit tests into separate folder. | Geir Storli | 2016-11-04 | 3 | -0/+441 |
| | |||||
* | Move docstore unit tests into common top-level folder. | Geir Storli | 2016-11-04 | 17 | -895/+0 |
| | |||||
* | Removed TestApp::GetSourceDirectory | Arnstein Ressem | 2016-11-02 | 1 | -2/+2 |
| | |||||
* | Remove the XXXFactory indirection. Just use static method on Alloc. | Henning Baldersheim | 2016-10-16 | 1 | -2/+1 |
| | |||||
* | Adjust results of sizeof() | Henning Baldersheim | 2016-10-03 | 1 | -16/+16 |
| | |||||
* | Handle variations to alignment smoother. | Henning Baldersheim | 2016-10-03 | 1 | -1/+1 |
| | |||||
* | make tests pass too | Henning Baldersheim | 2016-10-03 | 1 | -1/+3 |
| | |||||
* | Increase allowed deviation from 10 to 20. | Henning Baldersheim | 2016-09-16 | 1 | -2/+2 |
| |