Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Revert "Don't make changes to the hnsw index when the inserted tensor is ↵ | Geir Storli | 2022-06-13 | 1 | -30/+0 |
| | | | | unchanged" | ||||
* | Merge pull request #23051 from ↵ | Geir Storli | 2022-06-13 | 1 | -0/+30 |
|\ | | | | | | | | | vespa-engine/geirst/dont-update-hnsw-with-unchanged-tensors Don't make changes to the hnsw index when the inserted tensor is unchanged | ||||
| * | Don't make changes to the nearest neighbor index (hnsw) when the inserted ↵ | Geir Storli | 2022-06-10 | 1 | -0/+30 |
| | | | | | | | | | | | | tensor is unchanged. With this optimization we avoid doing unnecessary costly work, first removing the vector point, then inserting the same point. | ||||
* | | fix undefined behavior in unit tests | Håvard Pettersen | 2022-06-09 | 1 | -1/+1 |
|/ | |||||
* | Remove most use of vespalib::rmdir in searchlib. | Tor Egge | 2022-06-02 | 1 | -6/+6 |
| | |||||
* | Include searchcommon/attribut/config.h yourself and prepare for hiding large ↵ | Henning Baldersheim | 2022-05-25 | 1 | -6/+7 |
| | | | | | | implementation. Add setters to vespalib::GrowStrategy. | ||||
* | Auto-adjust targetHits for approximate nearest neighbor search when using ↵ | Geir Storli | 2022-05-10 | 1 | -11/+20 |
| | | | | | | | | post-filtering. The goal is to expose 'targetHits' hits to first-phase ranking. Before searching the HNSW index, targetHits is adjusted based on the estimated hit ratio of the query to compensate for the hits that will be removed in post-filtering. | ||||
* | Improve and extend visit trace for nearest neighbor blueprint. | Geir Storli | 2022-04-22 | 1 | -5/+0 |
| | |||||
* | Simplify calculation of global filter and fallback to brute force when using ↵ | Geir Storli | 2022-04-11 | 1 | -2/+13 |
| | | | | | | | | nearest neighbor search. With this change only two parameters are used to adjust the algorithm: - vespa.matching.global_filter.lower_limit - vespa.matching.global_filter.upper_limit | ||||
* | - assert result of Close() in destructor of FastOS_File and FastOS_BufferedFile. | Henning Baldersheim | 2022-01-26 | 1 | -1/+0 |
| | | | | | | | - Check result of Close() - Check result of Sync() - Scope FastOS_File to avoid explicit Close(). - NULL -> nullptr | ||||
* | Calculate need for compaction when updating stats. | Tor Egge | 2021-12-09 | 1 | -1/+2 |
| | |||||
* | Move CompactionStrategy from searchcommon to vespalib. | Tor Egge | 2021-12-08 | 1 | -1/+1 |
| | |||||
* | Update 2017 copyright notices. | gjoranv | 2021-10-07 | 2 | -2/+2 |
| | |||||
* | Change loading of nearest neighbor index to use direct I/O instead of mmapping. | Geir Storli | 2021-09-15 | 1 | -8/+6 |
| | | | | This should reduce memory spike during loading. | ||||
* | Reduce memory spike during loading of hnsw index by committing at regular ↵ | Geir Storli | 2021-09-10 | 1 | -4/+22 |
| | | | | | | | intervals. This ensures that memory buffers on hold lists are trimmed while loading, keeping the excess memory usage at a minimum. | ||||
* | The global filter is only needed when having a nearest neighbor index (hnsw) ↵ | Geir Storli | 2021-08-30 | 1 | -17/+44 |
| | | | | | | and doing approximate calculation. This avoids costly calculation of the global filter in cases it is not needed. | ||||
* | Report address space usage for shared string repo for non-dense tensor ↵ | Geir Storli | 2021-08-23 | 1 | -2/+8 |
| | | | | attributes. | ||||
* | Report address space usage for components in tensor attributes. | Geir Storli | 2021-08-20 | 1 | -0/+23 |
| | |||||
* | Compact HNSW index when ratio of dead bytes / address space is too high | Tor Egge | 2021-08-18 | 1 | -0/+8 |
| | | | | relative to used bytes / address space. | ||||
* | Use the executor for the part that can be parallell when rebuilding index on ↵ | Henning Baldersheim | 2021-08-13 | 1 | -0/+33 |
| | | | | load. | ||||
* | swappable -> paged | Henning Baldersheim | 2021-08-12 | 1 | -2/+2 |
| | |||||
* | A swappable attribute will use a file backed memory allocator. | Henning Baldersheim | 2021-08-12 | 1 | -0/+23 |
| | |||||
* | Reenable tensor attribute compaction test. | Tor Egge | 2021-06-01 | 1 | -8/+10 |
| | |||||
* | let the distance function decide how it wants the query tensor converted | Arne Juul | 2021-04-12 | 1 | -1/+1 |
| | |||||
* | fix NNS distance for new cell types | Arne Juul | 2021-04-12 | 1 | -1/+1 |
| | | | | This reverts commit f167fe4362c5e4e20a7605b99205cfbee77c569a. | ||||
* | Revert "fix NNS distance for new cell types" | Arnstein Ressem | 2021-04-12 | 1 | -1/+1 |
| | |||||
* | fix NNS distance for new cell types | Arne Juul | 2021-04-09 | 1 | -1/+1 |
| | |||||
* | Remove experimental use of mmap file allocator for dense tensor data. | Geir Storli | 2021-03-26 | 1 | -23/+0 |
| | |||||
* | Use mmap file allocator in dense tensor attribute if huge flag is | Tor Egge | 2021-02-15 | 1 | -0/+23 |
| | | | | set in config. | ||||
* | Fix onhold accounting for SerializedFastValueAttribute. | Tor Egge | 2021-02-05 | 1 | -0/+15 |
| | |||||
* | add distanceThreshold option for nearestNeighbor operator | Arne Juul | 2021-01-08 | 1 | -4/+16 |
| | |||||
* | use string ids as tensor labels | Håvard Pettersen | 2021-01-05 | 1 | -1/+1 |
| | |||||
* | use SimpleValue instead of EngineOrFactory | Arne Juul | 2020-12-02 | 1 | -4/+5 |
| | |||||
* | test SerializedFastValueAttribute instead | Arne Juul | 2020-11-27 | 1 | -3/+3 |
| | |||||
* | track CellType move | Arne Juul | 2020-11-20 | 1 | -2/+3 |
| | |||||
* | simplify | Arne Juul | 2020-10-15 | 1 | -4/+2 |
| | |||||
* | handle both engine- and factory-based tensors | Arne Juul | 2020-10-15 | 1 | -38/+16 |
| | | | | | | * use EngineOrFactory::get() instead of DefaultTensorEngine::ref() * avoid direct use of DenseTensorView etc where possible * use eval::Value instead of tensor::Tensor where possible | ||||
* | track TypedCells move | Arne Juul | 2020-10-01 | 1 | -3/+3 |
| | |||||
* | Rename GenericTensorAttribute -> SerializedTensorAttribute. | Geir Storli | 2020-09-04 | 1 | -3/+3 |
| | |||||
* | Enable free lists for DirectTensorStore. | Geir Storli | 2020-09-02 | 1 | -1/+3 |
| | |||||
* | add DirectTensorAttribute implementation | Arne Juul | 2020-09-01 | 1 | -15/+56 |
| | |||||
* | Check brute force limit in nearest neighbor blueprint. | Tor Egge | 2020-06-23 | 1 | -2/+14 |
| | |||||
* | Wire in nearest neighbor brute force limit. | Tor Egge | 2020-06-19 | 1 | -1/+1 |
| | |||||
* | Add support for updating a nearest neighbor index in two phases. | Geir Storli | 2020-06-18 | 1 | -13/+74 |
| | |||||
* | remove stub implementations in NearestNeighborIndex | Arne Juul | 2020-06-11 | 1 | -0/+9 |
| | | | | | * make API pure virtual * implement something that will work in mock | ||||
* | no fallback to brute force for now | Arne Juul | 2020-06-08 | 1 | -2/+2 |
| | |||||
* | Merge pull request #13234 from ↵ | Arne H Juul | 2020-05-14 | 1 | -1/+80 |
|\ | | | | | | | | | vespa-engine/arnej/use-global-filter-in-nn-blueprint Arnej/use global filter in nn blueprint | ||||
| * | refactor tests | Arne Juul | 2020-05-14 | 1 | -72/+79 |
| | | |||||
| * | unit test blueprint's handling of global filter | Arne Juul | 2020-05-13 | 1 | -0/+72 |
| | | |||||
* | | Merge pull request #13229 from ↵ | Geir Storli | 2020-05-13 | 1 | -0/+1 |
|\ \ | |/ |/| | | | | | vespa-engine/geirst/distance-metric-when-not-having-hnsw-index Support specifying a distance metric for nearest neighbor search when… |