summaryrefslogtreecommitdiffstats
path: root/searchlib/src/tests/attribute/tensorattribute
Commit message (Collapse)AuthorAgeFilesLines
* Revert "Don't make changes to the hnsw index when the inserted tensor is ↵Geir Storli2022-06-131-30/+0
| | | | unchanged"
* Merge pull request #23051 from ↵Geir Storli2022-06-131-0/+30
|\ | | | | | | | | vespa-engine/geirst/dont-update-hnsw-with-unchanged-tensors Don't make changes to the hnsw index when the inserted tensor is unchanged
| * Don't make changes to the nearest neighbor index (hnsw) when the inserted ↵Geir Storli2022-06-101-0/+30
| | | | | | | | | | | | tensor is unchanged. With this optimization we avoid doing unnecessary costly work, first removing the vector point, then inserting the same point.
* | fix undefined behavior in unit testsHåvard Pettersen2022-06-091-1/+1
|/
* Remove most use of vespalib::rmdir in searchlib.Tor Egge2022-06-021-6/+6
|
* Include searchcommon/attribut/config.h yourself and prepare for hiding large ↵Henning Baldersheim2022-05-251-6/+7
| | | | | | implementation. Add setters to vespalib::GrowStrategy.
* Auto-adjust targetHits for approximate nearest neighbor search when using ↵Geir Storli2022-05-101-11/+20
| | | | | | | | post-filtering. The goal is to expose 'targetHits' hits to first-phase ranking. Before searching the HNSW index, targetHits is adjusted based on the estimated hit ratio of the query to compensate for the hits that will be removed in post-filtering.
* Improve and extend visit trace for nearest neighbor blueprint.Geir Storli2022-04-221-5/+0
|
* Simplify calculation of global filter and fallback to brute force when using ↵Geir Storli2022-04-111-2/+13
| | | | | | | | nearest neighbor search. With this change only two parameters are used to adjust the algorithm: - vespa.matching.global_filter.lower_limit - vespa.matching.global_filter.upper_limit
* - assert result of Close() in destructor of FastOS_File and FastOS_BufferedFile.Henning Baldersheim2022-01-261-1/+0
| | | | | | | - Check result of Close() - Check result of Sync() - Scope FastOS_File to avoid explicit Close(). - NULL -> nullptr
* Calculate need for compaction when updating stats.Tor Egge2021-12-091-1/+2
|
* Move CompactionStrategy from searchcommon to vespalib.Tor Egge2021-12-081-1/+1
|
* Update 2017 copyright notices.gjoranv2021-10-072-2/+2
|
* Change loading of nearest neighbor index to use direct I/O instead of mmapping.Geir Storli2021-09-151-8/+6
| | | | This should reduce memory spike during loading.
* Reduce memory spike during loading of hnsw index by committing at regular ↵Geir Storli2021-09-101-4/+22
| | | | | | | intervals. This ensures that memory buffers on hold lists are trimmed while loading, keeping the excess memory usage at a minimum.
* The global filter is only needed when having a nearest neighbor index (hnsw) ↵Geir Storli2021-08-301-17/+44
| | | | | | and doing approximate calculation. This avoids costly calculation of the global filter in cases it is not needed.
* Report address space usage for shared string repo for non-dense tensor ↵Geir Storli2021-08-231-2/+8
| | | | attributes.
* Report address space usage for components in tensor attributes.Geir Storli2021-08-201-0/+23
|
* Compact HNSW index when ratio of dead bytes / address space is too highTor Egge2021-08-181-0/+8
| | | | relative to used bytes / address space.
* Use the executor for the part that can be parallell when rebuilding index on ↵Henning Baldersheim2021-08-131-0/+33
| | | | load.
* swappable -> pagedHenning Baldersheim2021-08-121-2/+2
|
* A swappable attribute will use a file backed memory allocator.Henning Baldersheim2021-08-121-0/+23
|
* Reenable tensor attribute compaction test.Tor Egge2021-06-011-8/+10
|
* let the distance function decide how it wants the query tensor convertedArne Juul2021-04-121-1/+1
|
* fix NNS distance for new cell typesArne Juul2021-04-121-1/+1
| | | | This reverts commit f167fe4362c5e4e20a7605b99205cfbee77c569a.
* Revert "fix NNS distance for new cell types"Arnstein Ressem2021-04-121-1/+1
|
* fix NNS distance for new cell typesArne Juul2021-04-091-1/+1
|
* Remove experimental use of mmap file allocator for dense tensor data.Geir Storli2021-03-261-23/+0
|
* Use mmap file allocator in dense tensor attribute if huge flag isTor Egge2021-02-151-0/+23
| | | | set in config.
* Fix onhold accounting for SerializedFastValueAttribute.Tor Egge2021-02-051-0/+15
|
* add distanceThreshold option for nearestNeighbor operatorArne Juul2021-01-081-4/+16
|
* use string ids as tensor labelsHåvard Pettersen2021-01-051-1/+1
|
* use SimpleValue instead of EngineOrFactoryArne Juul2020-12-021-4/+5
|
* test SerializedFastValueAttribute insteadArne Juul2020-11-271-3/+3
|
* track CellType moveArne Juul2020-11-201-2/+3
|
* simplifyArne Juul2020-10-151-4/+2
|
* handle both engine- and factory-based tensorsArne Juul2020-10-151-38/+16
| | | | | | * use EngineOrFactory::get() instead of DefaultTensorEngine::ref() * avoid direct use of DenseTensorView etc where possible * use eval::Value instead of tensor::Tensor where possible
* track TypedCells moveArne Juul2020-10-011-3/+3
|
* Rename GenericTensorAttribute -> SerializedTensorAttribute.Geir Storli2020-09-041-3/+3
|
* Enable free lists for DirectTensorStore.Geir Storli2020-09-021-1/+3
|
* add DirectTensorAttribute implementationArne Juul2020-09-011-15/+56
|
* Check brute force limit in nearest neighbor blueprint.Tor Egge2020-06-231-2/+14
|
* Wire in nearest neighbor brute force limit.Tor Egge2020-06-191-1/+1
|
* Add support for updating a nearest neighbor index in two phases.Geir Storli2020-06-181-13/+74
|
* remove stub implementations in NearestNeighborIndexArne Juul2020-06-111-0/+9
| | | | | * make API pure virtual * implement something that will work in mock
* no fallback to brute force for nowArne Juul2020-06-081-2/+2
|
* Merge pull request #13234 from ↵Arne H Juul2020-05-141-1/+80
|\ | | | | | | | | vespa-engine/arnej/use-global-filter-in-nn-blueprint Arnej/use global filter in nn blueprint
| * refactor testsArne Juul2020-05-141-72/+79
| |
| * unit test blueprint's handling of global filterArne Juul2020-05-131-0/+72
| |
* | Merge pull request #13229 from ↵Geir Storli2020-05-131-0/+1
|\ \ | |/ |/| | | | | vespa-engine/geirst/distance-metric-when-not-having-hnsw-index Support specifying a distance metric for nearest neighbor search when…