summaryrefslogtreecommitdiffstats
path: root/eval/src/apps
Commit message (Collapse)AuthorAgeFilesLines
* Better namingHenning Baldersheim2023-09-041-9/+9
|
* Probe with optimize as in production.Henning Baldersheim2023-09-041-5/+3
|
* Report memory usage back when probing types.Henning Baldersheim2023-09-041-13/+48
|
* experiment with simple instruction-level profilingHåvard Pettersen2022-09-011-12/+30
|
* use stdout for 'error' resultHåvard Pettersen2022-03-071-2/+2
|
* better error messagesHåvard Pettersen2022-02-151-7/+55
| | | | | | | | | | | | | added support for capturing stderr when you expect stuff to fail in order to capture all error messages from the child process. simplify ServerCmd to always be verbose (print stdin/stdout(stderr) interactions). improve ServerCmd to enable explicitly checking the child process exit code. fixed test dependency on binary for eval expr and analyze model tests.
* enable probing output typesHåvard Pettersen2022-02-112-2/+45
| | | | also added some testing
* run onnx model to detect unknown output sizesHåvard Pettersen2022-02-091-0/+1
|
* Update Verizon Media copyright notices.gjoranv2021-10-072-2/+2
|
* Update 2017 copyright notices.gjoranv2021-10-078-8/+8
|
* remove hamming test where Java eval result was ignoredHåvard Pettersen2021-09-221-4/+6
| | | | | | | Java tensor conformance evaluation failures will break global invariants by dropping tests in the output. We need to isolate test evaluation better before we are able to ignore expressions that will not even parse.
* added new 'hamming' functionHåvard Pettersen2021-09-223-5/+26
|
* Revert "added new 'hamming' function"Harald Musum2021-09-223-26/+5
|
* added new 'hamming' functionHåvard Pettersen2021-09-223-5/+26
|
* added 'undef' command for completenessHåvard Pettersen2021-09-071-13/+36
|
* added help and list commands to interactive modeHåvard Pettersen2021-09-021-0/+23
|
* use common history eventHåvard Pettersen2021-09-021-6/+4
|
* use editlineHåvard Pettersen2021-09-022-9/+52
|
* minor fixes after reviewHåvard Pettersen2021-08-311-4/+5
|
* add json-repl (and interactive) modes to vespa-eval-exprHåvard Pettersen2021-08-301-52/+248
|
* improve vespa-eval-exprHåvard Pettersen2021-08-231-18/+119
| | | | | | Allow multiple expressions to be evaluated. Later expressions may use results from earlier expressions. Also add option to print information about low-level optimizations (how the expressions will be executed).
* dry run onnx models on setupHåvard Pettersen2021-06-231-1/+10
|
* enable conformance testing of bit extractionHåvard Pettersen2021-06-211-6/+4
|
* add 'bit(a,b)' math functionHåvard Pettersen2021-06-181-0/+30
|
* estimate time and space needed for onnx model evaluationHåvard Pettersen2021-06-141-3/+152
|
* added very simple onnx model analyzerHåvard Pettersen2021-06-103-0/+68
| | | | just estimating memory needed to load the model for now
* un-ignore no longer failing testsHåvard Pettersen2021-05-031-9/+9
|
* ignore some conformance tests for JavaHåvard Pettersen2021-04-303-14/+38
| | | | | peek out-of-bounds nan vs non-existing cells in merge/join
* allow ignoring test failuresHåvard Pettersen2021-04-291-8/+17
| | | | | + avoid calculating expected result twice + added fail_cnt in test summary
* add more conformance testingHåvard Pettersen2021-04-291-2/+28
|
* stay within defined values for int8Håvard Pettersen2021-04-271-1/+1
|
* also test with 0Håvard Pettersen2021-04-261-1/+1
| | | | and make numbers a bit 'harder'
* add more testing of erf functionHåvard Pettersen2021-04-231-0/+9
|
* more conformance testingHåvard Pettersen2021-04-231-0/+56
|
* print diff of mismatching tensorsHåvard Pettersen2021-04-202-51/+64
| | | | also stop using vespalib testkit
* remove deprecated tensor modelHåvard Pettersen2021-04-161-1/+0
| | | | fix and extend tests to also verify unstable cell types
* Merge pull request #17452 from ↵Håvard Pettersen2021-04-162-111/+243
|\ | | | | | | | | vespa-engine/havardpe/extend-tensor-conformance-test Havardpe/extend tensor conformance test
| * extend tensor conformance testHåvard Pettersen2021-04-152-111/+243
| |
* | Avoid copying map elements when iterating over map.Tor Egge2021-04-141-1/+1
|/
* use GenSpec to generate more tests for map/reduce/joinHåvard Pettersen2021-04-143-79/+114
| | | | | | - limit the number of cases run in unit test - make pow tests use very limited input values to avoid rounding issues.
* add pending stuff (erf/median)Håvard Pettersen2021-04-141-4/+2
|
* always use reference eval as expected resultHåvard Pettersen2021-04-143-120/+72
|
* remove compare modeHåvard Pettersen2021-04-141-95/+0
|
* Fix C++ serialization test for new cell typesLester Solbakken2021-04-081-10/+21
|
* Add bfloat16 and int8 tensor cell types in JavaLester Solbakken2021-04-081-1/+21
|
* cell meta with both compile-time and run-time resolvingHåvard Pettersen2021-03-091-6/+6
| | | | wired into generic join and reduce as examples of usage
* all scalars must be doubleHåvard Pettersen2021-03-041-1/+1
| | | | and all operation results must be at least float
* use size literals in evalArne Juul2021-02-151-9/+10
|
* added 'display' mode to tensor conformance binaryHåvard Pettersen2021-02-041-0/+35
|
* use GenSpec in tensor_model.cppHåvard Pettersen2021-02-041-1/+1
|