summaryrefslogtreecommitdiffstats
path: root/filedistribution
Commit message (Collapse)AuthorAgeFilesLines
* * apply new common bootstrapArne Juul2022-10-241-3/+4
| | | | | * remove now-duplicated code * prefer using ${VESPA_HOME} environment variable
* Revert "Refactor cleanup of file references"Harald Musum2022-10-111-107/+0
|
* Use try-with-resources when getting file references in pathHarald Musum2022-10-101-16/+17
|
* Use a Stream to read files, might go OOM otherwiseHarald Musum2022-10-101-28/+25
| | | | | Slight rewrite to be able to use a stream for deleting unused file references, but still keep some of them (the last accessed ones)
* Move code for deleting unused file referencesHarald Musum2022-10-071-0/+109
| | | | | No functional changes, will be used by config proxy code as well in the future
* Add method to use Duration as timeout to make unit explicit, and avoid many ↵Henning Baldersheim2022-08-123-4/+6
| | | | magic conversions.
* Merge pull request #23391 from ↵Henning Baldersheim2022-07-071-0/+5
|\ | | | | | | | | vespa-engine/hmusum/add-forceDownload-option-to-file-downloader Temporarily add env variable for forcing download of file references
| * Temporarily add env varioable for forcing download of file referencesHarald Musum2022-07-061-0/+5
| | | | | | | | | | | | This can be used for testing file distributuion on one node. E.g. config proxy takes no config or feature flag, so need to use an environment variable.
* | Revert "Revert "Make sure to set compression type in file distribution meta ↵Harald Musum2022-07-067-11/+19
| | | | | | | | request""
* | Revert "Make sure to set compression type in file distribution meta request ↵Harald Musum2022-07-067-19/+11
| | | | | | | | [run-systemtest]"
* | Make sure to set compression type in file distribution meta requestHarald Musum2022-07-067-11/+19
|/
* Wire in use of compression types and flags for file distributionHarald Musum2022-07-064-16/+54
| | | | | VESPA_FILE_DISTRIBUTION_ACCEPTED_COMPRESSION_TYPES is not set anywhere yet, will be set through host-admin
* Support specifying compression type for file distribution requestsHarald Musum2022-07-055-19/+63
| | | | | | Add accepted compression types in file distribution requests. Older clients (e.g. Vespa 7.x) will not have that in requests, so fallback to gzip in that case.
* Make sure to return response when request times outHarald Musum2022-06-221-2/+3
| | | | | Return with new error code 2. Clients only check for error code 0, so a new error code is handled implicitly also by old clients
* Set project version to 8-SNAPSHOTgjoranv2022-06-081-2/+2
|
* Revoke com.yahoo.config.subscription as public APIHarald Musum2022-06-081-1/+0
| | | | Also remove some deprecated methods in ConfigGetter
* Revert "Support compressing files (not just directories) in file ↵Harald Musum2022-05-254-60/+23
| | | | distribution [run-systemtest]"
* Support compressing files (not just directories) in file distributionHarald Musum2022-05-254-23/+60
| | | | | Use file distribution compression feature flags and support compressing single files
* Remove unintended checkinHarald Musum2022-05-241-120/+0
|
* Prepare for different compression algorithms for distributed filesHarald Musum2022-05-245-21/+171
|
* Make sure to delete directory for decompressed files if something failsHarald Musum2022-05-222-23/+19
| | | | Some other cosmetic fixes
* install_jar CMake functionHåkon Hallingstad2022-05-201-1/+1
|
* Do not create dependency-reduced-pom.xmlgjoranv2022-04-081-0/+1
| | | | | | - From maven-shade-plugin 3.3.0 (needed for JDK 17), the DRP is installed and used instead of the ordinary pom.xml, causing transitive dependencies to disappear for dependent modules.
* Improve maven-shade-plugin filter, and move to parent pom.gjoranv2022-02-031-11/+0
| | | | - Removes 223 build warnings (out of 562 for building non-test code)
* Revert "Exclude META-INF files and module-info.class from uber jars."Harald Musum2022-02-021-2/+4
|
* Exclude META-INF files and module-info.class from uber jars.gjoranv2022-02-021-4/+2
| | | | - Generate countless warnings for duplicates and breaking encapsulation.
* Add SuppressWarnings for removal of config.subscription types.gjoranv2022-02-021-0/+1
|
* Use lower timeoutHarald Musum2022-01-121-5/+0
| | | | | | | If we get a request for a file reference we don't have, try to download with 10 second timeout and reply with not found otherwise, otherwise a thread might be busy for a long time and we might end up with all threads being busy and no requests can be served
* unify java warningsArne H Juul2022-01-061-7/+0
| | | | | * these were stricter than in parent, but to simplify we can just use compiler args from parent
* Reduce increase in rpc timeout for each retryHarald Musum2021-12-161-7/+6
|
* Don't try to download after timeoutHarald Musum2021-12-131-1/+3
|
* Simplify and reorder arguments, no functional changesHarald Musum2021-12-132-9/+5
|
* Make sure sleep time never exceeds 120 secondsHarald Musum2021-12-121-1/+2
|
* Add exponential backoff if starting download failsHarald Musum2021-12-121-2/+12
|
* Make sure to always delete temp file/dirHarald Musum2021-12-101-6/+5
|
* Make sure to cleanup when failing to read file reference dataHarald Musum2021-12-061-1/+1
|
* Merge pull request #20258 from vespa-engine/hmusum/move-logging-to-callersHåkon Hallingstad2021-11-292-8/+1
|\ | | | | Move logging in getFile() to callers
| * M0;95;0cove logging in getFile() to callersHarald Musum2021-11-282-8/+1
| |
* | Add some more logging for file distribution connectsHarald Musum2021-11-281-3/+5
|/ | | | | Sometimes seeing some request fail after a very short time with connection error, not sure what causes it, trying to debug
* Always add client string when getting filesHarald Musum2021-11-263-12/+20
|
* Reduce timeout when downloading filesHarald Musum2021-11-261-2/+2
| | | | | Reduce from 3 minutes to 30 seconds. Download will be retried on next run anyway.
* Minor changes to loggingHarald Musum2021-11-261-4/+4
|
* Reduce sleep time between retriesHarald Musum2021-11-261-1/+1
| | | | We now use a new source for each retry, so reduce sleep time between retries
* Simplify getting connection to use for file downloadHarald Musum2021-11-172-8/+9
|
* Add FileDistributionConnectionPoolHarald Musum2021-11-161-0/+43
| | | | | | | FileDistributionConnectionPool is better suited for connections getting files, since each file migh be available on different connections and switching connection for all file downloads if one fails does not make sense, instead one should switch per file download if necessary.
* Refactor, no funtional changesHarald Musum2021-11-151-12/+20
|
* Use correct variable in log messageHarald Musum2021-11-151-2/+2
|
* Improve file download logging a bitHarald Musum2021-11-151-1/+1
|
* Lower log level for a couple of messagesHarald Musum2021-11-121-2/+2
|
* Depend on http-utilsHarald Musum2021-10-221-0/+6
|