summaryrefslogtreecommitdiffstats
path: root/filedistribution
Commit message (Collapse)AuthorAgeFilesLines
* Change log level and message when getting file not requestedHarald Musum2018-01-031-1/+1
|
* Delete temp file if move fails because file already existsHarald Musum2018-01-011-1/+4
|
* Delete inprogress file if write is not successfulHarald Musum2017-12-291-1/+2
| | | | | Write appends, so if it fails we should clean up, else we will use more and more disk space
* Minor cleanupHarald Musum2017-12-204-11/+6
|
* Do async file distribution (when preparing application) when file ↵Harald Musum2017-12-142-4/+3
| | | | | | distributor disable Also: Don't cancel future when getting dile references started by async file distribution
* Update download status after each part receivedHarald Musum2017-12-134-22/+34
|
* Notify config proxy about starting downloads while preparingHarald Musum2017-12-133-13/+16
| | | | Code not activated yet
* Merge pull request #4415 from ↵Tor Brede Vekterli2017-12-121-1/+1
|\ | | | | | | | | vespa-engine/toregge/factor-out-vespalib-countdownlatch-and-gate-to-separate-header-files Factor out CountDownLatch and Gate to separate header files.
| * Factor out CountDownLatch and Gate to separate header files.Tor Egge2017-12-111-1/+1
| |
* | Make sure to use a tmp directory on same partition as download directoryHarald Musum2017-12-125-19/+44
|/
* Can not use referencedir as storage for temporary files.Henning Baldersheim2017-12-111-1/+1
| | | | Use parent dir instead. That will be on same FS hence the move will atomic.
* Reduce log level for some messagesHarald Musum2017-12-113-16/+8
|
* Only update hash when there is more dataHarald Musum2017-12-111-1/+3
|
* Fix parameters for filedistribution.receiveFileHarald Musum2017-12-101-1/+1
|
* Fix some issues related to RPC methods for file distributionHarald Musum2017-12-091-5/+2
|
* Use the LazyFileReferenceData to avoid filling memory.Henning Baldersheim2017-12-081-0/+7
|
* Implement the chunked transfer.Henning Baldersheim2017-12-081-8/+8
|
* Use a ByteChannel interface instead.Henning Baldersheim2017-12-084-24/+21
|
* Make a abstract FileReferenceData so it can cater for both whole files and ↵Henning Baldersheim2017-12-085-22/+127
| | | | chunked files.
* Use diamon syntax and revert uninteded recaforing in text and comments.Henning Baldersheim2017-12-081-24/+24
|
* Add the receiving part of the streaming transfer.Henning Baldersheim2017-12-083-42/+153
|
* Implement chunked receiver.Henning Baldersheim2017-12-071-0/+102
|
* Detach and serve from separate thread.Henning Baldersheim2017-12-073-98/+92
|
* Merge pull request #4381 from vespa-engine/hmusum/handle-directory-filereferenceHenning Baldersheim2017-12-077-46/+264
|\ | | | | Handle that a file reference is a directory with many files
| * Handle that a file reference is a directory with many filesHarald Musum2017-12-077-46/+264
| | | | | | | | Compress on the fly if asked for such a file reference
* | New ownersHarald Musum2017-12-071-1/+2
|/
* Merge pull request #4331 from vespa-engine/hmusum/handle-file-already-existingHenning Baldersheim2017-12-041-5/+19
|\ | | | | Handle file already exisisting
| * Handle file already exisistingHarald Musum2017-12-011-5/+19
| | | | | | | | | | | | When we ask several config servers for a file we might get several callbacks which all try to move a file to the destination. Do not fail if we cannot move the file because it already exists
* | Split parent + container-dependency-versions from root pom.gjoranv2017-12-011-1/+2
|/ | | | | | - Add missing dependencies so that all provided non-yahoo jars are listed in container-dependency-versions. - Add relativePath for all child poms of parent.
* Revert "Gjoranv/split parent2"gjoranv2017-11-301-2/+1
|
* Split parent + container-dependency-versions from root pom.gjoranv2017-11-301-1/+2
| | | | | | - Add missing dependencies so that all provided non-yahoo jars are listed in container-dependency-versions. - Add relativePath for all child poms of parent.
* Print stack trace when failing to write fileHarald Musum2017-11-301-1/+1
|
* Revert "Gjoranv/split parent"gjoranv2017-11-291-2/+1
|
* Split parent + container-dependency-versions from root pom.gjoranv2017-11-291-1/+2
| | | | | | - Add missing dependencies so that all provided non-yahoo jars are listed in container-dependency-versions. - Add relativePath for all child poms of parent.
* Write to temp file and move it afterwardsHarald Musum2017-11-281-2/+5
|
* Add setting for turning off file distributorHarald Musum2017-11-271-0/+98
| | | | | | If set, will not start file distributor on config server host and on tenant nodes, will instead use config proxy and file distribution will be done with RPC calls between config proxy and config server
* Remove duplicate dependencyHarald Musum2017-11-241-5/+0
|
* Implement chained download of file referencesHarald Musum2017-11-232-9/+14
| | | | | | | * A config server will download from another one (if possible) if it does not have the file itself. * Set error in connection pool when request fails * Use an empty connection pool if only one server
* Revert "Hmusum/choose new connection if file reference not found"Harald Musum2017-11-231-9/+5
|
* Set error in connection pool when request failsHarald Musum2017-11-231-5/+8
|
* Make sure to choose a new connection if file reference not foundHarald Musum2017-11-231-0/+1
|
* Add support for downloading from another config serverHarald Musum2017-11-233-20/+109
| | | | | | | If a request for a file reference cannot be fulfilled, ask another config server for the file. Handle connection errors when downloading files. Fixed bundle issues.
* Revert "Revert "Revert "Add support for downloading from another config ↵Harald Musum2017-11-222-78/+10
| | | | server"""
* Revert "Revert "Add support for downloading from another config server""Harald Musum2017-11-212-10/+78
|
* Revert "Add support for downloading from another config server"Harald Musum2017-11-212-78/+10
|
* Add support for downloading from another config serverHarald Musum2017-11-212-10/+78
| | | | | | If a request for a file reference cannot be fulfilled, ask another config server for the file. Handle connection errors when downloading files.
* Move fildistribution code to filedistribution moduleHarald Musum2017-11-177-1/+929
|
* Revert "Revert "Revert "Hmusum/move new filedistribution classes"""Harald Musum2017-11-168-1027/+1
|
* Revert "Revert "Hmusum/move new filedistribution classes""Harald Musum2017-11-168-1/+1027
|
* Revert "Hmusum/move new filedistribution classes"Harald Musum2017-11-168-1027/+1
|