We have a few build servers that run many builds in parallel. When a "docker build" step is added to the build, it starts taking an order of magnitude longer to run (from 20min to hours). We've observed this with both docker 1.1.2 and 1.3.1.
The builds do roughly this:
docker pull
docker build # build multiple images
docker run # run each of the built images
...
The Issue
I tried to create a minimal reproduction of the issue at https://github.com/dnephin/dockerd-load-test
What I observed was that concurrent builds actually take longer to run than if I had run them sequentially. Tested with docker 1.3.3 and 1.4.0.
build 1: elapsed 8.411
build 2: elapsed 19.825
build 3: elapsed 30.438
build 4: elapsed 41.650
build 5: elapsed 54.865
build 10: elapsed 115.551
build 20: elapsed 321.406
As more concurrent builds are run, the elapsed time actually increases beyond n * 8.4s.
See the the repo for the code to reproduce.
docteurklein, dennisoehme, danielward, creack, mfrister and 73 more
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4