docker中pull和push的性能有什么不同

71次阅读
没有评论

共计 9369 个字符,预计需要花费 24 分钟才能阅读完成。

这篇文章主要介绍了 docker 中 pull 和 push 的性能有什么不同,具有一定借鉴价值,感兴趣的朋友可以参考下,希望大家阅读完这篇文章之后大有收获,下面让丸趣 TV 小编带着大家一起了解一下。

0. 测试环境

基本架构:没有 docker index,所有操作发生在 daemon 和 registry 之间

镜像:

# docker images --tree 
Warning:  --tree  is deprecated, it will be removed soon. See usage.
├─9247a3750813 Virtual Size: 85.1 MB
│ └─a92b1d9f0ca5 Virtual Size: 1.078 GB Tags: 10.180.156.6:5000/bigtest2:latest

网络环境:docker daemon 和 registry 之间为千兆网络,带宽足够大。

1. docker push 日志分析及 registry put 对比测试

在客户端做一次 docker push 的时候,观察 registry 端日志,刨去无关的一些日志后,如下:

10.180.156.11 - - [02/Apr/2015:03:25:55 +0000]  GET /v2/ HTTP/1.1  404 233  -   Go 1.1 package http 
10.180.156.11 - - [02/Apr/2015:03:25:55 +0000]  GET /v1/_ping HTTP/1.1  200 2  -   Go 1.1 package http 
02/Apr/2015:03:25:55 +0000 DEBUG: args = {namespace :  library ,  repository : u bigtest2}
02/Apr/2015:03:25:55 +0000 ERROR:  ?xml version= 1.0  encoding= UTF-8 ? 
10.180.156.11 - - [02/Apr/2015:03:25:55 +0000]  PUT /v1/repositories/bigtest2/ HTTP/1.1  200 2  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:03:25:55 +0000 DEBUG: args = {image_id : u 9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f}
02/Apr/2015:03:25:55 +0000 DEBUG: args = {image_id : u a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5}
02/Apr/2015:03:25:55 +0000 DEBUG: api_error: Image not found
10.180.156.11 - - [02/Apr/2015:03:25:55 +0000]  GET /v1/images/9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f/json HTTP/1.1  404 28  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:03:25:55 +0000 DEBUG: api_error: Image not found
10.180.156.11 - - [02/Apr/2015:03:25:55 +0000]  GET /v1/images/a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5/json HTTP/1.1  404 28  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:03:25:55 +0000 DEBUG: args = {image_id : u 9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f}
10.180.156.11 - - [02/Apr/2015:03:25:56 +0000]  PUT /v1/images/9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f/json HTTP/1.1  200 4  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
=== 3 秒 ===
02/Apr/2015:03:25:57 +0000 DEBUG: args = {image_id : u 9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f}
===34 秒 ===
10.180.156.11 - - [02/Apr/2015:03:26:31 +0000]  PUT /v1/images/9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f/layer HTTP/1.1  200 4  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:03:26:31 +0000 DEBUG: args = {image_id : u 9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f}
10.180.156.11 - - [02/Apr/2015:03:26:31 +0000]  PUT /v1/images/9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f/checksum HTTP/1.1  200 4  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:03:26:31 +0000 DEBUG: args = {image_id : u a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5}
10.180.156.11 - - [02/Apr/2015:03:26:32 +0000]  PUT /v1/images/a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5/json HTTP/1.1  200 4  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
=== 6 秒 ===
02/Apr/2015:03:26:37 +0000 DEBUG: args = {image_id : u a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5}
===325 秒 ===
10.180.156.11 - - [02/Apr/2015:03:32:02 +0000]  PUT /v1/images/a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5/layer HTTP/1.1  200 4  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:03:32:02 +0000 DEBUG: args = {image_id : u a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5}
10.180.156.11 - - [02/Apr/2015:03:32:03 +0000]  PUT /v1/images/a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5/checksum HTTP/1.1  200 4  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:03:32:03 +0000 DEBUG: args = {tag : u latest ,  namespace :  library ,  repository : u bigtest2}
02/Apr/2015:03:32:03 +0000 DEBUG: [put_tag] namespace=library; repository=bigtest2; tag=latest
10.180.156.11 - - [02/Apr/2015:03:32:03 +0000]  PUT /v1/repositories/bigtest2/tags/latest HTTP/1.1  200 4  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:03:32:03 +0000 DEBUG: args = {images : True,  namespace :  library ,  repository : u bigtest2}
10.180.156.11 - - [02/Apr/2015:03:32:03 +0000]  PUT /v1/repositories/bigtest2/images HTTP/1.1  204 -  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64

可以发现,对于一个 2 层的镜像,整个 push 的时间可以分成几段

操作耗时百分比 put json13s0.8%put layer134s9.2%put json26s1.6%put layer2325s87.6% 总耗时 371s100%

也就是说,在做 put layer1 和 put layer2 时消耗了 96.8% 的时间。那么,纯的对 registry 服务做同样文件的 PUT 操作,会消耗多少时间呢?

# time curl -X PUT -H  Transfer-Encoding: chunked  --data-binary @layer-a92b1  http://10.180.156.6:5000/v1/images/a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5/layer 
real 0m44.571s
user 0m0.302s
sys 0m1.341s
# time curl -X PUT -H  Transfer-Encoding: chunked  --data-binary @layer-9247a  http://10.180.156.6:5000/v1/images/9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f/layer 
real 0m4.277s
user 0m0.029s
sys 0m0.130s

2. docker pull 日志分析及 registry get 对比测试

类似上个节,继续做 pull 的日志分析

10.180.156.11 - - [02/Apr/2015:08:54:16 +0000]  GET /v2/ HTTP/1.1  404 233  -   Go 1.1 package http 
10.180.156.11 - - [02/Apr/2015:08:54:16 +0000]  GET /v1/_ping HTTP/1.1  200 2  -   Go 1.1 package http 
02/Apr/2015:08:54:16 +0000 DEBUG: args = {namespace :  library ,  repository : u bigtest2}
10.180.156.11 - - [02/Apr/2015:08:54:16 +0000]  GET /v1/repositories/bigtest2/images HTTP/1.1  200 152  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:08:54:16 +0000 DEBUG: args = {namespace : u library ,  repository : u bigtest2}
02/Apr/2015:08:54:16 +0000 DEBUG: [get_tags] namespace=library; repository=bigtest2
10.180.156.11 - - [02/Apr/2015:08:54:16 +0000]  GET /v1/repositories/library/bigtest2/tags HTTP/1.1  200 78  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:08:54:16 +0000 DEBUG: args = {image_id : u a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5}
10.180.156.11 - - [02/Apr/2015:08:54:16 +0000]  GET /v1/images/a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5/ancestry HTTP/1.1  200 136  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:08:54:16 +0000 DEBUG: args = {image_id : u 9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f}
10.180.156.11 - - [02/Apr/2015:08:54:17 +0000]  GET /v1/images/9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f/json HTTP/1.1  200 619  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:08:54:17 +0000 DEBUG: args = {image_id : u 9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f}
=== 6 秒 ===
10.180.156.11 - - [02/Apr/2015:08:54:23 +0000]  GET /v1/images/9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f/layer HTTP/1.1  200 37124367  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:08:54:24 +0000 DEBUG: args = {image_id : u a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5}
===42 秒 ===
02/Apr/2015:08:55:06 +0000 DEBUG: api_error: Image not found
10.180.156.11 - - [02/Apr/2015:08:55:06 +0000]  GET /v1/images/a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5/json HTTP/1.1  404 28  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:08:55:06 +0000 DEBUG: args = {image_id : u a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5}
10.180.156.11 - - [02/Apr/2015:08:55:06 +0000]  GET /v1/images/a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5/json HTTP/1.1  200 1172  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64 
02/Apr/2015:08:55:07 +0000 DEBUG: args = {image_id : u a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5}
=== 2 秒 ===
10.180.156.11 - - [02/Apr/2015:08:56:08 +0000]  GET /v1/images/a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5/layer HTTP/1.1  200 420084375  -   docker/1.5.0 go/go1.4.1 git-commit/a8a31ef kernel/3.13.0-32-generic os/linux arch/amd64

可以发现,对于一个 2 层的镜像,整个 pull 的时间可以分成几段

操作耗时百分比 get json16s5.1%get layer142s36.2%get json20s0%get layer22s1.7% 总耗时 116s100%

对比直接从 registry 上 get 测试

# time curl -X GET -H  Transfer-Encoding: chunked  -o layer-9247a-down  http://10.180.156.6:5000/v1/images/9247a37508136a5fe916f4f87bfa2aa47f2edf8fc1a1ce787445b606d8fdbf9f/layer 
 % Total % Received % Xferd Average Speed Time Time Time Current
 Dload Upload Total Spent Left Speed
100 35.4M 100 35.4M 0 0 25.3M 0 0:00:01 0:00:01 --:--:-- 25.3M
real 0m1.409s
user 0m0.036s
sys 0m0.233s
# time curl -X GET -H  Transfer-Encoding: chunked  -o layer-a92b1-down  http://10.180.156.6:5000/v1/images/a92b1d9f0ca59cefd024a5f2f2d23e2d617b3e67cc2363c94998006fa87e60e5/layer 
 % Total % Received % Xferd Average Speed Time Time Time Current
 Dload Upload Total Spent Left Speed
100 400M 100 400M 0 0 19.2M 0 0:00:20 0:00:20 --:--:-- 24.5M
real 0m20.771s
user 0m0.381s
sys 0m2.501s

感谢你能够认真阅读完这篇文章,希望丸趣 TV 小编分享的“docker 中 pull 和 push 的性能有什么不同”这篇文章对大家有帮助,同时也希望大家多多支持丸趣 TV,关注丸趣 TV 行业资讯频道,更多相关知识等着你来学习!

正文完
 
丸趣
版权声明:本站原创文章,由 丸趣 2023-08-16发表,共计9369字。
转载说明:除特殊说明外本站除技术相关以外文章皆由网络搜集发布,转载请注明出处。
评论(没有评论)