Page tree

如需转载请标注内容地址为: https://wiki.shileizcc.com/confluence/display/KUB/Kubernetes+Rbd

Skip to end of metadata
Go to start of metadata

Kubernetes Rbd

Ceph install

Ceph 安装在 Google Cloud Kubernetes Cluster 上,服务器配置表:

服务器名称地址备注
gke-cluster-1-default-pool-72415711-4vx210.140.0.4New Disk: /dev/sdb 50GB
gke-cluster-1-default-pool-72415711-6rvw10.140.0.2New Disk: /dev/sdb 50GB
gke-cluster-1-default-pool-72415711-b3h410.140.0.3New Disk: /dev/sdb 50GB

创建的 Kubernetes Cluster 默认就是 3 各节点,需要注意每个节点都添加了一块 50GB 的磁盘。


首先配置 SSH 免秘钥(所有服务器全部执行)

$ ssh-keygen -t rsa
Generating public/private rsa key pair.
Enter file in which to save the key (/home/shilei/.ssh/id_rsa):
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /home/shilei/.ssh/id_rsa.
Your public key has been saved in /home/shilei/.ssh/id_rsa.pub.
The key fingerprint is:
SHA256:rQKOufyU5XK12yg8q/kXKCz1Zwd0k2aMe0M822xa6GY shilei@gke-cluster-1-default-pool-72415711-6rvw
The key's randomart image is:
+---[RSA 2048]----+
|         + .     |
|        o @      |
|       . * B     |
|    .   o.= =    |
|   o....S+.=     |
|  .+o=o.+oE      |
|  o.=o+oo=       |
| . o ++..+       |
|  o.+oo=o .      |
+----[SHA256]-----+

然后把三个节点下的 SSH 公钥 .ssh/id_rsa.pub 的内容放在 .ssh/authorized_keys,如下,三台机器分别添加三个公钥凭证:

.ssh/authorized_keys
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCehUkw10pXaxg/oXEF2mye3k3Lcwg7PaginFE0nTxf9FmJtA5kGRb+IDp8GRJcM0JWUewOgIIpNTJSbrSstP6g7o02Je2jfUy4F+TPuzMO0F64+A/nkD+j0Z/dIlP1Y500ny6ICPNOdE8wgZkfnKEAdCx29iaZSVpYGGafY9ybuB608S8c0eyry0pffj3VyCrs2kv1CiDeGHLBIQlrgm3OUcXiaHLFznQigGaa5RDyYPnQQfln+UQ9Dt4jUiAXU0s/84li2NLzZu86/rgGOl9f9KxSXnpc3wr3Z+20akfoe5/+6fyEtnFzL82hchWK9P+xiiJtXQh01zvQK5j4FuIJ shilei@gke-cluster-1-default-pool-72415711-6rvw
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYJcZAGHLXbWPzL9VbIvTHuS+Kp1R3KED7FlXkYd7NYIAvOLjizFtChGJRxe3mbUc95VmOY2UQmdRhVdAOemA4nklXWFGR2+h/Jjxev+lEzmgMTObTOj+Z+rSfJhfRPSbZxRJsQm/YsRwM+pYEDJj7fZglUu/fhsgStej0TmylOwkfe1B+OIgGT4iNxAw36mWZyScX1PvgqxkB1Sj2aIW4L/5kF0F0y+L/io5oQMMKCgDp/X76a/LTlyVB0JBy0qSoISDPsaQzuwPh1GMLciB417MbpHae/jY5vKzQQBnSHYkXWbLFJe8dZ5wnrC2jTrTzLNeUvjYL+utTpdOsNeNJ shilei@gke-cluster-1-default-pool-72415711-b3h4
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvsAj5U/S8nPFL1fyACRywuQ2A2d99CQBMZ1PwX7+raTkI9GnJp1xvI016u0n37wRvYl1w4U66ISs6olFdrQN7p9CBwAzy8yyPtMO1H8A9YuklaqhoTDPVKNu3nSweim5pvc6bbv1fU+qe740wvpkzpqp04m4DWPvBlUgsoZtkt1XUCrrmXLyj/BzWaJZIf66DBFXcncLrZd8SnhMsAfa+ayipi+tnpwb0UbcWDXJ0jqbbL94Gjau+TQe8mLkUPoYImXQk0X+/xnRzdJcyYqX9rXF9nWCY0MPXYmaBvtc2ZqAbiTb9adf1Y8JHmBdl4WMAw2JtezWog4KYnLa5mbuB shilei@gke-cluster-1-default-pool-72415711-4vx2

配置 Ceph 源:(三台机器全部执行)

$ wget -q -O- 'https://download.ceph.com/keys/release.asc' | sudo apt-key add -
$ echo deb http://download.ceph.com/debian-jewel/ $(lsb_release -sc) main | sudo tee /etc/apt/sources.list.d/ceph.list
$ sudo apt-get update

安装 Ceph,这里只需要一台服务器执行即可,使用节点为 "gke-cluster-1-default-pool-72415711-4vx2" :

$ sudo apt-get install ceph-deploy

创建配置工作目录:

$ mkdir my-cluster && cd my-cluster

初始 Ceph 安装节点配置:

$ ceph-deploy new gke-cluster-1-default-pool-72415711-4vx2 gke-cluster-1-default-pool-72415711-6rvw gke-cluster-1-default-pool-72415711-b3h4
执行过程
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/shilei/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (1.5.39): /usr/bin/ceph-deploy new gke-cluster-1-default-pool-72415711-4vx2 gke-cluster-1-default-pool-72415711-6rvw gke-cluster-1-default-pool-72415711-b3h4
[ceph_deploy.cli][INFO  ] ceph-deploy options:
[ceph_deploy.cli][INFO  ]  username                      : None
[ceph_deploy.cli][INFO  ]  verbose                       : False
[ceph_deploy.cli][INFO  ]  overwrite_conf                : False
[ceph_deploy.cli][INFO  ]  quiet                         : False
[ceph_deploy.cli][INFO  ]  cd_conf                       : <ceph_deploy.conf.cephdeploy.Conf instance at 0x7f1443fa1248>
[ceph_deploy.cli][INFO  ]  cluster                       : ceph
[ceph_deploy.cli][INFO  ]  ssh_copykey                   : True
[ceph_deploy.cli][INFO  ]  mon                           : ['gke-cluster-1-default-pool-72415711-4vx2', 'gke-cluster-1-default-pool-72415711-6rvw', 'gke-cluster-1-default-pool-72415711-b3h4']
[ceph_deploy.cli][INFO  ]  func                          : <function new at 0x7f1444624230>
[ceph_deploy.cli][INFO  ]  public_network                : None
[ceph_deploy.cli][INFO  ]  ceph_conf                     : None
[ceph_deploy.cli][INFO  ]  cluster_network               : None
[ceph_deploy.cli][INFO  ]  default_release               : False
[ceph_deploy.cli][INFO  ]  fsid                          : None
[ceph_deploy.new][DEBUG ] Creating new cluster named ceph
[ceph_deploy.new][INFO  ] making sure passwordless SSH succeeds
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /bin/ip link show
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /bin/ip addr show
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] IP addresses found: [u'169.254.123.1', u'10.140.0.4', u'10.8.1.1']
[ceph_deploy.new][DEBUG ] Resolving host gke-cluster-1-default-pool-72415711-4vx2
[ceph_deploy.new][DEBUG ] Monitor gke-cluster-1-default-pool-72415711-4vx2 at 10.140.0.4
[ceph_deploy.new][INFO  ] making sure passwordless SSH succeeds
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: ssh -CT -o BatchMode=yes gke-cluster-1-default-pool-72415711-6rvw
[ceph_deploy.new][WARNIN] could not connect via SSH
[ceph_deploy.new][INFO  ] will connect again with password prompt
The authenticity of host 'gke-cluster-1-default-pool-72415711-6rvw (10.140.0.2)' can't be established.
ECDSA key fingerprint is SHA256:NFEwFz2aH5lMDljGU+H5mXNPtULHyQ6JWaoJaDNK56o.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'gke-cluster-1-default-pool-72415711-6rvw,10.140.0.2' (ECDSA) to the list of known hosts.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect machine type
[ceph_deploy.new][INFO  ] adding public keys to authorized_keys
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] append contents to file
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo /bin/ip link show
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo /bin/ip addr show
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] IP addresses found: [u'10.140.0.2', u'169.254.123.1', u'10.8.0.1']
[ceph_deploy.new][DEBUG ] Resolving host gke-cluster-1-default-pool-72415711-6rvw
[ceph_deploy.new][DEBUG ] Monitor gke-cluster-1-default-pool-72415711-6rvw at 10.140.0.2
[ceph_deploy.new][INFO  ] making sure passwordless SSH succeeds
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: ssh -CT -o BatchMode=yes gke-cluster-1-default-pool-72415711-b3h4
[ceph_deploy.new][WARNIN] could not connect via SSH
[ceph_deploy.new][INFO  ] will connect again with password prompt
The authenticity of host 'gke-cluster-1-default-pool-72415711-b3h4 (10.140.0.3)' can't be established.
ECDSA key fingerprint is SHA256:2XY4K/jCYu3pUx7n1URDmR1/zU8tWhMDlGHPMfS07M8.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'gke-cluster-1-default-pool-72415711-b3h4,10.140.0.3' (ECDSA) to the list of known hosts.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect machine type
[ceph_deploy.new][INFO  ] adding public keys to authorized_keys
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] append contents to file
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo /bin/ip link show
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo /bin/ip addr show
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] IP addresses found: [u'169.254.123.1', u'10.8.2.1', u'10.140.0.3']
[ceph_deploy.new][DEBUG ] Resolving host gke-cluster-1-default-pool-72415711-b3h4
[ceph_deploy.new][DEBUG ] Monitor gke-cluster-1-default-pool-72415711-b3h4 at 10.140.0.3
[ceph_deploy.new][DEBUG ] Monitor initial members are ['gke-cluster-1-default-pool-72415711-4vx2', 'gke-cluster-1-default-pool-72415711-6rvw', 'gke-cluster-1-default-pool-72415711-b3h4']
[ceph_deploy.new][DEBUG ] Monitor addrs are ['10.140.0.4', '10.140.0.2', '10.140.0.3']
[ceph_deploy.new][DEBUG ] Creating a random mon key...
[ceph_deploy.new][DEBUG ] Writing monitor keyring to ceph.mon.keyring...
[ceph_deploy.new][DEBUG ] Writing initial config to ceph.conf...

安装 Ceph:

$ ceph-deploy install gke-cluster-1-default-pool-72415711-4vx2 gke-cluster-1-default-pool-72415711-6rvw gke-cluster-1-default-pool-72415711-b3h4
执行过程
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/shilei/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (1.5.39): /usr/bin/ceph-deploy install gke-cluster-1-default-pool-72415711-4vx2 gke-cluster-1-default-pool-72415711-6rvw gke-cluster-1-default-pool-72415711-b3h4
[ceph_deploy.cli][INFO  ] ceph-deploy options:
[ceph_deploy.cli][INFO  ]  verbose                       : False
[ceph_deploy.cli][INFO  ]  testing                       : None
[ceph_deploy.cli][INFO  ]  cd_conf                       : <ceph_deploy.conf.cephdeploy.Conf instance at 0x7f4e84dcde18>
[ceph_deploy.cli][INFO  ]  cluster                       : ceph
[ceph_deploy.cli][INFO  ]  dev_commit                    : None
[ceph_deploy.cli][INFO  ]  install_mds                   : False
[ceph_deploy.cli][INFO  ]  stable                        : None
[ceph_deploy.cli][INFO  ]  default_release               : False
[ceph_deploy.cli][INFO  ]  username                      : None
[ceph_deploy.cli][INFO  ]  adjust_repos                  : True
[ceph_deploy.cli][INFO  ]  func                          : <function install at 0x7f4e854a8938>
[ceph_deploy.cli][INFO  ]  install_mgr                   : False
[ceph_deploy.cli][INFO  ]  install_all                   : False
[ceph_deploy.cli][INFO  ]  repo                          : False
[ceph_deploy.cli][INFO  ]  host                          : ['gke-cluster-1-default-pool-72415711-4vx2', 'gke-cluster-1-default-pool-72415711-6rvw', 'gke-cluster-1-default-pool-72415711-b3h4']
[ceph_deploy.cli][INFO  ]  install_rgw                   : False
[ceph_deploy.cli][INFO  ]  install_tests                 : False
[ceph_deploy.cli][INFO  ]  repo_url                      : None
[ceph_deploy.cli][INFO  ]  ceph_conf                     : None
[ceph_deploy.cli][INFO  ]  install_osd                   : False
[ceph_deploy.cli][INFO  ]  version_kind                  : stable
[ceph_deploy.cli][INFO  ]  install_common                : False
[ceph_deploy.cli][INFO  ]  overwrite_conf                : False
[ceph_deploy.cli][INFO  ]  quiet                         : False
[ceph_deploy.cli][INFO  ]  dev                           : master
[ceph_deploy.cli][INFO  ]  nogpgcheck                    : False
[ceph_deploy.cli][INFO  ]  local_mirror                  : None
[ceph_deploy.cli][INFO  ]  release                       : None
[ceph_deploy.cli][INFO  ]  install_mon                   : False
[ceph_deploy.cli][INFO  ]  gpg_url                       : None
[ceph_deploy.install][DEBUG ] Installing stable version jewel on cluster ceph hosts gke-cluster-1-default-pool-72415711-4vx2 gke-cluster-1-default-pool-72415711-6rvw gke-cluster-1-default-pool-72415711-b3h4
[ceph_deploy.install][DEBUG ] Detecting platform for host gke-cluster-1-default-pool-72415711-4vx2 ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect machine type
[ceph_deploy.install][INFO  ] Distro info: Ubuntu 16.04 xenial
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] installing Ceph on gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo env DEBIAN_FRONTEND=noninteractive DEBIAN_PRIORITY=critical apt-get --assume-yes -q --no-install-recommends install ca-certificates apt-transport-https
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Reading package lists...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Building dependency tree...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Reading state information...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] apt-transport-https is already the newest version (1.2.24).
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] The following packages will be upgraded:
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   ca-certificates
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] 1 upgraded, 0 newly installed, 0 to remove and 104 not upgraded.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Need to get 168 kB of archives.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] After this operation, 60.4 kB disk space will be freed.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:1 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 ca-certificates all 20170717~16.04.1 [168 kB]
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] perl: warning: Setting locale failed.
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] perl: warning: Please check that your locale settings:
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] 	LANGUAGE = (unset),
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] 	LC_ALL = (unset),
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] 	LC_CTYPE = "zh_CN.UTF-8",
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] 	LANG = "en_US.UTF-8"
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN]     are supported and installed on your system.
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] perl: warning: Falling back to a fallback locale ("en_US.UTF-8").
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] locale: Cannot set LC_CTYPE to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] locale: Cannot set LC_ALL to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preconfiguring packages ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Fetched 168 kB in 0s (0 B/s)
(Reading database ... 56006 files and directories currently installed.).
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../ca-certificates_20170717~16.04.1_all.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking ca-certificates (20170717~16.04.1) over (20160104ubuntu1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Processing triggers for man-db (2.7.5-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up ca-certificates (20170717~16.04.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] locale: Cannot set LC_CTYPE to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] locale: Cannot set LC_ALL to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Processing triggers for ca-certificates (20170717~16.04.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Updating certificates in /etc/ssl/certs...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] 17 added, 42 removed; done.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Running hooks in /etc/ca-certificates/update.d...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] done.
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo wget -O release.asc https://download.ceph.com/keys/release.asc
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] --2017-12-04 04:21:28--  https://download.ceph.com/keys/release.asc
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:443... connected.
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] HTTP request sent, awaiting response... 200 OK
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] Length: 1645 (1.6K) [application/octet-stream]
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] Saving to: 'release.asc'
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN]
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN]      0K .                                                     100%  531M=0s
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN]
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] 2017-12-04 04:21:29 (531 MB/s) - 'release.asc' saved [1645/1645]
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN]
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo apt-key add release.asc
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] OK
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] add deb repo to /etc/apt/sources.list.d/
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo env DEBIAN_FRONTEND=noninteractive DEBIAN_PRIORITY=critical apt-get --assume-yes -q update
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Hit:1 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial InRelease
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Hit:2 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates InRelease
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Hit:3 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-backports InRelease
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Hit:4 http://security.ubuntu.com/ubuntu xenial-security InRelease
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Hit:5 https://download.ceph.com/debian-jewel xenial InRelease
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Reading package lists...
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo env DEBIAN_FRONTEND=noninteractive DEBIAN_PRIORITY=critical apt-get --assume-yes -q --no-install-recommends install -o Dpkg::Options::=--force-confnew ceph ceph-osd ceph-mds ceph-mon radosgw
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Reading package lists...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Building dependency tree...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Reading state information...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] The following additional packages will be installed:
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   binutils ceph-base ceph-common libaio1 libbabeltrace-ctf1 libbabeltrace1
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   libboost-iostreams1.58.0 libboost-program-options1.58.0
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   libboost-random1.58.0 libboost-regex1.58.0 libboost-system1.58.0
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   libboost-thread1.58.0 libcephfs1 libfcgi0ldbl libgoogle-perftools4
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   libjs-jquery libleveldb1v5 liblttng-ust-ctl2 liblttng-ust0 libnspr4 libnss3
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   libnss3-nssdb librados2 libradosstriper1 librbd1 librgw2 libsnappy1v5
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   libtcmalloc-minimal4 libunwind8 liburcu4 python-cephfs python-chardet
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   python-flask python-itsdangerous python-jinja2 python-markupsafe
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   python-rados python-rbd python-requests python-six python-urllib3
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   python-werkzeug
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Suggested packages:
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   binutils-doc python-flask-doc python-jinja2-doc python-ndg-httpsclient
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   python-openssl python-pyasn1 python-ntlm ipython python-genshi python-lxml
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   python-greenlet python-redis python-pylibmc | python-memcache
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   python-werkzeug-doc
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Recommended packages:
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   ceph-fs-common ceph-fuse javascript-common python-blinker
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   python-ndg-httpsclient python-openssl python-pyasn1 python-pyinotify
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] The following NEW packages will be installed:
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   binutils ceph ceph-base ceph-common ceph-mds ceph-mon ceph-osd libaio1
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   libbabeltrace-ctf1 libbabeltrace1 libboost-iostreams1.58.0
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   libboost-program-options1.58.0 libboost-random1.58.0 libboost-regex1.58.0
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   libboost-system1.58.0 libboost-thread1.58.0 libcephfs1 libfcgi0ldbl
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   libgoogle-perftools4 libjs-jquery libleveldb1v5 liblttng-ust-ctl2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   liblttng-ust0 libnspr4 libnss3 libnss3-nssdb librados2 libradosstriper1
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   librbd1 librgw2 libsnappy1v5 libtcmalloc-minimal4 libunwind8 liburcu4
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   python-cephfs python-chardet python-flask python-itsdangerous python-jinja2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   python-markupsafe python-rados python-rbd python-requests python-six
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   python-urllib3 python-werkzeug radosgw
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] 0 upgraded, 47 newly installed, 0 to remove and 104 not upgraded.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Need to get 115 MB of archives.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] After this operation, 538 MB of additional disk space will be used.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:1 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 binutils amd64 2.26.1-1ubuntu1~16.04.5 [2311 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:2 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-iostreams1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [29.0 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:3 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-system1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [9146 B]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:4 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-random1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [11.7 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:5 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-thread1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [47.0 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:6 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/universe amd64 liburcu4 amd64 0.9.1-3 [47.3 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:7 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/universe amd64 liblttng-ust-ctl2 amd64 2.7.1-1 [72.2 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:8 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/universe amd64 liblttng-ust0 amd64 2.7.1-1 [127 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:9 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libnspr4 amd64 2:4.13.1-0ubuntu0.16.04.1 [112 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:10 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libnss3-nssdb all 2:3.28.4-0ubuntu0.16.04.3 [10.6 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:11 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libnss3 amd64 2:3.28.4-0ubuntu0.16.04.3 [1148 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:12 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libbabeltrace1 amd64 1.3.2-1 [34.7 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:13 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libbabeltrace-ctf1 amd64 1.3.2-1 [88.3 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:14 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-program-options1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [138 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:15 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-regex1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [261 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:16 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libtcmalloc-minimal4 amd64 2.4-0ubuntu5.16.04.1 [105 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:17 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libunwind8 amd64 1.1-4.1 [46.5 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:18 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libgoogle-perftools4 amd64 2.4-0ubuntu5.16.04.1 [187 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:19 https://download.ceph.com/debian-jewel xenial/main amd64 librados2 amd64 10.2.10-1xenial [2843 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:20 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libfcgi0ldbl amd64 2.4.0-8.3 [161 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:21 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-six all 1.10.0-3 [10.9 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:22 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 python-urllib3 all 1.13.1-2ubuntu0.16.04.1 [57.2 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:23 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-chardet all 2.3.0-2 [96.3 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:24 https://download.ceph.com/debian-jewel xenial/main amd64 librbd1 amd64 10.2.10-1xenial [3367 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:25 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-requests all 2.9.1-3 [55.6 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:26 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-itsdangerous all 0.24+dfsg1-1 [12.0 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:27 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-markupsafe amd64 0.23-2build2 [15.5 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:28 https://download.ceph.com/debian-jewel xenial/main amd64 libradosstriper1 amd64 10.2.10-1xenial [2904 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:29 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-jinja2 all 2.8-1 [109 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:30 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libjs-jquery all 1.11.3+dfsg-4 [161 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:31 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 python-werkzeug all 0.10.4+dfsg1-1ubuntu1.1 [162 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:32 https://download.ceph.com/debian-jewel xenial/main amd64 librgw2 amd64 10.2.10-1xenial [4048 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:33 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-flask all 0.10.1-2build2 [51.8 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:34 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libsnappy1v5 amd64 1.1.3-2 [16.0 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:35 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libleveldb1v5 amd64 1.18-5 [132 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:36 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libaio1 amd64 0.3.110-2 [6356 B]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:37 https://download.ceph.com/debian-jewel xenial/main amd64 python-rados amd64 10.2.10-1xenial [1775 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:38 https://download.ceph.com/debian-jewel xenial/main amd64 libcephfs1 amd64 10.2.10-1xenial [2950 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:39 https://download.ceph.com/debian-jewel xenial/main amd64 python-cephfs amd64 10.2.10-1xenial [1362 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:40 https://download.ceph.com/debian-jewel xenial/main amd64 python-rbd amd64 10.2.10-1xenial [1449 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:41 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-common amd64 10.2.10-1xenial [15.5 MB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:42 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-base amd64 10.2.10-1xenial [50.5 MB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:43 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-mon amd64 10.2.10-1xenial [3811 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:44 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-osd amd64 10.2.10-1xenial [11.8 MB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:45 https://download.ceph.com/debian-jewel xenial/main amd64 ceph amd64 10.2.10-1xenial [1141 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:46 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-mds amd64 10.2.10-1xenial [3842 kB]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Get:47 https://download.ceph.com/debian-jewel xenial/main amd64 radosgw amd64 10.2.10-1xenial [1405 kB]
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] perl: warning: Setting locale failed.
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] perl: warning: Please check that your locale settings:
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] 	LANGUAGE = (unset),
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] 	LC_ALL = (unset),
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] 	LC_CTYPE = "zh_CN.UTF-8",
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] 	LANG = "en_US.UTF-8"
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN]     are supported and installed on your system.
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] perl: warning: Falling back to a fallback locale ("en_US.UTF-8").
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] locale: Cannot set LC_CTYPE to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] locale: Cannot set LC_ALL to default locale: No such file or directory
Extracting templates from packages: 100%2][WARNIN]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Fetched 115 MB in 46s (2450 kB/s)
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package binutils.
(Reading database ... 55980 files and directories currently installed.).
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../binutils_2.26.1-1ubuntu1~16.04.5_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking binutils (2.26.1-1ubuntu1~16.04.5) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libboost-iostreams1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libboost-iostreams1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libboost-iostreams1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libboost-system1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libboost-system1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libboost-system1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libboost-random1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libboost-random1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libboost-random1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libboost-thread1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libboost-thread1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libboost-thread1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package liburcu4:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../liburcu4_0.9.1-3_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking liburcu4:amd64 (0.9.1-3) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package liblttng-ust-ctl2:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../liblttng-ust-ctl2_2.7.1-1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking liblttng-ust-ctl2:amd64 (2.7.1-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package liblttng-ust0:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../liblttng-ust0_2.7.1-1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking liblttng-ust0:amd64 (2.7.1-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libnspr4:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libnspr4_2%3a4.13.1-0ubuntu0.16.04.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libnspr4:amd64 (2:4.13.1-0ubuntu0.16.04.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libnss3-nssdb.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libnss3-nssdb_2%3a3.28.4-0ubuntu0.16.04.3_all.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libnss3-nssdb (2:3.28.4-0ubuntu0.16.04.3) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libnss3:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libnss3_2%3a3.28.4-0ubuntu0.16.04.3_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libnss3:amd64 (2:3.28.4-0ubuntu0.16.04.3) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package librados2.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../librados2_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking librados2 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package librbd1.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../librbd1_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking librbd1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libbabeltrace1:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libbabeltrace1_1.3.2-1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libbabeltrace1:amd64 (1.3.2-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libbabeltrace-ctf1:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libbabeltrace-ctf1_1.3.2-1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libbabeltrace-ctf1:amd64 (1.3.2-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libboost-program-options1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libboost-program-options1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libboost-program-options1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libboost-regex1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libboost-regex1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libboost-regex1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libtcmalloc-minimal4.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libtcmalloc-minimal4_2.4-0ubuntu5.16.04.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libtcmalloc-minimal4 (2.4-0ubuntu5.16.04.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libunwind8.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libunwind8_1.1-4.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libunwind8 (1.1-4.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libgoogle-perftools4.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libgoogle-perftools4_2.4-0ubuntu5.16.04.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libgoogle-perftools4 (2.4-0ubuntu5.16.04.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libradosstriper1.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libradosstriper1_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libradosstriper1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libfcgi0ldbl.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libfcgi0ldbl_2.4.0-8.3_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libfcgi0ldbl (2.4.0-8.3) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package librgw2.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../librgw2_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking librgw2 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package python-rados.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../python-rados_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking python-rados (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libcephfs1.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libcephfs1_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libcephfs1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package python-cephfs.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../python-cephfs_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking python-cephfs (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package python-rbd.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../python-rbd_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking python-rbd (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package python-six.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../python-six_1.10.0-3_all.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking python-six (1.10.0-3) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package python-urllib3.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../python-urllib3_1.13.1-2ubuntu0.16.04.1_all.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking python-urllib3 (1.13.1-2ubuntu0.16.04.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package python-chardet.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../python-chardet_2.3.0-2_all.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking python-chardet (2.3.0-2) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package python-requests.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../python-requests_2.9.1-3_all.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking python-requests (2.9.1-3) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package ceph-common.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../ceph-common_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking ceph-common (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package ceph-base.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../ceph-base_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking ceph-base (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package python-itsdangerous.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../python-itsdangerous_0.24+dfsg1-1_all.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking python-itsdangerous (0.24+dfsg1-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package python-markupsafe.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../python-markupsafe_0.23-2build2_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking python-markupsafe (0.23-2build2) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package python-jinja2.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../python-jinja2_2.8-1_all.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking python-jinja2 (2.8-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libjs-jquery.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libjs-jquery_1.11.3+dfsg-4_all.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libjs-jquery (1.11.3+dfsg-4) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package python-werkzeug.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../python-werkzeug_0.10.4+dfsg1-1ubuntu1.1_all.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking python-werkzeug (0.10.4+dfsg1-1ubuntu1.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package python-flask.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../python-flask_0.10.1-2build2_all.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking python-flask (0.10.1-2build2) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libsnappy1v5:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libsnappy1v5_1.1.3-2_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libsnappy1v5:amd64 (1.1.3-2) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libleveldb1v5:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libleveldb1v5_1.18-5_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libleveldb1v5:amd64 (1.18-5) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package ceph-mon.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../ceph-mon_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking ceph-mon (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package libaio1:amd64.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../libaio1_0.3.110-2_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking libaio1:amd64 (0.3.110-2) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package ceph-osd.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../ceph-osd_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking ceph-osd (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package ceph.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../ceph_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking ceph (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package ceph-mds.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../ceph-mds_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking ceph-mds (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Selecting previously unselected package radosgw.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Preparing to unpack .../radosgw_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Unpacking radosgw (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Processing triggers for libc-bin (2.23-0ubuntu9) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Processing triggers for man-db (2.7.5-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Processing triggers for systemd (229-4ubuntu19) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Processing triggers for ureadahead (0.100.0-19) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up binutils (2.26.1-1ubuntu1~16.04.5) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libboost-iostreams1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libboost-system1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libboost-random1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libboost-thread1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up liburcu4:amd64 (0.9.1-3) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up liblttng-ust-ctl2:amd64 (2.7.1-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up liblttng-ust0:amd64 (2.7.1-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libnspr4:amd64 (2:4.13.1-0ubuntu0.16.04.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libbabeltrace1:amd64 (1.3.2-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libbabeltrace-ctf1:amd64 (1.3.2-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libboost-program-options1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libboost-regex1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libtcmalloc-minimal4 (2.4-0ubuntu5.16.04.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libunwind8 (1.1-4.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libgoogle-perftools4 (2.4-0ubuntu5.16.04.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libfcgi0ldbl (2.4.0-8.3) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up python-six (1.10.0-3) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up python-urllib3 (1.13.1-2ubuntu0.16.04.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up python-chardet (2.3.0-2) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up python-requests (2.9.1-3) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up python-itsdangerous (0.24+dfsg1-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up python-markupsafe (0.23-2build2) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up python-jinja2 (2.8-1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libjs-jquery (1.11.3+dfsg-4) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up python-werkzeug (0.10.4+dfsg1-1ubuntu1.1) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up python-flask (0.10.1-2build2) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libsnappy1v5:amd64 (1.1.3-2) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libleveldb1v5:amd64 (1.18-5) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libaio1:amd64 (0.3.110-2) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libnss3-nssdb (2:3.28.4-0ubuntu0.16.04.3) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libnss3:amd64 (2:3.28.4-0ubuntu0.16.04.3) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up librados2 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up librbd1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libradosstriper1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up librgw2 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up python-rados (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up libcephfs1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up python-cephfs (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up python-rbd (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up ceph-common (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Adding group ceph....done
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Adding system user ceph....done
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting system user ceph properties....done
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up ceph-base (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up ceph-mon (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up ceph-osd (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up ceph (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up ceph-mds (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting up radosgw (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Processing triggers for libc-bin (2.23-0ubuntu9) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Processing triggers for systemd (229-4ubuntu19) ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Processing triggers for ureadahead (0.100.0-19) ...
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo ceph --version
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] ceph version 10.2.10 (5dc1e4c05cb68dbf62ae6fce3f0700e4654fdbbe)
[ceph_deploy.install][DEBUG ] Detecting platform for host gke-cluster-1-default-pool-72415711-6rvw ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect machine type
[ceph_deploy.install][INFO  ] Distro info: Ubuntu 16.04 xenial
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] installing Ceph on gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo env DEBIAN_FRONTEND=noninteractive DEBIAN_PRIORITY=critical apt-get --assume-yes -q --no-install-recommends install ca-certificates apt-transport-https
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Reading package lists...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Building dependency tree...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Reading state information...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] apt-transport-https is already the newest version (1.2.24).
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] The following packages will be upgraded:
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   ca-certificates
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] 1 upgraded, 0 newly installed, 0 to remove and 104 not upgraded.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Need to get 168 kB of archives.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] After this operation, 60.4 kB disk space will be freed.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:1 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 ca-certificates all 20170717~16.04.1 [168 kB]
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] perl: warning: Setting locale failed.
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] perl: warning: Please check that your locale settings:
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] 	LANGUAGE = (unset),
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] 	LC_ALL = (unset),
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] 	LC_CTYPE = "zh_CN.UTF-8",
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] 	LANG = "en_US.UTF-8"
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN]     are supported and installed on your system.
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] perl: warning: Falling back to a fallback locale ("en_US.UTF-8").
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] locale: Cannot set LC_CTYPE to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] locale: Cannot set LC_ALL to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preconfiguring packages ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Fetched 168 kB in 0s (0 B/s)
(Reading database ... 55751 files and directories currently installed.).
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../ca-certificates_20170717~16.04.1_all.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking ca-certificates (20170717~16.04.1) over (20160104ubuntu1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Processing triggers for man-db (2.7.5-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up ca-certificates (20170717~16.04.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] locale: Cannot set LC_CTYPE to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] locale: Cannot set LC_ALL to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Processing triggers for ca-certificates (20170717~16.04.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Updating certificates in /etc/ssl/certs...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] 17 added, 42 removed; done.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Running hooks in /etc/ca-certificates/update.d...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] done.
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo wget -O release.asc https://download.ceph.com/keys/release.asc
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] --2017-12-04 04:22:51--  https://download.ceph.com/keys/release.asc
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:443... connected.
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] HTTP request sent, awaiting response... 200 OK
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] Length: 1645 (1.6K) [application/octet-stream]
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] Saving to: 'release.asc'
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN]
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN]      0K .                                                     100%  323M=0s
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN]
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] 2017-12-04 04:22:52 (323 MB/s) - 'release.asc' saved [1645/1645]
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN]
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo apt-key add release.asc
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] OK
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] add deb repo to /etc/apt/sources.list.d/
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo env DEBIAN_FRONTEND=noninteractive DEBIAN_PRIORITY=critical apt-get --assume-yes -q update
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Hit:1 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial InRelease
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Hit:2 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates InRelease
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Hit:3 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-backports InRelease
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Hit:4 http://security.ubuntu.com/ubuntu xenial-security InRelease
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Hit:5 https://download.ceph.com/debian-jewel xenial InRelease
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Reading package lists...
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo env DEBIAN_FRONTEND=noninteractive DEBIAN_PRIORITY=critical apt-get --assume-yes -q --no-install-recommends install -o Dpkg::Options::=--force-confnew ceph ceph-osd ceph-mds ceph-mon radosgw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Reading package lists...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Building dependency tree...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Reading state information...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] The following additional packages will be installed:
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   binutils ceph-base ceph-common libaio1 libbabeltrace-ctf1 libbabeltrace1
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   libboost-iostreams1.58.0 libboost-program-options1.58.0
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   libboost-random1.58.0 libboost-regex1.58.0 libboost-system1.58.0
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   libboost-thread1.58.0 libcephfs1 libfcgi0ldbl libgoogle-perftools4
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   libjs-jquery libleveldb1v5 liblttng-ust-ctl2 liblttng-ust0 libnspr4 libnss3
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   libnss3-nssdb librados2 libradosstriper1 librbd1 librgw2 libsnappy1v5
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   libtcmalloc-minimal4 libunwind8 liburcu4 python-cephfs python-chardet
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   python-flask python-itsdangerous python-jinja2 python-markupsafe
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   python-pkg-resources python-rados python-rbd python-requests python-six
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   python-urllib3 python-werkzeug
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Suggested packages:
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   binutils-doc python-flask-doc python-jinja2-doc python-setuptools
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   python-ndg-httpsclient python-openssl python-pyasn1 python-ntlm ipython
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   python-genshi python-lxml python-greenlet python-redis python-pylibmc
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   | python-memcache python-werkzeug-doc
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Recommended packages:
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   ceph-fs-common ceph-fuse javascript-common python-blinker
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   python-ndg-httpsclient python-openssl python-pyasn1 python-pyinotify
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] The following NEW packages will be installed:
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   binutils ceph ceph-base ceph-common ceph-mds ceph-mon ceph-osd libaio1
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   libbabeltrace-ctf1 libbabeltrace1 libboost-iostreams1.58.0
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   libboost-program-options1.58.0 libboost-random1.58.0 libboost-regex1.58.0
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   libboost-system1.58.0 libboost-thread1.58.0 libcephfs1 libfcgi0ldbl
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   libgoogle-perftools4 libjs-jquery libleveldb1v5 liblttng-ust-ctl2
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   liblttng-ust0 libnspr4 libnss3 libnss3-nssdb librados2 libradosstriper1
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   librbd1 librgw2 libsnappy1v5 libtcmalloc-minimal4 libunwind8 liburcu4
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   python-cephfs python-chardet python-flask python-itsdangerous python-jinja2
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   python-markupsafe python-pkg-resources python-rados python-rbd
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   python-requests python-six python-urllib3 python-werkzeug radosgw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] 0 upgraded, 48 newly installed, 0 to remove and 104 not upgraded.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Need to get 115 MB of archives.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] After this operation, 538 MB of additional disk space will be used.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:1 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 binutils amd64 2.26.1-1ubuntu1~16.04.5 [2311 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:2 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-iostreams1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [29.0 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:3 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-system1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [9146 B]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:4 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-random1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [11.7 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:5 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-thread1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [47.0 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:6 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/universe amd64 liburcu4 amd64 0.9.1-3 [47.3 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:7 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/universe amd64 liblttng-ust-ctl2 amd64 2.7.1-1 [72.2 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:8 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/universe amd64 liblttng-ust0 amd64 2.7.1-1 [127 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:9 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libnspr4 amd64 2:4.13.1-0ubuntu0.16.04.1 [112 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:10 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libnss3-nssdb all 2:3.28.4-0ubuntu0.16.04.3 [10.6 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:11 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libnss3 amd64 2:3.28.4-0ubuntu0.16.04.3 [1148 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:12 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libbabeltrace1 amd64 1.3.2-1 [34.7 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:13 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libbabeltrace-ctf1 amd64 1.3.2-1 [88.3 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:14 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-program-options1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [138 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:15 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-regex1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [261 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:16 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libtcmalloc-minimal4 amd64 2.4-0ubuntu5.16.04.1 [105 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:17 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libunwind8 amd64 1.1-4.1 [46.5 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:18 https://download.ceph.com/debian-jewel xenial/main amd64 librados2 amd64 10.2.10-1xenial [2843 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:19 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libgoogle-perftools4 amd64 2.4-0ubuntu5.16.04.1 [187 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:20 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libfcgi0ldbl amd64 2.4.0-8.3 [161 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:21 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-six all 1.10.0-3 [10.9 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:22 https://download.ceph.com/debian-jewel xenial/main amd64 librbd1 amd64 10.2.10-1xenial [3367 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:23 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 python-urllib3 all 1.13.1-2ubuntu0.16.04.1 [57.2 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:24 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-pkg-resources all 20.7.0-1 [108 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:25 https://download.ceph.com/debian-jewel xenial/main amd64 libradosstriper1 amd64 10.2.10-1xenial [2904 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:26 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-chardet all 2.3.0-2 [96.3 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:27 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-requests all 2.9.1-3 [55.6 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:28 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-itsdangerous all 0.24+dfsg1-1 [12.0 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:29 https://download.ceph.com/debian-jewel xenial/main amd64 librgw2 amd64 10.2.10-1xenial [4048 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:30 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-markupsafe amd64 0.23-2build2 [15.5 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:31 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-jinja2 all 2.8-1 [109 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:32 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libjs-jquery all 1.11.3+dfsg-4 [161 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:33 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 python-werkzeug all 0.10.4+dfsg1-1ubuntu1.1 [162 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:34 https://download.ceph.com/debian-jewel xenial/main amd64 python-rados amd64 10.2.10-1xenial [1775 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:35 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-flask all 0.10.1-2build2 [51.8 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:36 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libsnappy1v5 amd64 1.1.3-2 [16.0 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:37 https://download.ceph.com/debian-jewel xenial/main amd64 libcephfs1 amd64 10.2.10-1xenial [2950 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:38 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libleveldb1v5 amd64 1.18-5 [132 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:39 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libaio1 amd64 0.3.110-2 [6356 B]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:40 https://download.ceph.com/debian-jewel xenial/main amd64 python-cephfs amd64 10.2.10-1xenial [1362 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:41 https://download.ceph.com/debian-jewel xenial/main amd64 python-rbd amd64 10.2.10-1xenial [1449 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:42 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-common amd64 10.2.10-1xenial [15.5 MB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:43 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-base amd64 10.2.10-1xenial [50.5 MB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:44 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-mon amd64 10.2.10-1xenial [3811 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:45 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-osd amd64 10.2.10-1xenial [11.8 MB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:46 https://download.ceph.com/debian-jewel xenial/main amd64 ceph amd64 10.2.10-1xenial [1141 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:47 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-mds amd64 10.2.10-1xenial [3842 kB]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Get:48 https://download.ceph.com/debian-jewel xenial/main amd64 radosgw amd64 10.2.10-1xenial [1405 kB]
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] perl: warning: Setting locale failed.
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] perl: warning: Please check that your locale settings:
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] 	LANGUAGE = (unset),
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] 	LC_ALL = (unset),
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] 	LC_CTYPE = "zh_CN.UTF-8",
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] 	LANG = "en_US.UTF-8"
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN]     are supported and installed on your system.
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] perl: warning: Falling back to a fallback locale ("en_US.UTF-8").
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] locale: Cannot set LC_CTYPE to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] locale: Cannot set LC_ALL to default locale: No such file or directory
Extracting templates from packages: 100%w][WARNIN]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Fetched 115 MB in 27s (4206 kB/s)
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package binutils.
(Reading database ... 55725 files and directories currently installed.).
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../binutils_2.26.1-1ubuntu1~16.04.5_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking binutils (2.26.1-1ubuntu1~16.04.5) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libboost-iostreams1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libboost-iostreams1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libboost-iostreams1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libboost-system1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libboost-system1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libboost-system1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libboost-random1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libboost-random1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libboost-random1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libboost-thread1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libboost-thread1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libboost-thread1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package liburcu4:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../liburcu4_0.9.1-3_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking liburcu4:amd64 (0.9.1-3) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package liblttng-ust-ctl2:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../liblttng-ust-ctl2_2.7.1-1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking liblttng-ust-ctl2:amd64 (2.7.1-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package liblttng-ust0:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../liblttng-ust0_2.7.1-1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking liblttng-ust0:amd64 (2.7.1-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libnspr4:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libnspr4_2%3a4.13.1-0ubuntu0.16.04.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libnspr4:amd64 (2:4.13.1-0ubuntu0.16.04.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libnss3-nssdb.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libnss3-nssdb_2%3a3.28.4-0ubuntu0.16.04.3_all.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libnss3-nssdb (2:3.28.4-0ubuntu0.16.04.3) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libnss3:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libnss3_2%3a3.28.4-0ubuntu0.16.04.3_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libnss3:amd64 (2:3.28.4-0ubuntu0.16.04.3) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package librados2.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../librados2_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking librados2 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package librbd1.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../librbd1_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking librbd1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libbabeltrace1:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libbabeltrace1_1.3.2-1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libbabeltrace1:amd64 (1.3.2-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libbabeltrace-ctf1:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libbabeltrace-ctf1_1.3.2-1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libbabeltrace-ctf1:amd64 (1.3.2-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libboost-program-options1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libboost-program-options1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libboost-program-options1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libboost-regex1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libboost-regex1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libboost-regex1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libtcmalloc-minimal4.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libtcmalloc-minimal4_2.4-0ubuntu5.16.04.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libtcmalloc-minimal4 (2.4-0ubuntu5.16.04.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libunwind8.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libunwind8_1.1-4.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libunwind8 (1.1-4.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libgoogle-perftools4.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libgoogle-perftools4_2.4-0ubuntu5.16.04.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libgoogle-perftools4 (2.4-0ubuntu5.16.04.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libradosstriper1.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libradosstriper1_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libradosstriper1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libfcgi0ldbl.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libfcgi0ldbl_2.4.0-8.3_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libfcgi0ldbl (2.4.0-8.3) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package librgw2.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../librgw2_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking librgw2 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package python-rados.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../python-rados_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking python-rados (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libcephfs1.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libcephfs1_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libcephfs1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package python-cephfs.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../python-cephfs_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking python-cephfs (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package python-rbd.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../python-rbd_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking python-rbd (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package python-six.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../python-six_1.10.0-3_all.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking python-six (1.10.0-3) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package python-urllib3.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../python-urllib3_1.13.1-2ubuntu0.16.04.1_all.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking python-urllib3 (1.13.1-2ubuntu0.16.04.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package python-pkg-resources.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../python-pkg-resources_20.7.0-1_all.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking python-pkg-resources (20.7.0-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package python-chardet.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../python-chardet_2.3.0-2_all.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking python-chardet (2.3.0-2) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package python-requests.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../python-requests_2.9.1-3_all.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking python-requests (2.9.1-3) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package ceph-common.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../ceph-common_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking ceph-common (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package ceph-base.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../ceph-base_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking ceph-base (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package python-itsdangerous.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../python-itsdangerous_0.24+dfsg1-1_all.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking python-itsdangerous (0.24+dfsg1-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package python-markupsafe.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../python-markupsafe_0.23-2build2_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking python-markupsafe (0.23-2build2) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package python-jinja2.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../python-jinja2_2.8-1_all.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking python-jinja2 (2.8-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libjs-jquery.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libjs-jquery_1.11.3+dfsg-4_all.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libjs-jquery (1.11.3+dfsg-4) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package python-werkzeug.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../python-werkzeug_0.10.4+dfsg1-1ubuntu1.1_all.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking python-werkzeug (0.10.4+dfsg1-1ubuntu1.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package python-flask.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../python-flask_0.10.1-2build2_all.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking python-flask (0.10.1-2build2) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libsnappy1v5:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libsnappy1v5_1.1.3-2_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libsnappy1v5:amd64 (1.1.3-2) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libleveldb1v5:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libleveldb1v5_1.18-5_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libleveldb1v5:amd64 (1.18-5) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package ceph-mon.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../ceph-mon_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking ceph-mon (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package libaio1:amd64.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../libaio1_0.3.110-2_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking libaio1:amd64 (0.3.110-2) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package ceph-osd.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../ceph-osd_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking ceph-osd (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package ceph.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../ceph_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking ceph (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package ceph-mds.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../ceph-mds_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking ceph-mds (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Selecting previously unselected package radosgw.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Preparing to unpack .../radosgw_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Unpacking radosgw (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Processing triggers for libc-bin (2.23-0ubuntu9) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Processing triggers for man-db (2.7.5-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Processing triggers for systemd (229-4ubuntu19) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Processing triggers for ureadahead (0.100.0-19) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up binutils (2.26.1-1ubuntu1~16.04.5) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libboost-iostreams1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libboost-system1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libboost-random1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libboost-thread1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up liburcu4:amd64 (0.9.1-3) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up liblttng-ust-ctl2:amd64 (2.7.1-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up liblttng-ust0:amd64 (2.7.1-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libnspr4:amd64 (2:4.13.1-0ubuntu0.16.04.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libbabeltrace1:amd64 (1.3.2-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libbabeltrace-ctf1:amd64 (1.3.2-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libboost-program-options1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libboost-regex1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libtcmalloc-minimal4 (2.4-0ubuntu5.16.04.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libunwind8 (1.1-4.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libgoogle-perftools4 (2.4-0ubuntu5.16.04.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libfcgi0ldbl (2.4.0-8.3) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up python-six (1.10.0-3) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up python-urllib3 (1.13.1-2ubuntu0.16.04.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up python-pkg-resources (20.7.0-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up python-chardet (2.3.0-2) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up python-requests (2.9.1-3) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up python-itsdangerous (0.24+dfsg1-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up python-markupsafe (0.23-2build2) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up python-jinja2 (2.8-1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libjs-jquery (1.11.3+dfsg-4) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up python-werkzeug (0.10.4+dfsg1-1ubuntu1.1) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up python-flask (0.10.1-2build2) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libsnappy1v5:amd64 (1.1.3-2) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libleveldb1v5:amd64 (1.18-5) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libaio1:amd64 (0.3.110-2) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libnss3-nssdb (2:3.28.4-0ubuntu0.16.04.3) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libnss3:amd64 (2:3.28.4-0ubuntu0.16.04.3) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up librados2 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up librbd1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libradosstriper1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up librgw2 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up python-rados (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up libcephfs1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up python-cephfs (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up python-rbd (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up ceph-common (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Adding group ceph....done
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Adding system user ceph....done
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting system user ceph properties....done
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up ceph-base (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up ceph-mon (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up ceph-osd (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up ceph (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up ceph-mds (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting up radosgw (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Processing triggers for libc-bin (2.23-0ubuntu9) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Processing triggers for systemd (229-4ubuntu19) ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Processing triggers for ureadahead (0.100.0-19) ...
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo ceph --version
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] ceph version 10.2.10 (5dc1e4c05cb68dbf62ae6fce3f0700e4654fdbbe)
[ceph_deploy.install][DEBUG ] Detecting platform for host gke-cluster-1-default-pool-72415711-b3h4 ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect machine type
[ceph_deploy.install][INFO  ] Distro info: Ubuntu 16.04 xenial
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] installing Ceph on gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo env DEBIAN_FRONTEND=noninteractive DEBIAN_PRIORITY=critical apt-get --assume-yes -q --no-install-recommends install ca-certificates apt-transport-https
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Reading package lists...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Building dependency tree...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Reading state information...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] apt-transport-https is already the newest version (1.2.24).
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] The following packages will be upgraded:
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   ca-certificates
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] 1 upgraded, 0 newly installed, 0 to remove and 104 not upgraded.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Need to get 168 kB of archives.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] After this operation, 60.4 kB disk space will be freed.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:1 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 ca-certificates all 20170717~16.04.1 [168 kB]
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] perl: warning: Setting locale failed.
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] perl: warning: Please check that your locale settings:
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] 	LANGUAGE = (unset),
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] 	LC_ALL = (unset),
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] 	LC_CTYPE = "zh_CN.UTF-8",
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] 	LANG = "en_US.UTF-8"
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN]     are supported and installed on your system.
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] perl: warning: Falling back to a fallback locale ("en_US.UTF-8").
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] locale: Cannot set LC_CTYPE to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] locale: Cannot set LC_ALL to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preconfiguring packages ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Fetched 168 kB in 0s (14.9 MB/s)
(Reading database ... 55751 files and directories currently installed.).
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../ca-certificates_20170717~16.04.1_all.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking ca-certificates (20170717~16.04.1) over (20160104ubuntu1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Processing triggers for man-db (2.7.5-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up ca-certificates (20170717~16.04.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] locale: Cannot set LC_CTYPE to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] locale: Cannot set LC_ALL to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Processing triggers for ca-certificates (20170717~16.04.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Updating certificates in /etc/ssl/certs...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] 17 added, 42 removed; done.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Running hooks in /etc/ca-certificates/update.d...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] done.
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo wget -O release.asc https://download.ceph.com/keys/release.asc
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] --2017-12-04 04:23:58--  https://download.ceph.com/keys/release.asc
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:443... connected.
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] HTTP request sent, awaiting response... 200 OK
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] Length: 1645 (1.6K) [application/octet-stream]
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] Saving to: 'release.asc'
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN]
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN]      0K .                                                     100%  505M=0s
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN]
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] 2017-12-04 04:23:59 (505 MB/s) - 'release.asc' saved [1645/1645]
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN]
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo apt-key add release.asc
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] OK
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] add deb repo to /etc/apt/sources.list.d/
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo env DEBIAN_FRONTEND=noninteractive DEBIAN_PRIORITY=critical apt-get --assume-yes -q update
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Hit:1 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial InRelease
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Hit:2 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates InRelease
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Hit:3 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-backports InRelease
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Hit:4 http://security.ubuntu.com/ubuntu xenial-security InRelease
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Hit:5 https://download.ceph.com/debian-jewel xenial InRelease
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Reading package lists...
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo env DEBIAN_FRONTEND=noninteractive DEBIAN_PRIORITY=critical apt-get --assume-yes -q --no-install-recommends install -o Dpkg::Options::=--force-confnew ceph ceph-osd ceph-mds ceph-mon radosgw
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Reading package lists...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Building dependency tree...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Reading state information...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] The following additional packages will be installed:
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   binutils ceph-base ceph-common libaio1 libbabeltrace-ctf1 libbabeltrace1
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   libboost-iostreams1.58.0 libboost-program-options1.58.0
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   libboost-random1.58.0 libboost-regex1.58.0 libboost-system1.58.0
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   libboost-thread1.58.0 libcephfs1 libfcgi0ldbl libgoogle-perftools4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   libjs-jquery libleveldb1v5 liblttng-ust-ctl2 liblttng-ust0 libnspr4 libnss3
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   libnss3-nssdb librados2 libradosstriper1 librbd1 librgw2 libsnappy1v5
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   libtcmalloc-minimal4 libunwind8 liburcu4 python-cephfs python-chardet
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   python-flask python-itsdangerous python-jinja2 python-markupsafe
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   python-pkg-resources python-rados python-rbd python-requests python-six
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   python-urllib3 python-werkzeug
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Suggested packages:
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   binutils-doc python-flask-doc python-jinja2-doc python-setuptools
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   python-ndg-httpsclient python-openssl python-pyasn1 python-ntlm ipython
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   python-genshi python-lxml python-greenlet python-redis python-pylibmc
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   | python-memcache python-werkzeug-doc
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Recommended packages:
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   ceph-fs-common ceph-fuse javascript-common python-blinker
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   python-ndg-httpsclient python-openssl python-pyasn1 python-pyinotify
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] The following NEW packages will be installed:
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   binutils ceph ceph-base ceph-common ceph-mds ceph-mon ceph-osd libaio1
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   libbabeltrace-ctf1 libbabeltrace1 libboost-iostreams1.58.0
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   libboost-program-options1.58.0 libboost-random1.58.0 libboost-regex1.58.0
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   libboost-system1.58.0 libboost-thread1.58.0 libcephfs1 libfcgi0ldbl
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   libgoogle-perftools4 libjs-jquery libleveldb1v5 liblttng-ust-ctl2
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   liblttng-ust0 libnspr4 libnss3 libnss3-nssdb librados2 libradosstriper1
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   librbd1 librgw2 libsnappy1v5 libtcmalloc-minimal4 libunwind8 liburcu4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   python-cephfs python-chardet python-flask python-itsdangerous python-jinja2
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   python-markupsafe python-pkg-resources python-rados python-rbd
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   python-requests python-six python-urllib3 python-werkzeug radosgw
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] 0 upgraded, 48 newly installed, 0 to remove and 104 not upgraded.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Need to get 115 MB of archives.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] After this operation, 538 MB of additional disk space will be used.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:1 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 binutils amd64 2.26.1-1ubuntu1~16.04.5 [2311 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:2 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-iostreams1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [29.0 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:3 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-system1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [9146 B]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:4 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-random1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [11.7 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:5 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-thread1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [47.0 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:6 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/universe amd64 liburcu4 amd64 0.9.1-3 [47.3 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:7 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/universe amd64 liblttng-ust-ctl2 amd64 2.7.1-1 [72.2 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:8 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/universe amd64 liblttng-ust0 amd64 2.7.1-1 [127 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:9 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libnspr4 amd64 2:4.13.1-0ubuntu0.16.04.1 [112 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:10 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libnss3-nssdb all 2:3.28.4-0ubuntu0.16.04.3 [10.6 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:11 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libnss3 amd64 2:3.28.4-0ubuntu0.16.04.3 [1148 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:12 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libbabeltrace1 amd64 1.3.2-1 [34.7 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:13 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libbabeltrace-ctf1 amd64 1.3.2-1 [88.3 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:14 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-program-options1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [138 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:15 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libboost-regex1.58.0 amd64 1.58.0+dfsg-5ubuntu3.1 [261 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:16 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libtcmalloc-minimal4 amd64 2.4-0ubuntu5.16.04.1 [105 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:17 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libunwind8 amd64 1.1-4.1 [46.5 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:18 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 libgoogle-perftools4 amd64 2.4-0ubuntu5.16.04.1 [187 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:19 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libfcgi0ldbl amd64 2.4.0-8.3 [161 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:20 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-six all 1.10.0-3 [10.9 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:21 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 python-urllib3 all 1.13.1-2ubuntu0.16.04.1 [57.2 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:22 https://download.ceph.com/debian-jewel xenial/main amd64 librados2 amd64 10.2.10-1xenial [2843 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:23 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-pkg-resources all 20.7.0-1 [108 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:24 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-chardet all 2.3.0-2 [96.3 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:25 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-requests all 2.9.1-3 [55.6 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:26 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-itsdangerous all 0.24+dfsg1-1 [12.0 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:27 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-markupsafe amd64 0.23-2build2 [15.5 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:28 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-jinja2 all 2.8-1 [109 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:29 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libjs-jquery all 1.11.3+dfsg-4 [161 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:30 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial-updates/main amd64 python-werkzeug all 0.10.4+dfsg1-1ubuntu1.1 [162 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:31 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 python-flask all 0.10.1-2build2 [51.8 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:32 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libsnappy1v5 amd64 1.1.3-2 [16.0 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:33 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libleveldb1v5 amd64 1.18-5 [132 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:34 http://asia-east1.gce.archive.ubuntu.com/ubuntu xenial/main amd64 libaio1 amd64 0.3.110-2 [6356 B]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:35 https://download.ceph.com/debian-jewel xenial/main amd64 librbd1 amd64 10.2.10-1xenial [3367 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:36 https://download.ceph.com/debian-jewel xenial/main amd64 libradosstriper1 amd64 10.2.10-1xenial [2904 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:37 https://download.ceph.com/debian-jewel xenial/main amd64 librgw2 amd64 10.2.10-1xenial [4048 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:38 https://download.ceph.com/debian-jewel xenial/main amd64 python-rados amd64 10.2.10-1xenial [1775 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:39 https://download.ceph.com/debian-jewel xenial/main amd64 libcephfs1 amd64 10.2.10-1xenial [2950 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:40 https://download.ceph.com/debian-jewel xenial/main amd64 python-cephfs amd64 10.2.10-1xenial [1362 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:41 https://download.ceph.com/debian-jewel xenial/main amd64 python-rbd amd64 10.2.10-1xenial [1449 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:42 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-common amd64 10.2.10-1xenial [15.5 MB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:43 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-base amd64 10.2.10-1xenial [50.5 MB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:44 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-mon amd64 10.2.10-1xenial [3811 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:45 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-osd amd64 10.2.10-1xenial [11.8 MB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:46 https://download.ceph.com/debian-jewel xenial/main amd64 ceph amd64 10.2.10-1xenial [1141 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:47 https://download.ceph.com/debian-jewel xenial/main amd64 ceph-mds amd64 10.2.10-1xenial [3842 kB]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Get:48 https://download.ceph.com/debian-jewel xenial/main amd64 radosgw amd64 10.2.10-1xenial [1405 kB]
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] perl: warning: Setting locale failed.
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] perl: warning: Please check that your locale settings:
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] 	LANGUAGE = (unset),
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] 	LC_ALL = (unset),
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] 	LC_CTYPE = "zh_CN.UTF-8",
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] 	LANG = "en_US.UTF-8"
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN]     are supported and installed on your system.
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] perl: warning: Falling back to a fallback locale ("en_US.UTF-8").
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] locale: Cannot set LC_CTYPE to default locale: No such file or directory
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] locale: Cannot set LC_ALL to default locale: No such file or directory
Extracting templates from packages: 100%4][WARNIN]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Fetched 115 MB in 43s (2609 kB/s)
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package binutils.
(Reading database ... 55725 files and directories currently installed.).
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../binutils_2.26.1-1ubuntu1~16.04.5_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking binutils (2.26.1-1ubuntu1~16.04.5) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libboost-iostreams1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libboost-iostreams1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libboost-iostreams1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libboost-system1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libboost-system1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libboost-system1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libboost-random1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libboost-random1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libboost-random1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libboost-thread1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libboost-thread1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libboost-thread1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package liburcu4:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../liburcu4_0.9.1-3_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking liburcu4:amd64 (0.9.1-3) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package liblttng-ust-ctl2:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../liblttng-ust-ctl2_2.7.1-1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking liblttng-ust-ctl2:amd64 (2.7.1-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package liblttng-ust0:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../liblttng-ust0_2.7.1-1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking liblttng-ust0:amd64 (2.7.1-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libnspr4:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libnspr4_2%3a4.13.1-0ubuntu0.16.04.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libnspr4:amd64 (2:4.13.1-0ubuntu0.16.04.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libnss3-nssdb.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libnss3-nssdb_2%3a3.28.4-0ubuntu0.16.04.3_all.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libnss3-nssdb (2:3.28.4-0ubuntu0.16.04.3) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libnss3:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libnss3_2%3a3.28.4-0ubuntu0.16.04.3_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libnss3:amd64 (2:3.28.4-0ubuntu0.16.04.3) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package librados2.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../librados2_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking librados2 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package librbd1.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../librbd1_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking librbd1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libbabeltrace1:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libbabeltrace1_1.3.2-1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libbabeltrace1:amd64 (1.3.2-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libbabeltrace-ctf1:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libbabeltrace-ctf1_1.3.2-1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libbabeltrace-ctf1:amd64 (1.3.2-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libboost-program-options1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libboost-program-options1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libboost-program-options1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libboost-regex1.58.0:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libboost-regex1.58.0_1.58.0+dfsg-5ubuntu3.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libboost-regex1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libtcmalloc-minimal4.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libtcmalloc-minimal4_2.4-0ubuntu5.16.04.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libtcmalloc-minimal4 (2.4-0ubuntu5.16.04.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libunwind8.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libunwind8_1.1-4.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libunwind8 (1.1-4.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libgoogle-perftools4.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libgoogle-perftools4_2.4-0ubuntu5.16.04.1_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libgoogle-perftools4 (2.4-0ubuntu5.16.04.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libradosstriper1.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libradosstriper1_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libradosstriper1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libfcgi0ldbl.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libfcgi0ldbl_2.4.0-8.3_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libfcgi0ldbl (2.4.0-8.3) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package librgw2.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../librgw2_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking librgw2 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package python-rados.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../python-rados_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking python-rados (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libcephfs1.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libcephfs1_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libcephfs1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package python-cephfs.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../python-cephfs_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking python-cephfs (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package python-rbd.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../python-rbd_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking python-rbd (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package python-six.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../python-six_1.10.0-3_all.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking python-six (1.10.0-3) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package python-urllib3.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../python-urllib3_1.13.1-2ubuntu0.16.04.1_all.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking python-urllib3 (1.13.1-2ubuntu0.16.04.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package python-pkg-resources.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../python-pkg-resources_20.7.0-1_all.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking python-pkg-resources (20.7.0-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package python-chardet.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../python-chardet_2.3.0-2_all.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking python-chardet (2.3.0-2) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package python-requests.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../python-requests_2.9.1-3_all.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking python-requests (2.9.1-3) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package ceph-common.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../ceph-common_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking ceph-common (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package ceph-base.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../ceph-base_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking ceph-base (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package python-itsdangerous.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../python-itsdangerous_0.24+dfsg1-1_all.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking python-itsdangerous (0.24+dfsg1-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package python-markupsafe.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../python-markupsafe_0.23-2build2_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking python-markupsafe (0.23-2build2) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package python-jinja2.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../python-jinja2_2.8-1_all.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking python-jinja2 (2.8-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libjs-jquery.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libjs-jquery_1.11.3+dfsg-4_all.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libjs-jquery (1.11.3+dfsg-4) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package python-werkzeug.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../python-werkzeug_0.10.4+dfsg1-1ubuntu1.1_all.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking python-werkzeug (0.10.4+dfsg1-1ubuntu1.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package python-flask.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../python-flask_0.10.1-2build2_all.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking python-flask (0.10.1-2build2) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libsnappy1v5:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libsnappy1v5_1.1.3-2_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libsnappy1v5:amd64 (1.1.3-2) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libleveldb1v5:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libleveldb1v5_1.18-5_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libleveldb1v5:amd64 (1.18-5) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package ceph-mon.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../ceph-mon_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking ceph-mon (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package libaio1:amd64.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../libaio1_0.3.110-2_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking libaio1:amd64 (0.3.110-2) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package ceph-osd.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../ceph-osd_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking ceph-osd (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package ceph.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../ceph_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking ceph (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package ceph-mds.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../ceph-mds_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking ceph-mds (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Selecting previously unselected package radosgw.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Preparing to unpack .../radosgw_10.2.10-1xenial_amd64.deb ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Unpacking radosgw (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Processing triggers for libc-bin (2.23-0ubuntu9) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Processing triggers for man-db (2.7.5-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Processing triggers for systemd (229-4ubuntu19) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Processing triggers for ureadahead (0.100.0-19) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up binutils (2.26.1-1ubuntu1~16.04.5) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libboost-iostreams1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libboost-system1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libboost-random1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libboost-thread1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up liburcu4:amd64 (0.9.1-3) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up liblttng-ust-ctl2:amd64 (2.7.1-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up liblttng-ust0:amd64 (2.7.1-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libnspr4:amd64 (2:4.13.1-0ubuntu0.16.04.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libbabeltrace1:amd64 (1.3.2-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libbabeltrace-ctf1:amd64 (1.3.2-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libboost-program-options1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libboost-regex1.58.0:amd64 (1.58.0+dfsg-5ubuntu3.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libtcmalloc-minimal4 (2.4-0ubuntu5.16.04.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libunwind8 (1.1-4.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libgoogle-perftools4 (2.4-0ubuntu5.16.04.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libfcgi0ldbl (2.4.0-8.3) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up python-six (1.10.0-3) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up python-urllib3 (1.13.1-2ubuntu0.16.04.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up python-pkg-resources (20.7.0-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up python-chardet (2.3.0-2) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up python-requests (2.9.1-3) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up python-itsdangerous (0.24+dfsg1-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up python-markupsafe (0.23-2build2) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up python-jinja2 (2.8-1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libjs-jquery (1.11.3+dfsg-4) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up python-werkzeug (0.10.4+dfsg1-1ubuntu1.1) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up python-flask (0.10.1-2build2) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libsnappy1v5:amd64 (1.1.3-2) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libleveldb1v5:amd64 (1.18-5) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libaio1:amd64 (0.3.110-2) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libnss3-nssdb (2:3.28.4-0ubuntu0.16.04.3) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libnss3:amd64 (2:3.28.4-0ubuntu0.16.04.3) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up librados2 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up librbd1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libradosstriper1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up librgw2 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up python-rados (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up libcephfs1 (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up python-cephfs (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up python-rbd (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up ceph-common (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Adding group ceph....done
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Adding system user ceph....done
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting system user ceph properties....done
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up ceph-base (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up ceph-mon (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up ceph-osd (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up ceph (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up ceph-mds (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting up radosgw (10.2.10-1xenial) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Processing triggers for libc-bin (2.23-0ubuntu9) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Processing triggers for systemd (229-4ubuntu19) ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Processing triggers for ureadahead (0.100.0-19) ...
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo ceph --version
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] ceph version 10.2.10 (5dc1e4c05cb68dbf62ae6fce3f0700e4654fdbbe)

配置初始 monitor(s)、并收集所有密钥:

$ ceph-deploy mon create-initial
执行过程
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/shilei/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (1.5.39): /usr/bin/ceph-deploy mon create-initial
[ceph_deploy.cli][INFO  ] ceph-deploy options:
[ceph_deploy.cli][INFO  ]  username                      : None
[ceph_deploy.cli][INFO  ]  verbose                       : False
[ceph_deploy.cli][INFO  ]  overwrite_conf                : False
[ceph_deploy.cli][INFO  ]  subcommand                    : create-initial
[ceph_deploy.cli][INFO  ]  quiet                         : False
[ceph_deploy.cli][INFO  ]  cd_conf                       : <ceph_deploy.conf.cephdeploy.Conf instance at 0x7f719660afc8>
[ceph_deploy.cli][INFO  ]  cluster                       : ceph
[ceph_deploy.cli][INFO  ]  func                          : <function mon at 0x7f71965e65f0>
[ceph_deploy.cli][INFO  ]  ceph_conf                     : None
[ceph_deploy.cli][INFO  ]  keyrings                      : None
[ceph_deploy.cli][INFO  ]  default_release               : False
[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts gke-cluster-1-default-pool-72415711-4vx2 gke-cluster-1-default-pool-72415711-6rvw gke-cluster-1-default-pool-72415711-b3h4
[ceph_deploy.mon][DEBUG ] detecting platform for host gke-cluster-1-default-pool-72415711-4vx2 ...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] find the location of an executable
[ceph_deploy.mon][INFO  ] distro info: Ubuntu 16.04 xenial
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] determining if provided host has same hostname in remote
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] get remote short hostname
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] deploying mon to gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] get remote short hostname
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] remote hostname: gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] create the mon path if it does not exist
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-4vx2/done
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-4vx2/done
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] creating keyring file: /var/lib/ceph/tmp/ceph-gke-cluster-1-default-pool-72415711-4vx2.mon.keyring
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] create the monitor keyring file
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo ceph-mon --cluster ceph --mkfs -i gke-cluster-1-default-pool-72415711-4vx2 --keyring /var/lib/ceph/tmp/ceph-gke-cluster-1-default-pool-72415711-4vx2.mon.keyring --setuser 64045 --setgroup 64045
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] ceph-mon: mon.noname-a 10.140.0.4:6789/0 is local, renaming to mon.gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] ceph-mon: set fsid to 7bdb1d81-efdc-4a54-a328-87b7841df4b5
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-4vx2 for mon.gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] unlinking keyring file /var/lib/ceph/tmp/ceph-gke-cluster-1-default-pool-72415711-4vx2.mon.keyring
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] create a done file to avoid re-doing the mon deployment
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] create the init path if it does not exist
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo systemctl enable ceph.target
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo systemctl enable ceph-mon@gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] Created symlink from /etc/systemd/system/ceph-mon.target.wants/ceph-mon@gke-cluster-1-default-pool-72415711-4vx2.service to /lib/systemd/system/ceph-mon@.service.
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo systemctl start ceph-mon@gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.gke-cluster-1-default-pool-72415711-4vx2.asok mon_status
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] ********************************************************************************
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] status for monitor: mon.gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] {
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   "election_epoch": 0,
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   "extra_probe_peers": [
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]     "10.140.0.2:6789/0",
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]     "10.140.0.3:6789/0"
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   ],
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   "monmap": {
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]     "created": "2017-12-04 04:26:57.271964",
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]     "epoch": 0,
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]     "fsid": "7bdb1d81-efdc-4a54-a328-87b7841df4b5",
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]     "modified": "2017-12-04 04:26:57.271964",
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]     "mons": [
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]       {
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]         "addr": "10.140.0.4:6789/0",
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]         "name": "gke-cluster-1-default-pool-72415711-4vx2",
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]         "rank": 0
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]       },
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]       {
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]         "addr": "0.0.0.0:0/1",
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]         "name": "gke-cluster-1-default-pool-72415711-6rvw",
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]         "rank": 1
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]       },
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]       {
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]         "addr": "0.0.0.0:0/2",
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]         "name": "gke-cluster-1-default-pool-72415711-b3h4",
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]         "rank": 2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]       }
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]     ]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   },
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   "name": "gke-cluster-1-default-pool-72415711-4vx2",
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   "outside_quorum": [
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]     "gke-cluster-1-default-pool-72415711-4vx2"
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   ],
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   "quorum": [],
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   "rank": 0,
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   "state": "probing",
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]   "sync_provider": []
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] }
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] ********************************************************************************
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] monitor: mon.gke-cluster-1-default-pool-72415711-4vx2 is running
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.gke-cluster-1-default-pool-72415711-4vx2.asok mon_status
[ceph_deploy.mon][DEBUG ] detecting platform for host gke-cluster-1-default-pool-72415711-6rvw ...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] find the location of an executable
[ceph_deploy.mon][INFO  ] distro info: Ubuntu 16.04 xenial
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] determining if provided host has same hostname in remote
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] get remote short hostname
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] deploying mon to gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] get remote short hostname
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] remote hostname: gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] create the mon path if it does not exist
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-6rvw/done
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-6rvw/done
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] creating keyring file: /var/lib/ceph/tmp/ceph-gke-cluster-1-default-pool-72415711-6rvw.mon.keyring
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] create the monitor keyring file
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo ceph-mon --cluster ceph --mkfs -i gke-cluster-1-default-pool-72415711-6rvw --keyring /var/lib/ceph/tmp/ceph-gke-cluster-1-default-pool-72415711-6rvw.mon.keyring --setuser 64045 --setgroup 64045
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] ceph-mon: mon.noname-b 10.140.0.2:6789/0 is local, renaming to mon.gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] ceph-mon: set fsid to 7bdb1d81-efdc-4a54-a328-87b7841df4b5
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-6rvw for mon.gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] unlinking keyring file /var/lib/ceph/tmp/ceph-gke-cluster-1-default-pool-72415711-6rvw.mon.keyring
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] create a done file to avoid re-doing the mon deployment
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] create the init path if it does not exist
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo systemctl enable ceph.target
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo systemctl enable ceph-mon@gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] Created symlink from /etc/systemd/system/ceph-mon.target.wants/ceph-mon@gke-cluster-1-default-pool-72415711-6rvw.service to /lib/systemd/system/ceph-mon@.service.
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo systemctl start ceph-mon@gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.gke-cluster-1-default-pool-72415711-6rvw.asok mon_status
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] ********************************************************************************
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] status for monitor: mon.gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] {
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   "election_epoch": 0,
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   "extra_probe_peers": [
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]     "10.140.0.3:6789/0",
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]     "10.140.0.4:6789/0"
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   ],
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   "monmap": {
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]     "created": "2017-12-04 04:27:00.228192",
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]     "epoch": 0,
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]     "fsid": "7bdb1d81-efdc-4a54-a328-87b7841df4b5",
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]     "modified": "2017-12-04 04:27:00.228192",
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]     "mons": [
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]       {
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]         "addr": "10.140.0.2:6789/0",
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]         "name": "gke-cluster-1-default-pool-72415711-6rvw",
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]         "rank": 0
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]       },
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]       {
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]         "addr": "10.140.0.4:6789/0",
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]         "name": "gke-cluster-1-default-pool-72415711-4vx2",
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]         "rank": 1
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]       },
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]       {
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]         "addr": "0.0.0.0:0/2",
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]         "name": "gke-cluster-1-default-pool-72415711-b3h4",
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]         "rank": 2
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]       }
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]     ]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   },
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   "name": "gke-cluster-1-default-pool-72415711-6rvw",
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   "outside_quorum": [
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]     "gke-cluster-1-default-pool-72415711-6rvw"
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   ],
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   "quorum": [],
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   "rank": 0,
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   "state": "probing",
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]   "sync_provider": []
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] }
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] ********************************************************************************
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] monitor: mon.gke-cluster-1-default-pool-72415711-6rvw is running
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.gke-cluster-1-default-pool-72415711-6rvw.asok mon_status
[ceph_deploy.mon][DEBUG ] detecting platform for host gke-cluster-1-default-pool-72415711-b3h4 ...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] find the location of an executable
[ceph_deploy.mon][INFO  ] distro info: Ubuntu 16.04 xenial
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] determining if provided host has same hostname in remote
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] get remote short hostname
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] deploying mon to gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] get remote short hostname
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] remote hostname: gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] create the mon path if it does not exist
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-b3h4/done
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-b3h4/done
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] creating keyring file: /var/lib/ceph/tmp/ceph-gke-cluster-1-default-pool-72415711-b3h4.mon.keyring
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] create the monitor keyring file
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo ceph-mon --cluster ceph --mkfs -i gke-cluster-1-default-pool-72415711-b3h4 --keyring /var/lib/ceph/tmp/ceph-gke-cluster-1-default-pool-72415711-b3h4.mon.keyring --setuser 64045 --setgroup 64045
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] ceph-mon: mon.noname-c 10.140.0.3:6789/0 is local, renaming to mon.gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] ceph-mon: set fsid to 7bdb1d81-efdc-4a54-a328-87b7841df4b5
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-b3h4 for mon.gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] unlinking keyring file /var/lib/ceph/tmp/ceph-gke-cluster-1-default-pool-72415711-b3h4.mon.keyring
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] create a done file to avoid re-doing the mon deployment
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] create the init path if it does not exist
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo systemctl enable ceph.target
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo systemctl enable ceph-mon@gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] Created symlink from /etc/systemd/system/ceph-mon.target.wants/ceph-mon@gke-cluster-1-default-pool-72415711-b3h4.service to /lib/systemd/system/ceph-mon@.service.
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo systemctl start ceph-mon@gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.gke-cluster-1-default-pool-72415711-b3h4.asok mon_status
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] ********************************************************************************
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] status for monitor: mon.gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] {
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   "election_epoch": 1,
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   "extra_probe_peers": [
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]     "10.140.0.2:6789/0",
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]     "10.140.0.4:6789/0"
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   ],
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   "monmap": {
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]     "created": "2017-12-04 04:27:03.328274",
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]     "epoch": 0,
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]     "fsid": "7bdb1d81-efdc-4a54-a328-87b7841df4b5",
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]     "modified": "2017-12-04 04:27:03.328274",
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]     "mons": [
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]       {
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]         "addr": "10.140.0.2:6789/0",
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]         "name": "gke-cluster-1-default-pool-72415711-6rvw",
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]         "rank": 0
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]       },
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]       {
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]         "addr": "10.140.0.3:6789/0",
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]         "name": "gke-cluster-1-default-pool-72415711-b3h4",
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]         "rank": 1
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]       },
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]       {
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]         "addr": "10.140.0.4:6789/0",
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]         "name": "gke-cluster-1-default-pool-72415711-4vx2",
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]         "rank": 2
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]       }
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]     ]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   },
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   "name": "gke-cluster-1-default-pool-72415711-b3h4",
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   "outside_quorum": [],
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   "quorum": [],
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   "rank": 1,
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   "state": "electing",
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]   "sync_provider": []
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] }
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] ********************************************************************************
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] monitor: mon.gke-cluster-1-default-pool-72415711-b3h4 is running
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.gke-cluster-1-default-pool-72415711-b3h4.asok mon_status
[ceph_deploy.mon][INFO  ] processing monitor mon.gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.gke-cluster-1-default-pool-72415711-4vx2.asok mon_status
[ceph_deploy.mon][WARNIN] mon.gke-cluster-1-default-pool-72415711-4vx2 monitor is not yet in quorum, tries left: 5
[ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.gke-cluster-1-default-pool-72415711-4vx2.asok mon_status
[ceph_deploy.mon][WARNIN] mon.gke-cluster-1-default-pool-72415711-4vx2 monitor is not yet in quorum, tries left: 4
[ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.gke-cluster-1-default-pool-72415711-4vx2.asok mon_status
[ceph_deploy.mon][INFO  ] mon.gke-cluster-1-default-pool-72415711-4vx2 monitor has reached quorum!
[ceph_deploy.mon][INFO  ] processing monitor mon.gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.gke-cluster-1-default-pool-72415711-6rvw.asok mon_status
[ceph_deploy.mon][INFO  ] mon.gke-cluster-1-default-pool-72415711-6rvw monitor has reached quorum!
[ceph_deploy.mon][INFO  ] processing monitor mon.gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.gke-cluster-1-default-pool-72415711-b3h4.asok mon_status
[ceph_deploy.mon][INFO  ] mon.gke-cluster-1-default-pool-72415711-b3h4 monitor has reached quorum!
[ceph_deploy.mon][INFO  ] all initial monitors are running and have formed quorum
[ceph_deploy.mon][INFO  ] Running gatherkeys...
[ceph_deploy.gatherkeys][INFO  ] Storing keys in temp directory /tmp/tmpaODujZ
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] get remote short hostname
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] fetch remote file
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --admin-daemon=/var/run/ceph/ceph-mon.gke-cluster-1-default-pool-72415711-4vx2.asok mon_status
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-4vx2/keyring auth get client.admin
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-4vx2/keyring auth get client.bootstrap-mds
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-4vx2/keyring auth get client.bootstrap-mgr
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-4vx2/keyring auth get-or-create client.bootstrap-mgr mon allow profile bootstrap-mgr
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-4vx2/keyring auth get client.bootstrap-osd
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-gke-cluster-1-default-pool-72415711-4vx2/keyring auth get client.bootstrap-rgw
[ceph_deploy.gatherkeys][INFO  ] Storing ceph.client.admin.keyring
[ceph_deploy.gatherkeys][INFO  ] Storing ceph.bootstrap-mds.keyring
[ceph_deploy.gatherkeys][INFO  ] Storing ceph.bootstrap-mgr.keyring
[ceph_deploy.gatherkeys][INFO  ] keyring 'ceph.mon.keyring' already exists
[ceph_deploy.gatherkeys][INFO  ] Storing ceph.bootstrap-osd.keyring
[ceph_deploy.gatherkeys][INFO  ] Storing ceph.bootstrap-rgw.keyring
[ceph_deploy.gatherkeys][INFO  ] Destroy temp directory /tmp/tmpaODujZ

初始化磁盘:

$ ceph-deploy disk zap gke-cluster-1-default-pool-72415711-4vx2:/dev/sdb gke-cluster-1-default-pool-72415711-6rvw:/dev/sdb gke-cluster-1-default-pool-72415711-b3h4:/dev/sdb
执行过程
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/shilei/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (1.5.39): /usr/bin/ceph-deploy disk zap gke-cluster-1-default-pool-72415711-4vx2:/dev/sdb gke-cluster-1-default-pool-72415711-6rvw:/dev/sdb gke-cluster-1-default-pool-72415711-b3h4:/dev/sdb
[ceph_deploy.cli][INFO  ] ceph-deploy options:
[ceph_deploy.cli][INFO  ]  username                      : None
[ceph_deploy.cli][INFO  ]  verbose                       : False
[ceph_deploy.cli][INFO  ]  overwrite_conf                : False
[ceph_deploy.cli][INFO  ]  subcommand                    : zap
[ceph_deploy.cli][INFO  ]  quiet                         : False
[ceph_deploy.cli][INFO  ]  cd_conf                       : <ceph_deploy.conf.cephdeploy.Conf instance at 0x7fb44ad5db48>
[ceph_deploy.cli][INFO  ]  cluster                       : ceph
[ceph_deploy.cli][INFO  ]  func                          : <function disk at 0x7fb44afba5f0>
[ceph_deploy.cli][INFO  ]  ceph_conf                     : None
[ceph_deploy.cli][INFO  ]  default_release               : False
[ceph_deploy.cli][INFO  ]  disk                          : [('gke-cluster-1-default-pool-72415711-4vx2', '/dev/sdb', None), ('gke-cluster-1-default-pool-72415711-6rvw', '/dev/sdb', None), ('gke-cluster-1-default-pool-72415711-b3h4', '/dev/sdb', None)]
[ceph_deploy.osd][DEBUG ] zapping /dev/sdb on gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] find the location of an executable
[ceph_deploy.osd][INFO  ] Distro info: Ubuntu 16.04 xenial
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] zeroing last few blocks of device
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /usr/sbin/ceph-disk zap /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] ***************************************************************
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Found invalid GPT and valid MBR; converting MBR to GPT format
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] in memory.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] ***************************************************************
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] other utilities.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Creating new GPT entries.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] The operation has completed successfully.
[ceph_deploy.osd][DEBUG ] zapping /dev/sdb on gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] find the location of an executable
[ceph_deploy.osd][INFO  ] Distro info: Ubuntu 16.04 xenial
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] zeroing last few blocks of device
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo /usr/sbin/ceph-disk zap /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] ***************************************************************
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Found invalid GPT and valid MBR; converting MBR to GPT format
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] in memory.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] ***************************************************************
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] other utilities.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Creating new GPT entries.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] The operation has completed successfully.
[ceph_deploy.osd][DEBUG ] zapping /dev/sdb on gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] find the location of an executable
[ceph_deploy.osd][INFO  ] Distro info: Ubuntu 16.04 xenial
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] zeroing last few blocks of device
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo /usr/sbin/ceph-disk zap /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] ***************************************************************
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Found invalid GPT and valid MBR; converting MBR to GPT format
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] in memory.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] ***************************************************************
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] GPT data structures destroyed! You may now partition the disk using fdisk or
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] other utilities.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Creating new GPT entries.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] The operation has completed successfully.

初始化准备 OSD:

$ ceph-deploy osd prepare gke-cluster-1-default-pool-72415711-4vx2:/dev/sdb gke-cluster-1-default-pool-72415711-6rvw:/dev/sdb gke-cluster-1-default-pool-72415711-b3h4:/dev/sdb
执行过程
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/shilei/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (1.5.39): /usr/bin/ceph-deploy osd prepare gke-cluster-1-default-pool-72415711-4vx2:/dev/sdb gke-cluster-1-default-pool-72415711-6rvw:/dev/sdb gke-cluster-1-default-pool-72415711-b3h4:/dev/sdb
[ceph_deploy.cli][INFO  ] ceph-deploy options:
[ceph_deploy.cli][INFO  ]  username                      : None
[ceph_deploy.cli][INFO  ]  block_db                      : None
[ceph_deploy.cli][INFO  ]  disk                          : [('gke-cluster-1-default-pool-72415711-4vx2', '/dev/sdb', None), ('gke-cluster-1-default-pool-72415711-6rvw', '/dev/sdb', None), ('gke-cluster-1-default-pool-72415711-b3h4', '/dev/sdb', None)]
[ceph_deploy.cli][INFO  ]  dmcrypt                       : False
[ceph_deploy.cli][INFO  ]  verbose                       : False
[ceph_deploy.cli][INFO  ]  bluestore                     : None
[ceph_deploy.cli][INFO  ]  block_wal                     : None
[ceph_deploy.cli][INFO  ]  overwrite_conf                : False
[ceph_deploy.cli][INFO  ]  subcommand                    : prepare
[ceph_deploy.cli][INFO  ]  dmcrypt_key_dir               : /etc/ceph/dmcrypt-keys
[ceph_deploy.cli][INFO  ]  quiet                         : False
[ceph_deploy.cli][INFO  ]  cd_conf                       : <ceph_deploy.conf.cephdeploy.Conf instance at 0x7fd163edbd40>
[ceph_deploy.cli][INFO  ]  cluster                       : ceph
[ceph_deploy.cli][INFO  ]  fs_type                       : xfs
[ceph_deploy.cli][INFO  ]  filestore                     : None
[ceph_deploy.cli][INFO  ]  func                          : <function osd at 0x7fd164133578>
[ceph_deploy.cli][INFO  ]  ceph_conf                     : None
[ceph_deploy.cli][INFO  ]  default_release               : False
[ceph_deploy.cli][INFO  ]  zap_disk                      : False
[ceph_deploy.osd][DEBUG ] Preparing cluster ceph disks gke-cluster-1-default-pool-72415711-4vx2:/dev/sdb: gke-cluster-1-default-pool-72415711-6rvw:/dev/sdb: gke-cluster-1-default-pool-72415711-b3h4:/dev/sdb:
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] find the location of an executable
[ceph_deploy.osd][INFO  ] Distro info: Ubuntu 16.04 xenial
[ceph_deploy.osd][DEBUG ] Deploying osd to gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph_deploy.osd][DEBUG ] Preparing host gke-cluster-1-default-pool-72415711-4vx2 disk /dev/sdb journal None activate False
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /usr/sbin/ceph-disk -v prepare --cluster ceph --fs-type xfs -- /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/ceph-osd --check-allows-journal -i 0 --log-file $run_dir/$cluster-osd-check.log --cluster ceph --setuser ceph --setgroup ceph
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/ceph-osd --check-wants-journal -i 0 --log-file $run_dir/$cluster-osd-check.log --cluster ceph --setuser ceph --setgroup ceph
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/ceph-osd --check-needs-journal -i 0 --log-file $run_dir/$cluster-osd-check.log --cluster ceph --setuser ceph --setgroup ceph
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] set_type: Will colocate journal with data on /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] ptype_tobe_for_name: name = journal
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] create_partition: Creating journal partition num 2 size 5120 on /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /sbin/sgdisk --new=2:0:+5120M --change-name=2:ceph journal --partition-guid=2:800dd641-2577-4a23-b6ec-abde6a43316f --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting name!
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] partNum is 1
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] REALLY setting name!
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] The operation has completed successfully.
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] update_partition: Calling partprobe on created device /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/flock -s /dev/sdb /sbin/partprobe /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb2 uuid path is /sys/dev/block/8:18/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] prepare_device: Journal is GPT partition /dev/disk/by-partuuid/800dd641-2577-4a23-b6ec-abde6a43316f
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] prepare_device: Journal is GPT partition /dev/disk/by-partuuid/800dd641-2577-4a23-b6ec-abde6a43316f
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] set_data_partition: Creating osd partition on /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] ptype_tobe_for_name: name = data
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] create_partition: Creating data partition num 1 size 0 on /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:89fd83dd-04fb-4a0a-9bbe-e3b16395a190 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be --mbrtogpt -- /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Setting name!
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] partNum is 0
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] REALLY setting name!
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] The operation has completed successfully.
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] update_partition: Calling partprobe on created device /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/flock -s /dev/sdb /sbin/partprobe /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb1 uuid path is /sys/dev/block/8:17/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] populate_data_path_device: Creating xfs fs on /dev/sdb1
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdb1
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] meta-data=/dev/sdb1              isize=2048   agcount=4, agsize=2949055 blks
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]          =                       sectsz=4096  attr=2, projid32bit=1
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]          =                       crc=1        finobt=1, sparse=0
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] data     =                       bsize=4096   blocks=11796219, imaxpct=25
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]          =                       sunit=0      swidth=0 blks
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] log      =internal log           bsize=4096   blocks=5759, version=2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ]          =                       sectsz=4096  sunit=1 blks, lazy-count=1
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] realtime =none                   extsz=4096   blocks=0, rtextents=0
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] mount: Mounting /dev/sdb1 on /var/lib/ceph/tmp/mnt.Lv6NGf with options noatime,inode64
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /bin/mount -t xfs -o noatime,inode64 -- /dev/sdb1 /var/lib/ceph/tmp/mnt.Lv6NGf
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] populate_data_path: Preparing osd data dir /var/lib/ceph/tmp/mnt.Lv6NGf
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.Lv6NGf/ceph_fsid.22045.tmp
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.Lv6NGf/fsid.22045.tmp
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.Lv6NGf/magic.22045.tmp
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.Lv6NGf/journal_uuid.22045.tmp
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] adjust_symlink: Creating symlink /var/lib/ceph/tmp/mnt.Lv6NGf/journal -> /dev/disk/by-partuuid/800dd641-2577-4a23-b6ec-abde6a43316f
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.Lv6NGf
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] unmount: Unmounting /var/lib/ceph/tmp/mnt.Lv6NGf
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.Lv6NGf
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] Warning: The kernel is still using the old partition table.
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] The new table will be used at the next reboot or after you
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] run partprobe(8) or kpartx(8)
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] The operation has completed successfully.
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] update_partition: Calling partprobe on prepared device /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/flock -s /dev/sdb /sbin/partprobe /dev/sdb
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /sbin/udevadm trigger --action=add --sysname-match sdb1
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] checking OSD status...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /usr/bin/ceph --cluster=ceph osd stat --format=json
[ceph_deploy.osd][DEBUG ] Host gke-cluster-1-default-pool-72415711-4vx2 is now ready for osd use.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] find the location of an executable
[ceph_deploy.osd][INFO  ] Distro info: Ubuntu 16.04 xenial
[ceph_deploy.osd][DEBUG ] Deploying osd to gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph_deploy.osd][DEBUG ] Preparing host gke-cluster-1-default-pool-72415711-6rvw disk /dev/sdb journal None activate False
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo /usr/sbin/ceph-disk -v prepare --cluster ceph --fs-type xfs -- /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/ceph-osd --check-allows-journal -i 0 --log-file $run_dir/$cluster-osd-check.log --cluster ceph --setuser ceph --setgroup ceph
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/ceph-osd --check-wants-journal -i 0 --log-file $run_dir/$cluster-osd-check.log --cluster ceph --setuser ceph --setgroup ceph
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/ceph-osd --check-needs-journal -i 0 --log-file $run_dir/$cluster-osd-check.log --cluster ceph --setuser ceph --setgroup ceph
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] set_type: Will colocate journal with data on /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] ptype_tobe_for_name: name = journal
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] create_partition: Creating journal partition num 2 size 5120 on /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /sbin/sgdisk --new=2:0:+5120M --change-name=2:ceph journal --partition-guid=2:58d573cc-649a-4482-9a11-6080071e76fa --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting name!
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] partNum is 1
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] REALLY setting name!
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] The operation has completed successfully.
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] update_partition: Calling partprobe on created device /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/flock -s /dev/sdb /sbin/partprobe /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb2 uuid path is /sys/dev/block/8:18/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] prepare_device: Journal is GPT partition /dev/disk/by-partuuid/58d573cc-649a-4482-9a11-6080071e76fa
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] prepare_device: Journal is GPT partition /dev/disk/by-partuuid/58d573cc-649a-4482-9a11-6080071e76fa
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] set_data_partition: Creating osd partition on /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] ptype_tobe_for_name: name = data
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] create_partition: Creating data partition num 1 size 0 on /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:e8064f62-d747-4077-8232-1732275c5e04 --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be --mbrtogpt -- /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Setting name!
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] partNum is 0
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] REALLY setting name!
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] The operation has completed successfully.
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] update_partition: Calling partprobe on created device /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/flock -s /dev/sdb /sbin/partprobe /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb1 uuid path is /sys/dev/block/8:17/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] populate_data_path_device: Creating xfs fs on /dev/sdb1
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdb1
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] meta-data=/dev/sdb1              isize=2048   agcount=4, agsize=2949055 blks
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]          =                       sectsz=4096  attr=2, projid32bit=1
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]          =                       crc=1        finobt=1, sparse=0
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] data     =                       bsize=4096   blocks=11796219, imaxpct=25
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]          =                       sunit=0      swidth=0 blks
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] log      =internal log           bsize=4096   blocks=5759, version=2
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ]          =                       sectsz=4096  sunit=1 blks, lazy-count=1
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] realtime =none                   extsz=4096   blocks=0, rtextents=0
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] mount: Mounting /dev/sdb1 on /var/lib/ceph/tmp/mnt.INEcFU with options noatime,inode64
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /bin/mount -t xfs -o noatime,inode64 -- /dev/sdb1 /var/lib/ceph/tmp/mnt.INEcFU
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] populate_data_path: Preparing osd data dir /var/lib/ceph/tmp/mnt.INEcFU
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.INEcFU/ceph_fsid.22872.tmp
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.INEcFU/fsid.22872.tmp
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.INEcFU/magic.22872.tmp
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.INEcFU/journal_uuid.22872.tmp
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] adjust_symlink: Creating symlink /var/lib/ceph/tmp/mnt.INEcFU/journal -> /dev/disk/by-partuuid/58d573cc-649a-4482-9a11-6080071e76fa
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.INEcFU
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] unmount: Unmounting /var/lib/ceph/tmp/mnt.INEcFU
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.INEcFU
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] Warning: The kernel is still using the old partition table.
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] The new table will be used at the next reboot or after you
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] run partprobe(8) or kpartx(8)
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] The operation has completed successfully.
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] update_partition: Calling partprobe on prepared device /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/flock -s /dev/sdb /sbin/partprobe /dev/sdb
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /sbin/udevadm trigger --action=add --sysname-match sdb1
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] checking OSD status...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo /usr/bin/ceph --cluster=ceph osd stat --format=json
[ceph_deploy.osd][DEBUG ] Host gke-cluster-1-default-pool-72415711-6rvw is now ready for osd use.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] find the location of an executable
[ceph_deploy.osd][INFO  ] Distro info: Ubuntu 16.04 xenial
[ceph_deploy.osd][DEBUG ] Deploying osd to gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph_deploy.osd][DEBUG ] Preparing host gke-cluster-1-default-pool-72415711-b3h4 disk /dev/sdb journal None activate False
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo /usr/sbin/ceph-disk -v prepare --cluster ceph --fs-type xfs -- /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/ceph-osd --check-allows-journal -i 0 --log-file $run_dir/$cluster-osd-check.log --cluster ceph --setuser ceph --setgroup ceph
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/ceph-osd --check-wants-journal -i 0 --log-file $run_dir/$cluster-osd-check.log --cluster ceph --setuser ceph --setgroup ceph
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/ceph-osd --check-needs-journal -i 0 --log-file $run_dir/$cluster-osd-check.log --cluster ceph --setuser ceph --setgroup ceph
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] set_type: Will colocate journal with data on /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] ptype_tobe_for_name: name = journal
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] create_partition: Creating journal partition num 2 size 5120 on /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /sbin/sgdisk --new=2:0:+5120M --change-name=2:ceph journal --partition-guid=2:549911d5-7a98-42f7-a545-a44c5fe00d5b --typecode=2:45b0969e-9b03-4f30-b4c6-b4b80ceff106 --mbrtogpt -- /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting name!
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] partNum is 1
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] REALLY setting name!
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] The operation has completed successfully.
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] update_partition: Calling partprobe on created device /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/flock -s /dev/sdb /sbin/partprobe /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb2 uuid path is /sys/dev/block/8:18/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] prepare_device: Journal is GPT partition /dev/disk/by-partuuid/549911d5-7a98-42f7-a545-a44c5fe00d5b
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] prepare_device: Journal is GPT partition /dev/disk/by-partuuid/549911d5-7a98-42f7-a545-a44c5fe00d5b
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] set_data_partition: Creating osd partition on /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] ptype_tobe_for_name: name = data
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] create_partition: Creating data partition num 1 size 0 on /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:5184b8e9-6dcd-4a0f-8d6d-0f184a034bae --typecode=1:89c57f98-2fe5-4dc0-89c1-f3ad0ceff2be --mbrtogpt -- /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Setting name!
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] partNum is 0
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] REALLY setting name!
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] The operation has completed successfully.
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] update_partition: Calling partprobe on created device /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/flock -s /dev/sdb /sbin/partprobe /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb1 uuid path is /sys/dev/block/8:17/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] populate_data_path_device: Creating xfs fs on /dev/sdb1
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdb1
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] meta-data=/dev/sdb1              isize=2048   agcount=4, agsize=2949055 blks
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]          =                       sectsz=4096  attr=2, projid32bit=1
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]          =                       crc=1        finobt=1, sparse=0
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] data     =                       bsize=4096   blocks=11796219, imaxpct=25
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]          =                       sunit=0      swidth=0 blks
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] log      =internal log           bsize=4096   blocks=5759, version=2
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ]          =                       sectsz=4096  sunit=1 blks, lazy-count=1
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] realtime =none                   extsz=4096   blocks=0, rtextents=0
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] mount: Mounting /dev/sdb1 on /var/lib/ceph/tmp/mnt.zANqcc with options noatime,inode64
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /bin/mount -t xfs -o noatime,inode64 -- /dev/sdb1 /var/lib/ceph/tmp/mnt.zANqcc
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] populate_data_path: Preparing osd data dir /var/lib/ceph/tmp/mnt.zANqcc
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.zANqcc/ceph_fsid.21814.tmp
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.zANqcc/fsid.21814.tmp
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.zANqcc/magic.21814.tmp
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.zANqcc/journal_uuid.21814.tmp
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] adjust_symlink: Creating symlink /var/lib/ceph/tmp/mnt.zANqcc/journal -> /dev/disk/by-partuuid/549911d5-7a98-42f7-a545-a44c5fe00d5b
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.zANqcc
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] unmount: Unmounting /var/lib/ceph/tmp/mnt.zANqcc
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.zANqcc
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb uuid path is /sys/dev/block/8:16/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-062c0ceff05d -- /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] Warning: The kernel is still using the old partition table.
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] The new table will be used at the next reboot or after you
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] run partprobe(8) or kpartx(8)
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] The operation has completed successfully.
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] update_partition: Calling partprobe on prepared device /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/flock -s /dev/sdb /sbin/partprobe /dev/sdb
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /sbin/udevadm settle --timeout=600
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /sbin/udevadm trigger --action=add --sysname-match sdb1
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] checking OSD status...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo /usr/bin/ceph --cluster=ceph osd stat --format=json
[ceph_deploy.osd][DEBUG ] Host gke-cluster-1-default-pool-72415711-b3h4 is now ready for osd use.

激活 OSD:

$ ceph-deploy osd activate gke-cluster-1-default-pool-72415711-4vx2:/dev/sdb1 gke-cluster-1-default-pool-72415711-6rvw:/dev/sdb1 gke-cluster-1-default-pool-72415711-b3h4:/dev/sdb1
执行过程
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/shilei/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (1.5.39): /usr/bin/ceph-deploy osd activate gke-cluster-1-default-pool-72415711-4vx2:/dev/sdb1 gke-cluster-1-default-pool-72415711-6rvw:/dev/sdb1 gke-cluster-1-default-pool-72415711-b3h4:/dev/sdb1
[ceph_deploy.cli][INFO  ] ceph-deploy options:
[ceph_deploy.cli][INFO  ]  username                      : None
[ceph_deploy.cli][INFO  ]  verbose                       : False
[ceph_deploy.cli][INFO  ]  overwrite_conf                : False
[ceph_deploy.cli][INFO  ]  subcommand                    : activate
[ceph_deploy.cli][INFO  ]  quiet                         : False
[ceph_deploy.cli][INFO  ]  cd_conf                       : <ceph_deploy.conf.cephdeploy.Conf instance at 0x7f2f4bbaad40>
[ceph_deploy.cli][INFO  ]  cluster                       : ceph
[ceph_deploy.cli][INFO  ]  func                          : <function osd at 0x7f2f4be02578>
[ceph_deploy.cli][INFO  ]  ceph_conf                     : None
[ceph_deploy.cli][INFO  ]  default_release               : False
[ceph_deploy.cli][INFO  ]  disk                          : [('gke-cluster-1-default-pool-72415711-4vx2', '/dev/sdb1', None), ('gke-cluster-1-default-pool-72415711-6rvw', '/dev/sdb1', None), ('gke-cluster-1-default-pool-72415711-b3h4', '/dev/sdb1', None)]
[ceph_deploy.osd][DEBUG ] Activating cluster ceph disks gke-cluster-1-default-pool-72415711-4vx2:/dev/sdb1: gke-cluster-1-default-pool-72415711-6rvw:/dev/sdb1: gke-cluster-1-default-pool-72415711-b3h4:/dev/sdb1:
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-4vx2
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] find the location of an executable
[ceph_deploy.osd][INFO  ] Distro info: Ubuntu 16.04 xenial
[ceph_deploy.osd][DEBUG ] activating host gke-cluster-1-default-pool-72415711-4vx2 disk /dev/sdb1
[ceph_deploy.osd][DEBUG ] will use init type: systemd
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /usr/sbin/ceph-disk -v activate --mark-init systemd --mount /dev/sdb1
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] main_activate: path = /dev/sdb1
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb1 uuid path is /sys/dev/block/8:17/dm/uuid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /sbin/blkid -o udev -p /dev/sdb1
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /sbin/blkid -p -s TYPE -o value -- /dev/sdb1
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] mount: Mounting /dev/sdb1 on /var/lib/ceph/tmp/mnt.U1ZHmf with options noatime,inode64
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /bin/mount -t xfs -o noatime,inode64 -- /dev/sdb1 /var/lib/ceph/tmp/mnt.U1ZHmf
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] activate: Cluster uuid is 7bdb1d81-efdc-4a54-a328-87b7841df4b5
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] activate: Cluster name is ceph
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] activate: OSD uuid is 89fd83dd-04fb-4a0a-9bbe-e3b16395a190
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] activate: OSD id is 0
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] activate: Marking with init system systemd
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.U1ZHmf/systemd
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] activate: ceph osd.0 data dir is ready at /var/lib/ceph/tmp/mnt.U1ZHmf
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] mount_activate: ceph osd.0 already mounted in position; unmounting ours.
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] unmount: Unmounting /var/lib/ceph/tmp/mnt.U1ZHmf
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.U1ZHmf
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] start_daemon: Starting ceph osd.0...
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /bin/systemctl disable ceph-osd@0
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] Removed symlink /etc/systemd/system/ceph-osd.target.wants/ceph-osd@0.service.
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /bin/systemctl disable ceph-osd@0 --runtime
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /bin/systemctl enable ceph-osd@0
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] Created symlink from /etc/systemd/system/ceph-osd.target.wants/ceph-osd@0.service to /lib/systemd/system/ceph-osd@.service.
[gke-cluster-1-default-pool-72415711-4vx2][WARNIN] command_check_call: Running command: /bin/systemctl start ceph-osd@0
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] checking OSD status...
[gke-cluster-1-default-pool-72415711-4vx2][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo /usr/bin/ceph --cluster=ceph osd stat --format=json
[gke-cluster-1-default-pool-72415711-4vx2][INFO  ] Running command: sudo systemctl enable ceph.target
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-6rvw
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] find the location of an executable
[ceph_deploy.osd][INFO  ] Distro info: Ubuntu 16.04 xenial
[ceph_deploy.osd][DEBUG ] activating host gke-cluster-1-default-pool-72415711-6rvw disk /dev/sdb1
[ceph_deploy.osd][DEBUG ] will use init type: systemd
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo /usr/sbin/ceph-disk -v activate --mark-init systemd --mount /dev/sdb1
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] main_activate: path = /dev/sdb1
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb1 uuid path is /sys/dev/block/8:17/dm/uuid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /sbin/blkid -o udev -p /dev/sdb1
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /sbin/blkid -p -s TYPE -o value -- /dev/sdb1
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] mount: Mounting /dev/sdb1 on /var/lib/ceph/tmp/mnt.PNHjnZ with options noatime,inode64
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /bin/mount -t xfs -o noatime,inode64 -- /dev/sdb1 /var/lib/ceph/tmp/mnt.PNHjnZ
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] activate: Cluster uuid is 7bdb1d81-efdc-4a54-a328-87b7841df4b5
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] activate: Cluster name is ceph
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] activate: OSD uuid is e8064f62-d747-4077-8232-1732275c5e04
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] activate: OSD id is 1
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] activate: Marking with init system systemd
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.PNHjnZ/systemd
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] activate: ceph osd.1 data dir is ready at /var/lib/ceph/tmp/mnt.PNHjnZ
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] mount_activate: ceph osd.1 already mounted in position; unmounting ours.
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] unmount: Unmounting /var/lib/ceph/tmp/mnt.PNHjnZ
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.PNHjnZ
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] start_daemon: Starting ceph osd.1...
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /bin/systemctl disable ceph-osd@1
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] Removed symlink /etc/systemd/system/ceph-osd.target.wants/ceph-osd@1.service.
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /bin/systemctl disable ceph-osd@1 --runtime
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /bin/systemctl enable ceph-osd@1
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] Created symlink from /etc/systemd/system/ceph-osd.target.wants/ceph-osd@1.service to /lib/systemd/system/ceph-osd@.service.
[gke-cluster-1-default-pool-72415711-6rvw][WARNIN] command_check_call: Running command: /bin/systemctl start ceph-osd@1
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] checking OSD status...
[gke-cluster-1-default-pool-72415711-6rvw][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo /usr/bin/ceph --cluster=ceph osd stat --format=json
[gke-cluster-1-default-pool-72415711-6rvw][INFO  ] Running command: sudo systemctl enable ceph.target
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connection detected need for sudo
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] connected to host: gke-cluster-1-default-pool-72415711-b3h4
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect platform information from remote host
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] detect machine type
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] find the location of an executable
[ceph_deploy.osd][INFO  ] Distro info: Ubuntu 16.04 xenial
[ceph_deploy.osd][DEBUG ] activating host gke-cluster-1-default-pool-72415711-b3h4 disk /dev/sdb1
[ceph_deploy.osd][DEBUG ] will use init type: systemd
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo /usr/sbin/ceph-disk -v activate --mark-init systemd --mount /dev/sdb1
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] main_activate: path = /dev/sdb1
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb1 uuid path is /sys/dev/block/8:17/dm/uuid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /sbin/blkid -o udev -p /dev/sdb1
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /sbin/blkid -p -s TYPE -o value -- /dev/sdb1
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] mount: Mounting /dev/sdb1 on /var/lib/ceph/tmp/mnt.tUI6_A with options noatime,inode64
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /bin/mount -t xfs -o noatime,inode64 -- /dev/sdb1 /var/lib/ceph/tmp/mnt.tUI6_A
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] activate: Cluster uuid is 7bdb1d81-efdc-4a54-a328-87b7841df4b5
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] activate: Cluster name is ceph
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] activate: OSD uuid is 5184b8e9-6dcd-4a0f-8d6d-0f184a034bae
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] activate: OSD id is 2
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] activate: Marking with init system systemd
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command: Running command: /bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt.tUI6_A/systemd
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] activate: ceph osd.2 data dir is ready at /var/lib/ceph/tmp/mnt.tUI6_A
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] mount_activate: ceph osd.2 already mounted in position; unmounting ours.
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] unmount: Unmounting /var/lib/ceph/tmp/mnt.tUI6_A
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.tUI6_A
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] start_daemon: Starting ceph osd.2...
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /bin/systemctl disable ceph-osd@2
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] Removed symlink /etc/systemd/system/ceph-osd.target.wants/ceph-osd@2.service.
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /bin/systemctl disable ceph-osd@2 --runtime
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /bin/systemctl enable ceph-osd@2
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] Created symlink from /etc/systemd/system/ceph-osd.target.wants/ceph-osd@2.service to /lib/systemd/system/ceph-osd@.service.
[gke-cluster-1-default-pool-72415711-b3h4][WARNIN] command_check_call: Running command: /bin/systemctl start ceph-osd@2
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] checking OSD status...
[gke-cluster-1-default-pool-72415711-b3h4][DEBUG ] find the location of an executable
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo /usr/bin/ceph --cluster=ceph osd stat --format=json
[gke-cluster-1-default-pool-72415711-b3h4][INFO  ] Running command: sudo systemctl enable ceph.target

分配 admin 权限配置到各节点:

$ ceph-deploy admin gke-cluster-1-default-pool-72415711-4vx2 gke-cluster-1-default-pool-72415711-6rvw gke-cluster-1-default-pool-72415711-b3h4

给予本地配置文件执行权限,可以让命令行执行时具备执行加载此配置的权限:

$ chmod +r /etc/ceph/ceph.client.admin.keyring

安装以及完成,检测集群是否构建成功:

$ ceph health
HEALTH_OK
$ ceph -s
    cluster 7bdb1d81-efdc-4a54-a328-87b7841df4b5
     health HEALTH_OK
     monmap e1: 3 mons at {gke-cluster-1-default-pool-72415711-4vx2=10.140.0.4:6789/0,gke-cluster-1-default-pool-72415711-6rvw=10.140.0.2:6789/0,gke-cluster-1-default-pool-72415711-b3h4=10.140.0.3:6789/0}
            election epoch 6, quorum 0,1,2 gke-cluster-1-default-pool-72415711-6rvw,gke-cluster-1-default-pool-72415711-b3h4,gke-cluster-1-default-pool-72415711-4vx2
     osdmap e14: 3 osds: 3 up, 3 in
            flags sortbitwise,require_jewel_osds
      pgmap v28: 64 pgs, 1 pools, 0 bytes data, 0 objects
            101 MB used, 134 GB / 134 GB avail
                  64 active+clean

新版中 ceph 都是用的 ceph 作为用户,所以可能会造成如下报错:

Jun 11 03:10:19 instance-4 systemd[1]: ceph-osd@2.service: Main process exited, code=exited, status=1/FAILURE
Jun 11 03:10:19 instance-4 systemd[1]: ceph-osd@2.service: Unit entered failed state.
Jun 11 03:10:19 instance-4 systemd[1]: ceph-osd@2.service: Failed with result 'exit-code'.
Jun 11 03:10:39 instance-4 systemd[1]: ceph-osd@2.service: Service hold-off time over, scheduling restart.
Jun 11 03:10:39 instance-4 systemd[1]: Stopped Ceph object storage daemon.
Jun 11 03:10:39 instance-4 systemd[1]: Starting Ceph object storage daemon...
Jun 11 03:10:39 instance-4 ceph-osd-prestart.sh[10328]: create-or-move updated item name 'osd.2' weight 0.0146 at location {host=instance-4,root=default} to crush map
Jun 11 03:10:40 instance-4 systemd[1]: Started Ceph object storage daemon.
Jun 11 03:10:40 instance-4 ceph-osd[10376]: starting osd.2 at :/0 osd_data /var/lib/ceph/osd/ceph-2 /var/lib/ceph/osd/ceph-2/journal
Jun 11 03:10:40 instance-4 ceph-osd[10376]: 2019-06-11 03:10:40.070148 7f6bf3e3fb00 -1 filestore(/var/lib/ceph/osd/ceph-2) mount failed to open journal /var/lib/ceph/osd/ceph-2/journal: (13) Permission denied
Jun 11 03:10:40 instance-4 ceph-osd[10376]: 2019-06-11 03:10:40.070414 7f6bf3e3fb00 -1 osd.2 0 OSD:init: unable to mount object store
Jun 11 03:10:40 instance-4 ceph-osd[10376]: 2019-06-11 03:10:40.070435 7f6bf3e3fb00 -1  ** ERROR: osd init failed: (13) Permission denied

解决方案是把所有的接入设备添加 ceph 属主:

$ chown ceph:ceph /dev/sdb*

Ceph for Kubernetes

准备 Kubernetes 的 Ceph rbd:

$ ceph osd pool create kube 256 256
pool 'kube' created

测试 ceph rbd 能否正常使用:

$ rbd create kube/test --size 1024 --image-format 2
$ rbd ls kube
$ rbd rm kube/test  

创建 Ceph 的秘钥凭证:

$ ceph auth get client.admin 2>&1 |grep "key = " |awk '{print  $3'}  > /tmp/secret  
$ sudo kubectl create secret generic ceph-admin-secret --from-file=/tmp/secret --namespace=kube-system  
$ sudo kubectl create secret generic ceph-admin-secret --from-file=/tmp/secret --namespace=default  

如果存在 RBAD 权限问题请使用:

创建 rbd 集群角色配置:

rbd-clusterrole.yaml
kind: ClusterRole  
apiVersion: rbac.authorization.k8s.io/v1beta1  
metadata:  
  name: rbd-provisioner  
rules:  
  - apiGroups: [""]  
    resources: ["persistentvolumes"]  
    verbs: ["get", "list", "watch", "create", "delete"]  
  - apiGroups: [""]  
    resources: ["persistentvolumeclaims"]  
    verbs: ["get", "list", "watch", "update"]  
  - apiGroups: ["storage.k8s.io"]  
    resources: ["storageclasses"]  
    verbs: ["get", "list", "watch"]  
  - apiGroups: [""]  
    resources: ["events"]  
    verbs: ["list", "watch", "create", "update", "patch"]  
  - apiGroups: [""]  
    resources: ["secrets"]  
    verbs: ["get"]  

创建绑定角色配置:

rbd-clusterrolebinding.yaml
kind: ClusterRoleBinding  
apiVersion: rbac.authorization.k8s.io/v1beta1  
metadata:  
  name: rbd-provisioner  
subjects:  
  - kind: ServiceAccount  
    name: rbd-provisioner  
    namespace: default  
roleRef:  
  kind: ClusterRole  
  name: rbd-provisioner  
  apiGroup: rbac.authorization.k8s.io  

准备 ServiceAccount 配置文件:

rbd-serviceaccount.yaml
apiVersion: v1  
kind: ServiceAccount  
metadata:  
  name: rbd-provisioner

准备 rbd Deployment 配置文件:

rbd-deployment.yaml
apiVersion: extensions/v1beta1  
kind: Deployment  
metadata:  
  name: rbd-provisioner  
spec:  
  replicas: 1  
  strategy:  
    type: Recreate  
  template:  
    metadata:  
      labels:  
        app: rbd-provisioner  
    spec:  
      containers:  
      - name: rbd-provisioner  
        image: "quay.io/external_storage/rbd-provisioner:latest"  
        env:  
        - name: PROVISIONER_NAME  
          value: ceph.com/rbd  
      serviceAccount: rbd-provisioner  

启动配置:

$ kubectl apply -f rbd-serviceaccount.yaml -f rbd-clusterrole.yaml -f rbd-clusterrolebinding.yaml -f rbd-deployment.yaml

创建 StorageClass,准备配置文件:

kube-ceph-storage-class.yaml
apiVersion: storage.k8s.io/v1  
kind: StorageClass  
metadata:  
  name: rbd  
provisioner: ceph.com/rbd  
parameters:  
  monitors: 10.140.0.4:6789,10.140.0.3:6789,10.140.0.2:6789
  adminId: admin  
  adminSecretName: ceph-admin-secret  
  adminSecretNamespace: kube-system  
  pool: kube  
  userId: admin  
  userSecretName: ceph-admin-secret  
  imageFormat: "2"  
  imageFeatures: layering 

启动服务:

$ kubectl create -f kube-ceph-storage-class.yaml  

测试 Ceph StorageClass :

ceph-pvc.yaml
apiVersion: v1  
kind: PersistentVolumeClaim  
metadata:  
  name: ceph-pvc
spec:  
  accessModes:   
    - ReadWriteOnce  
  resources:  
    requests:  
      storage: 5Gi   
  storageClassName: rbd 

启动服务:

$ kubectl create -f ceph-pvc.yaml  

查看 PV、PVC 状态:

$ kubectl get pv
NAME                                       CAPACITY   ACCESSMODES   RECLAIMPOLICY   STATUS     CLAIM                   STORAGECLASS   REASON    AGE
pvc-c5dfd88e-d8b8-11e7-ae60-42010af0020f   5Gi        RWO           Delete          Bound      default/ceph-pvc        rbd                      8s
$ kubectl get pvc
NAME       STATUS    VOLUME                                     CAPACITY   ACCESSMODES   STORAGECLASS   AGE
ceph-pvc   Bound     pvc-c5dfd88e-d8b8-11e7-ae60-42010af0020f   5Gi        RWO           rbd            10s

Testing Service

创建一个服务进行测试,准备 Nginx-Deployment 配置文件:

nginx-dep.yaml
apiVersion: extensions/v1beta1
kind: Deployment
metadata:
  name: nginx
  namespace: default
  labels:
    name: nginx
    kubernetes.io/cluster-service: "true"
spec:
  replicas: 1
  template:
    metadata:
      labels:
        app: nginx
    spec:
      containers:
       - image: nginx:latest
         name: nginx
         ports:
           - containerPort: 80
         volumeMounts:
         - mountPath: "/data"
           name: data
      volumes:
        - name: data
          persistentVolumeClaim:
            claimName: ceph-pvc

启动服务:

$ kubectl apply -f nginx-dep.yaml

查看服务状态以及挂载 Volume 状态:

$ kubectl get po
NAME                               READY     STATUS    RESTARTS   AGE
nginx-3309912037-5lqcn             1/1       Running   0          8s

进入 Nginx 服务终端,并查看 Volume:

$ kubectl exec -it nginx-3309912037-5lqcn bash
$ ls /data/
lost+found
$ df -h
Filesystem      Size  Used Avail Use% Mounted on
none             97G  4.3G   93G   5% /
tmpfs           3.7G     0  3.7G   0% /dev
tmpfs           3.7G     0  3.7G   0% /sys/fs/cgroup
/dev/rbd1       4.8G   10M  4.6G   1% /data
/dev/sda1        97G  4.3G   93G   5% /etc/hosts
shm              64M     0   64M   0% /dev/shm
tmpfs           3.7G   12K  3.7G   1% /run/secrets/kubernetes.io/serviceaccount

清除无关文件:

$ rm -rf /data/lost+found/

如果使用 MySQL 直接挂载可能会存在问题,因为默认情况下有这个 lost-found 的数据目录存在,需要删除后才能让 MySQL 等服务进行使用:(确保已经删除了数据目录下的其他文件与目录)

mysql-dep.yaml
apiVersion: extensions/v1beta1
kind: Deployment
metadata:
  name: mysql
  namespace: default
  labels:
    name: mysql
    kubernetes.io/cluster-service: "true"
spec:
  replicas: 1
  template:
    metadata:
      labels:
        app: mysql
    spec:
      containers:
       - image: mysql:latest
         name: mysql
         env:
           - name: MYSQL_ROOT_PASSWORD
             value: passwords
         ports:
           - containerPort: 3306
         volumeMounts:
         - mountPath: "/var/lib/mysql"
           name: data
      volumes:
        - name: data
          persistentVolumeClaim:
            claimName: ceph-pvc

启动服务:

$ kubectl delete -f nginx.yaml
$ kubectl apply -f mysql-dep.yaml

服务状态:

$ kubectl get po -o wide
NAME                               READY     STATUS    RESTARTS   AGE       IP          NODE
mysql-2251924792-5t615             1/1       Running   0          17s       10.8.2.10   gke-cluster-1-default-pool-72415711-b3h4
$ kubectl exec -it mysql-2251924792-5t615 bash
$ df -h
Filesystem      Size  Used Avail Use% Mounted on
none             97G  4.3G   93G   5% /
tmpfs           3.7G     0  3.7G   0% /dev
tmpfs           3.7G     0  3.7G   0% /sys/fs/cgroup
/dev/sda1        97G  4.3G   93G   5% /etc/hosts
shm              64M     0   64M   0% /dev/shm
/dev/rbd1       4.8G  220M  4.4G   5% /var/lib/mysql
tmpfs           3.7G   12K  3.7G   1% /run/secrets/kubernetes.io/serviceaccount
$ cd /var/lib/mysql
$ ls
auto.cnf  ca-key.pem  ca.pem  client-cert.pem  client-key.pem  ib_buffer_pool  ib_logfile0  ib_logfile1  ibdata1  ibtmp1  mysql  performance_schema  private_key.pem  public_key.pem  server-cert.pem  server-key.pem  sys

如果没有清空 Volume 不相干的文件与目录,MySQL 会出现如下错误:

$ docker logs -f 5fc8386d1da0
Initializing database
2017-12-04T06:05:37.764385Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
2017-12-04T06:05:37.765974Z 0 [ERROR] --initialize specified but the data directory has files in it. Aborting.
2017-12-04T06:05:37.766008Z 0 [ERROR] Aborting
  • No labels