kubernetes/k8s接合阿里云LoadBalancer/负载均衡

在生产环境中kubernetes如果仅提供http或https服务，则可以使用nginx-ingress或者traefik之类的七层负载均衡软件。 当然，也可以通过NodePort的方式暴露http或tcp服务。如果不想直接使用NodePort暴露出的那个端口号，而服务器又是运行在阿里云上，那么可以使用阿里云提供的Kubernetes Cloud Controller Manager来对外暴露TCP服务或http/https服务。

前提：

1.在阿里云上购买了几台ecs

2.在阿里云的ecs上搭建好了一个kubernetes集群，这里以kubernetes1.9.0为例

3.在阿里云上购买一个公网的负载均衡

就可以开始配置阿里云的负载均衡与kubernetes整合了。以下是配置步骤：

1. 先获取每台ecs对应的regionId和ecsId,可以使用命令echo `curl -s http://100.100.100.200/latest/meta-data/region-id`.`curl -s http://100.100.100.200/latest/meta-data/instance-id`获取。
2. 把apiserver, controller-manager和kubelet都添加启动参数 --cloud-provider=external，并且在kubelet中添加--provider-id=上面得到的<REGION_ID>.<ECS_ID>
3. 先创建一个secret用来保存阿里的Access Key Id和Access Key Secret(这两项值在阿里的控制台可以查到),编写一个alicloud-secret.yaml文件，如下
   复制代码 apiVersion: v1 kind: Secret metadata: name: alicloud-config namespace: kube-system data: # insert your base64 encoded AliCloud access id and key here, ensure there's no trailing newline: # to base64 encode your token run: # echo -n "abc123abc123doaccesstoken" | base64 access-key-id: " <ACCESS_KEY_ID>" access-key-secret: " <ACCESS_KEY_SECRET>"

   1
   2
   3
   4
   5
   6
   7
   8
   9
   10
   11
   12
   13
   14
   15
   16
   17
   18
   19
   20
   21
   22
   23
   24
   25
   26
   27
   28
   29
   30
   31
   32
   33
   34
   35
   36
   37
   38
   39
   40
   41
   42
   43
   44
   45
   46
   47
   48
   49
   50
   51
   52
   53
   54
   55
   56
   57
   58
   59
   60
   61
   62
   63
   64
   65
   66
   67
   68
   69
   70
   71
   72
   73
   74
   75
   76
   77
   78
   79
   80
   81
   82
   83
   84
   85
   86
   87
   88
   89
   90
   91
   92
   93
   94
   
   
   
   
   
   
   
   apiVersion: v1
   
   
   
   
   
   
   
   kind: Secret
   
   
   
   
   
   
   
   metadata:
   
   
   
   
   
   
   
   name: alicloud-config
   
   
   
   
   
   
   
   namespace: kube-system
   
   
   
   
   
   
   
   data:
   
   
   
   
   
   
   
   # insert your base64 encoded AliCloud access id and key here, ensure there's no trailing newline:
   
   
   
   
   
   
   
   # to base64 encode your token run:
   
   
   
   
   
   
   
   #
   echo -n "abc123abc123doaccesstoken" | base64
   
   
   
   
   
   
   
   access-key-id: "
   <ACCESS_KEY_ID>"
   
   
   
   
   
   
   
   access-key-secret: "
   <ACCESS_KEY_SECRET>"
   
   
   

   这里的id和secret就是把从阿里控制台中得到的用base64编码，然后替换到上面文件中就可以了。然后用kubectl apply -f alicloud-secret.yaml创建对应secret.
4. 接下来再编写alicloud-controller-manager.yaml文件，如下
   
   复制代码 apiVersion: extensions/v1beta1 kind: Deployment metadata: name: alicloud-controller-manager namespace: kube-system spec: replicas: 1 revisionHistoryLimit: 2 template: metadata: labels: app: alicloud-controller-manager spec: dnsPolicy: Default tolerations: # this taint is set by all kubelets running `--cloud-provider=external` - key: "node.cloudprovider.kubernetes.io/uninitialized" value: "true" effect: "NoSchedule" containers: - image: registry.cn-hangzhou.aliyuncs.com/kube-test/alicloud-controller-manager:v0.1.0 name: alicloud-controller-manager command: - /alicloud-controller-manager # set leader-elect=true if you have more that one replicas - --leader-elect=false - --allocate-node-cidrs=true # set this to what you set to controller-manager or kube-proxy - --cluster-cidr= 10.0.6.0 /24 # if you want to use a secure endpoint or deploy in a kubeadm deployed cluster, you need to use a kubeconfig instead. - --master= 10.0.0.10:8080 env: - name: ACCESS_KEY_ID valueFrom: secretKeyRef: name: alicloud-config key: access-key-id - name: ACCESS_KEY_SECRET valueFrom: secretKeyRef: name: alicloud-config key: access-key-secret

   1
   2
   3
   4
   5
   6
   7
   8
   9
   10
   11
   12
   13
   14
   15
   16
   17
   18
   19
   20
   21
   22
   23
   24
   25
   26
   27
   28
   29
   30
   31
   32
   33
   34
   35
   36
   37
   38
   39
   40
   41
   42
   43
   44
   45
   46
   47
   48
   49
   50
   51
   52
   53
   54
   55
   56
   57
   58
   59
   60
   61
   62
   63
   64
   65
   66
   67
   68
   69
   70
   71
   72
   73
   74
   75
   76
   77
   78
   79
   80
   81
   82
   83
   84
   85
   86
   87
   88
   89
   90
   91
   92
   93
   94
   95
   96
   97
   98
   99
   100
   101
   102
   103
   104
   105
   106
   107
   108
   109
   110
   111
   112
   113
   114
   115
   116
   117
   118
   119
   120
   121
   122
   123
   124
   125
   126
   127
   128
   129
   130
   131
   132
   133
   134
   135
   136
   137
   138
   139
   140
   141
   142
   143
   144
   145
   146
   147
   148
   149
   150
   151
   152
   153
   154
   155
   156
   157
   158
   159
   160
   161
   162
   163
   164
   165
   166
   167
   168
   169
   170
   171
   172
   173
   174
   175
   176
   177
   178
   179
   180
   181
   182
   183
   184
   185
   186
   187
   188
   189
   190
   191
   192
   193
   194
   195
   196
   197
   198
   199
   200
   201
   202
   203
   204
   205
   206
   207
   208
   209
   210
   211
   212
   213
   214
   215
   216
   217
   218
   219
   220
   221
   222
   223
   224
   225
   226
   227
   228
   229
   230
   231
   232
   233
   234
   235
   236
   237
   238
   239
   240
   241
   242
   243
   244
   245
   246
   247
   248
   249
   250
   251
   252
   253
   254
   255
   256
   257
   258
   259
   260
   261
   262
   263
   264
   265
   266
   267
   268
   269
   270
   271
   272
   273
   274
   275
   276
   277
   278
   279
   280
   281
   282
   283
   284
   285
   286
   287
   288
   289
   290
   291
   292
   293
   294
   295
   296
   297
   298
   299
   300
   301
   302
   303
   304
   305
   306
   307
   308
   309
   310
   311
   312
   313
   314
   315
   316
   317
   318
   319
   320
   321
   322
   323
   324
   325
   326
   327
   328
   329
   330
   331
   332
   333
   334
   335
   336
   337
   338
   339
   340
   341
   342
   
   
   
   
   
   
   
   apiVersion: extensions/v1beta1
   
   
   
   
   
   
   
   kind: Deployment
   
   
   
   
   
   
   
   metadata:
   
   
   
   
   
   
   
   name: alicloud-controller-manager
   
   
   
   
   
   
   
   namespace: kube-system
   
   
   
   
   
   
   
   spec:
   
   
   
   
   
   
   
   replicas: 1
   
   
   
   
   
   
   
   revisionHistoryLimit: 2
   
   
   
   
   
   
   
   template:
   
   
   
   
   
   
   
   metadata:
   
   
   
   
   
   
   
   labels:
   
   
   
   
   
   
   
   app: alicloud-controller-manager
   
   
   
   
   
   
   
   spec:
   
   
   
   
   
   
   
   dnsPolicy: Default
   
   
   
   
   
   
   
   tolerations:
   
   
   
   
   
   
   
   # this taint is set by all kubelets running `--cloud-provider=external`
   
   
   
   
   
   
   
   - key: "node.cloudprovider.kubernetes.io/uninitialized"
   
   
   
   
   
   
   
   value: "true"
   
   
   
   
   
   
   
   effect: "NoSchedule"
   
   
   
   
   
   
   
   containers:
   
   
   
   
   
   
   
   - image: registry.cn-hangzhou.aliyuncs.com/kube-test/alicloud-controller-manager:v0.1.0
   
   
   
   
   
   
   
   name: alicloud-controller-manager
   
   
   
   
   
   
   
   command:
   
   
   
   
   
   
   
   - /alicloud-controller-manager
   
   
   
   
   
   
   
   # set leader-elect=true if you have more that one replicas
   
   
   
   
   
   
   
   - --leader-elect=false
   
   
   
   
   
   
   
   - --allocate-node-cidrs=true
   
   
   
   
   
   
   
   # set this to what you set to controller-manager or kube-proxy
   
   
   
   
   
   
   
   - --cluster-cidr=
   10.0.6.0
   /24
   
   
   
   
   
   
   
   # if you want to use a secure endpoint or deploy in a kubeadm deployed cluster, you need to use a kubeconfig instead.
   
   
   
   
   
   
   
   - --master=
   10.0.0.10:8080
   
   
   
   
   
   
   
   env:
   
   
   
   
   
   
   
   - name: ACCESS_KEY_ID
   
   
   
   
   
   
   
   valueFrom:
   
   
   
   
   
   
   
   secretKeyRef:
   
   
   
   
   
   
   
   name: alicloud-config
   
   
   
   
   
   
   
   key: access-key-id
   
   
   
   
   
   
   
   - name: ACCESS_KEY_SECRET
   
   
   
   
   
   
   
   valueFrom:
   
   
   
   
   
   
   
   secretKeyRef:
   
   
   
   
   
   
   
   name: alicloud-config
   
   
   
   
   
   
   
   key: access-key-secret
   
   
   

   注意上面红字部分，根据自己的配置情况替换。同样，使用kubectl apply -f alicloud-controller-manager.yaml来创建对应的deployment
5. 然后就可以创建一个service来使用它了，例如我下面创建一个zookeeper的服务

   复制代码 apiVersion: v1 kind: Service metadata: name: zookeeper-master labels: app: zookeeper-master namespace: xxxxx spec: ports: - port: 2181 targetPort: 2181 protocol: TCP name: main-port selector: app: zookeeper-master type: LoadBalancer

   1
   2
   3
   4
   5
   6
   7
   8
   9
   10
   11
   12
   13
   14
   15
   16
   17
   18
   19
   20
   21
   22
   23
   24
   25
   26
   27
   28
   29
   30
   31
   32
   33
   34
   35
   36
   37
   38
   39
   40
   41
   42
   43
   44
   45
   46
   47
   48
   49
   50
   51
   52
   53
   54
   55
   56
   57
   58
   59
   60
   61
   62
   63
   64
   65
   66
   67
   68
   69
   70
   71
   72
   73
   74
   75
   76
   77
   78
   79
   80
   81
   82
   83
   84
   85
   86
   87
   88
   89
   90
   91
   92
   93
   94
   95
   96
   97
   98
   99
   100
   101
   102
   103
   104
   105
   106
   107
   108
   109
   110
   111
   112
   113
   114
   115
   116
   117
   118
   119
   120
   121
   122
   123
   124
   125
   126
   127
   128
   129
   130
   131
   
   
   
   
   
   
   
   apiVersion: v1
   
   
   
   
   
   
   
   kind: Service
   
   
   
   
   
   
   
   metadata:
   
   
   
   
   
   
   
   name: zookeeper-master
   
   
   
   
   
   
   
   labels:
   
   
   
   
   
   
   
   app: zookeeper-master
   
   
   
   
   
   
   
   namespace: xxxxx
   
   
   
   
   
   
   
   spec:
   
   
   
   
   
   
   
   ports:
   
   
   
   
   
   
   
   - port: 2181
   
   
   
   
   
   
   
   targetPort: 2181
   
   
   
   
   
   
   
   protocol: TCP
   
   
   
   
   
   
   
   name: main-port
   
   
   
   
   
   
   
   selector:
   
   
   
   
   
   
   
   app: zookeeper-master
   
   
   
   
   
   
   
   type: LoadBalancer
   
   
   

   这时可以通过kubectl get svc看到对应的service已经有了external-ip
   
   
6. 要在阿里控制台把负载均衡设置一下后端服务器，把k8s的node节点都添加进去。

最后

以上就是包容鲜花最近收集整理的关于kubernetes/k8s接合阿里云LoadBalancer/负载均衡的全部内容，更多相关kubernetes/k8s接合阿里云LoadBalancer/负载均衡内容请搜索靠谱客的其他文章。