MongoDB Sharding Cluster 分片集群

Config Server存储集群所有节点、分片数据路由信息。默认需要配置3个Config Server节点。
Mongos提供对外应用访问，所有操作均通过mongos执行。一般有多个mongos节点。数据迁移和数据自动平衡。
Mongod存储应用数据记录。一般有多个Mongod节点，达到数据分片目的。

分片集群规划及配置

1、规划：

mongos:

    port 38017
    dir:/mongodb/38017/conf  /mongodb/38017/log  /mongod/38017/data

confdb:

  port：38018,38019,38020
  replSetName: configReplSet
  clusterRole: configsvr
  dir:
            /mongodb/38018/conf  /mongodb/38018/log  /mongod/38018/data
            /mongodb/38019/conf  /mongodb/38019/log  /mongod/38019/data
            /mongodb/38020/conf  /mongodb/38020/log  /mongod/38020/data

shard1：

  port:38021,38022,38023
  replSetName: sh1
  clusterRole: shardsvr
  dir:
            /mongodb/38021/conf  /mongodb/38021/log  /mongod/38021/data
            /mongodb/38022/conf  /mongodb/38022/log  /mongod/38022/data
            /mongodb/38023/conf  /mongodb/38023/log  /mongod/38023/data

shard2:

  port:38024,38025,38026
  replSetName: sh2
  clusterRole: shardsvr
  dir:
            /mongodb/38024/conf  /mongodb/38024/log  /mongod/38024/data
            /mongodb/38025/conf  /mongodb/38025/log  /mongod/38025/data
            /mongodb/38026/conf  /mongodb/38026/log  /mongod/38026/data

2、shard复制集配置：

2.1目录创建：

mkdir -p /mongodb/38021/conf  /mongodb/38021/log  /mongodb/38021/data
mkdir -p /mongodb/38022/conf  /mongodb/38022/log  /mongodb/38022/data
mkdir -p /mongodb/38023/conf  /mongodb/38023/log  /mongodb/38023/data
mkdir -p /mongodb/38024/conf  /mongodb/38024/log  /mongodb/38024/data
mkdir -p /mongodb/38025/conf  /mongodb/38025/log  /mongodb/38025/data
mkdir -p /mongodb/38026/conf  /mongodb/38026/log  /mongodb/38026/data

2.2修改配置文件：

sh1:

vi /mongodb/38021/conf/mongodb.conf 
===============
根据需求修改相应参数：
systemLog:
  destination: file
  path: /mongodb/38021/log/mongodb.log
  logAppend: true
storage:
  journal:
    enabled: true
  dbPath: /mongodb/38021/data
  directoryPerDB: true
  #engine: wiredTiger
  wiredTiger:
    engineConfig:
      cacheSizeGB: 1
      directoryForIndexes: true
    collectionConfig:
      blockCompressor: zlib
    indexConfig:
      prefixCompression: true
net:
  port: 38021
replication:
  oplogSizeMB: 2048
  replSetName: sh1
sharding:
  clusterRole: shardsvr
processManagement: 
  fork: true

===============
cp  /mongodb/38021/conf/mongodb.conf  /mongodb/38022/conf/
cp  /mongodb/38021/conf/mongodb.conf  /mongodb/38023/conf/

sed 's#38021#38022#g' /mongodb/38022/conf/mongodb.conf -i
sed 's#38021#38023#g' /mongodb/38023/conf/mongodb.conf -i

sh2:

vi /mongodb/38024/conf/mongodb.conf 
========
根据需求修改相应参数：
systemLog:
  destination: file
  path: /mongodb/38024/log/mongodb.log   
  logAppend: true
storage:
  journal:
    enabled: true
  dbPath: /mongodb/38024/data
  directoryPerDB: true
  wiredTiger:
    engineConfig:
      cacheSizeGB: 1
      directoryForIndexes: true
    collectionConfig:
      blockCompressor: zlib
    indexConfig:
      prefixCompression: true
net:
  port: 38024
replication:
  oplogSizeMB: 2048
  replSetName: sh2
sharding:
  clusterRole: shardsvr
processManagement: 
  fork: true
========


cp  /mongodb/38024/conf/mongodb.conf  /mongodb/38025/conf/
cp  /mongodb/38024/conf/mongodb.conf  /mongodb/38026/conf/

sed 's#38024#38025#g' /mongodb/38025/conf/mongodb.conf -i
sed 's#38024#38026#g' /mongodb/38026/conf/mongodb.conf -i

2.3启动所有节点，并搭建复制集：

mongod -f  /mongodb/38021/conf/mongodb.conf 
mongod -f  /mongodb/38022/conf/mongodb.conf 
mongod -f  /mongodb/38023/conf/mongodb.conf 
mongod -f  /mongodb/38024/conf/mongodb.conf 
mongod -f  /mongodb/38025/conf/mongodb.conf 
mongod -f  /mongodb/38026/conf/mongodb.conf  



mongo --port 38021

use  admin
config = {_id: 'sh1', members: [
                          {_id: 0, host: '192.168.6.244:38021'},
                          {_id: 1, host: '192.168.6.244:38022'},
                          {_id: 2, host: '192.168.6.244:38023',"arbiterOnly":true}]
           }

> rs.initiate(config)


 mongo --port 38024 
 use admin
config = {_id: 'sh2', members: [
                          {_id: 0, host: '192.168.6.244:38024'},
                          {_id: 1, host: '192.168.6.244:38025'},
                          {_id: 2, host: '192.168.6.244:38026',"arbiterOnly":true}]
           }

  > rs.initiate(config)

3、config节点配置：

3.1目录创建：

mkdir -p /mongodb/38018/conf  /mongodb/38018/log  /mongodb/38018/data
mkdir -p /mongodb/38019/conf  /mongodb/38019/log  /mongodb/38019/data
mkdir -p /mongodb/38020/conf  /mongodb/38020/log  /mongodb/38020/data

3.2修改配置文件：

[mongod@server1 ~]$ vi /mongodb/38018/conf/mongodb.conf

systemLog:
  destination: file
  path: /mongodb/38018/log/mongodb.conf
  logAppend: true
storage:
  journal:
    enabled: true
  dbPath: /mongodb/38018/data
  directoryPerDB: true
  #engine: wiredTiger
  wiredTiger:
    engineConfig:
      cacheSizeGB: 1
      directoryForIndexes: true
    collectionConfig:
      blockCompressor: zlib
    indexConfig:
      prefixCompression: true
net:
  port: 38018
replication:
  oplogSizeMB: 2048
  replSetName: configReplSet
sharding:
  clusterRole: configsvr
processManagement: 
  fork: true


cp /mongodb/38018/conf/mongodb.conf /mongodb/38019/conf/
cp /mongodb/38018/conf/mongodb.conf /mongodb/38020/conf/

sed 's#38018#38019#g' /mongodb/38019/conf/mongodb.conf -i
sed 's#38018#38020#g' /mongodb/38020/conf/mongodb.conf -i

3.3启动节点，并配置复制集

mongod -f /mongodb/38018/conf/mongodb.conf 
mongod -f /mongodb/38019/conf/mongodb.conf 
mongod -f /mongodb/38020/conf/mongodb.conf 


mongo --port 38018
use  admin

 config = {_id: 'configReplSet', members: [
                          {_id: 0, host: '192.168.6.244:38018'},
                          {_id: 1, host: '192.168.6.244:38019'},
                          {_id: 2, host: '192.168.6.244:38020'}]
           }

  > rs.initiate(config)  

注：configserver 可以是一个节点，官方建议复制集。configserver不能有arbiter。新版本中，要求必须是复制集。
注：mongodb 3.4之后，虽然要求config server为replica set，但是不支持arbiter

4、mongos节点配置：

4.1创建目录：

mkdir -p /mongodb/38017/conf  /mongodb/38017/log 

4.2配置文件：

vi /mongodb/38017/conf/mongos.conf
systemLog:
  destination: file
  path: /mongodb/38017/log/mongos.log
  logAppend: true
net:
  port: 38017
sharding:
  configDB: configReplSet/192.168.6.244:38018,192.168.6.244:38019,192.168.6.244:38020
processManagement: 
  fork: true

4.3启动mongos

[mongod@server1 ~]$ mongos -f /mongodb/38017/conf/mongos.conf 

5、分片集群操作：

连接到其中一个mongos（192.168.6.244），做以下配置
（1）连接到mongs的admin数据库

# su - mongod
$ mongo 192.168.6.244:38017/admin

（2）添加分片

> db.runCommand( { addshard : "sh1/192.168.6.244:38021,192.168.6.244:38022,192.168.6.244:38023",name:"shard1"} )


> db.runCommand( { addshard : "sh2/192.168.6.244:38024,192.168.6.244:38025,192.168.6.244:38026",name:"shard2"} )

（3）列出分片

mongos> db.runCommand( { listshards : 1 } )

（4）整体状态查看
mongos> sh.status();