boot2docker-mongodb

Bash script to start a MongoDB sharded cluster using docker on OS X (via boot2docker). It uses IP addresses for container communication.

Inspired by Alex Komyagin's mongo-docker.

Using official MongoDB docker image.

Current setup:

• 2 replica sets (3 data notes)
• 3 config servers
• 1 mongos node

Installation on Mac:

Install Homebrew

First, install Homebrew.

ruby -e "$(curl -fsSL https://raw.github.com/mxcl/homebrew/go)"

Install Virtualbox

Install VirtualBox using Brew Cask.

brew update
brew tap phinze/homebrew-cask
brew install brew-cask
brew cask install virtualbox

Install boot2docker and docker-compose

Boot2docker is a small script that helps download and setup a minimal Linux VM that will be in charge of running docker daemon.

brew install boot2docker
boot2docker init
boot2docker up
brew install docker-compose

Check out the repository

git clone [email protected]:gianpaj/boot2docker-mongodb.git
cd boot2docker-mongodb

Setup Cluster

This will pull the official MongoDB image and setup a sharded cluster.

source setup.sh

Example output:

Writing /Users/gianfranco/.boot2docker/certs/boot2docker-vm/ca.pem
Writing /Users/gianfranco/.boot2docker/certs/boot2docker-vm/cert.pem
Writing /Users/gianfranco/.boot2docker/certs/boot2docker-vm/key.pem
Creating mongo_rs1_1...
Creating mongo_rs1_2...
Creating mongo_rs1_3...
Starting mongo_rs1_1...
Starting mongo_rs1_2...
Starting mongo_rs1_3...
Creating mongo_rs2_1...
Creating mongo_rs2_2...
Creating mongo_rs2_3...
Starting mongo_rs2_1...
Starting mongo_rs2_2...
Starting mongo_rs2_3...
Initiating replica set
{ "ok" : 1 }
Initiating replica set
{ "ok" : 1 }
Creating mongo_cfg_1...
Creating mongo_cfg_2...
Creating mongo_cfg_3...
Starting mongo_cfg_1...
Starting mongo_cfg_2...
Starting mongo_cfg_3...
Starting mongos...
{ "shardAdded" : "rs1", "ok" : 1 }
{ "shardAdded" : "rs2", "ok" : 1 }
{ "nInserted" : 1 }
{
	"raw" : {
		"rs2/172.17.0.57:27017,172.17.0.58:27017,172.17.0.59:27017" : {
			"createdCollectionAutomatically" : false,
			"numIndexesBefore" : 1,
			"numIndexesAfter" : 2,
			"ok" : 1,
			"$gleStats" : {
				"lastOpTime" : Timestamp(1427043270, 3),
				"electionId" : ObjectId("550ef3b7702605233a3b52af")
			}
		}
	},
	"ok" : 1
}
{ "ok" : 1 }
{ "collectionsharded" : "test.test", "ok" : 1 }
#####################################
MongoDB Cluster is now ready to use
Connect to the cluster via docker:
$ docker exec -it mongos mongo

Connect to the cluster via OS X:
$ mongo 192.168.59.103

Connect to the sharded cluster

You should now be able connect to the new sharded cluster via the mongos node:

$ mongo 192.168.59.103
MongoDB shell version: 3.0.0
connecting to: test
Welcome to the MongoDB shell.
For interactive help, type "help".
For more comprehensive documentation, see
	http://docs.mongodb.org/
Questions? Try the support group
	http://groups.google.com/group/mongodb-user
Server has startup warnings:
2015-03-22T16:54:19.591+0000 I CONTROL  ** WARNING: You are running this process as the root user, which is not recommended.
2015-03-22T16:54:19.592+0000 I CONTROL
mongos> sh.status()
--- Sharding Status ---
  sharding version: {
	"_id" : 1,
	"minCompatibleVersion" : 5,
	"currentVersion" : 6,
	"clusterId" : ObjectId("550ef3bc06152859f0406435")
}
  shards:
	{  "_id" : "rs1",  "host" : "rs1/172.17.0.54:27017,172.17.0.55:27017,172.17.0.56:27017" }
	{  "_id" : "rs2",  "host" : "rs2/172.17.0.57:27017,172.17.0.58:27017,172.17.0.59:27017" }
  balancer:
	Currently enabled:  yes
	Currently running:  no
	Failed balancer rounds in last 5 attempts:  0
	Migration Results for the last 24 hours:
		No recent migrations
  databases:
	{  "_id" : "admin",  "partitioned" : false,  "primary" : "config" }
	{  "_id" : "test",  "partitioned" : true,  "primary" : "rs2" }
		test.test
			shard key: { "_id" : "hashed" }
			chunks:
				rs2	1
			{ "_id" : { "$minKey" : 1 } } -->> { "_id" : { "$maxKey" : 1 } } on : rs2 Timestamp(1, 0)

List docker containers

$ docker ps
CONTAINER ID        IMAGE               COMMAND                CREATED             STATUS              PORTS                      NAMES
29ab8a7ace17        mongo:latest        "/entrypoint.sh mong   3 hours ago         Up 3 hours          0.0.0.0:27017->27017/tcp   mongos
a285db10a9c9        mongo:latest        "/entrypoint.sh mong   3 hours ago         Up 3 hours          27017/tcp                  mongo_cfg_3
ea6c65693796        mongo:latest        "/entrypoint.sh mong   3 hours ago         Up 3 hours          27017/tcp                  mongo_cfg_2
7ff53954aa89        mongo:latest        "/entrypoint.sh mong   3 hours ago         Up 3 hours          27017/tcp                  mongo_cfg_1
3abf28cbe965        mongo:latest        "/entrypoint.sh mong   3 hours ago         Up 3 hours          27017/tcp                  mongo_rs2_2
4b6532f484f6        mongo:latest        "/entrypoint.sh mong   3 hours ago         Up 3 hours          27017/tcp                  mongo_rs2_3
d885bfae4069        mongo:latest        "/entrypoint.sh mong   3 hours ago         Up 3 hours          27017/tcp                  mongo_rs2_1
ede4197d5086        mongo:latest        "/entrypoint.sh mong   3 hours ago         Up 3 hours          27017/tcp                  mongo_rs1_3
0c2cabc5a65b        mongo:latest        "/entrypoint.sh mong   3 hours ago         Up 3 hours          27017/tcp                  mongo_rs1_2
f2e58d9b3201        mongo:latest        "/entrypoint.sh mong   3 hours ago         Up 3 hours          27017/tcp                  mongo_rs1_1

Auth

ln -s docker-compose.auth300.yml docker-compose.yml
ln Dockerfiles/30auth Dockerfile
docker build -t gianpaj/boot2docker_3.0.0 -f Dockerfile .

Built upon

• docker
• boot2docker
• docker-compose