Zookeeper Started
Zookeeper Started
by
Table of contents
1 Getting Started: Coordinating Distributed Applications with ZooKeeper......................... 2
1.1 Pre-requisites.................................................................................................................2
1.2 Download...................................................................................................................... 2
1.3 Standalone Operation....................................................................................................2
1.4 Managing ZooKeeper Storage...................................................................................... 3
1.5 Connecting to ZooKeeper.............................................................................................3
1.6 Programming to ZooKeeper......................................................................................... 6
1.7 Running Replicated ZooKeeper....................................................................................6
1.8 Other Optimizations......................................................................................................7
1.1 Pre-requisites
See System Requirements in the Admin guide.
1.2 Download
To get a ZooKeeper distribution, download a recent stable release from one of the Apache
Download Mirrors.
tickTime=2000
dataDir=/var/lib/zookeeper
clientPort=2181
This file can be called anything, but for the sake of this discussion call it conf/zoo.cfg.
Change the value of dataDir to specify an existing (empty to start with) directory. Here are
the meanings for each of the fields:
tickTime
the basic time unit in milliseconds used by ZooKeeper. It is used to do heartbeats and the
minimum session timeout will be twice the tickTime.
dataDir
the location to store the in-memory database snapshots and, unless specified otherwise,
the transaction log of updates to the database.
clientPort
the port to listen for client connections
Now that you created the configuration file, you can start ZooKeeper:
Copyright © 2008-2013 The Apache Software Foundation. All rights reserved. Page 2
ZooKeeper Getting Started Guide
bin/zkServer.sh start
ZooKeeper logs messages using log4j -- more detail available in the Logging section of the
Programmer's Guide. You will see log messages coming to the console (default) and/or a log
file depending on the log4j configuration.
The steps outlined here run ZooKeeper in standalone mode. There is no replication, so
if ZooKeeper process fails, the service will go down. This is fine for most development
situations, but to run ZooKeeper in replicated mode, please see Running Replicated
ZooKeeper.
or
LD_LIBRARY_PATH=. cli_st 127.0.0.1:2181
This will give you a simple shell to execute file system like operations on ZooKeeper.
Once you have connected, you should see something like:
Connecting to localhost:2181
log4j:WARN No appenders could be found for logger (org.apache.zookeeper.ZooKeeper).
log4j:WARN Please initialize the log4j system properly.
Welcome to ZooKeeper!
JLine support is enabled
[zkshell: 0]
Copyright © 2008-2013 The Apache Software Foundation. All rights reserved. Page 3
ZooKeeper Getting Started Guide
From the shell, type help to get a listing of commands that can be executed from the client,
as in:
[zkshell: 0] help
ZooKeeper host:port cmd args
get path [watch]
ls path [watch]
set path data [version]
delquota [-n|-b] path
quit
printwatches on|off
createpath data acl
stat path [watch]
listquota path
history
setAcl path acl
getAcl path
sync path
redo cmdno
addauth scheme auth
delete path [version]
setquota -n|-b val path
From here, you can try a few simple commands to get a feel for this simple command line
interface. First, start by issuing the list command, as in ls, yielding:
[zkshell: 8] ls /
[zookeeper]
Next, create a new znode by running create /zk_test my_data. This creates a new
znode and associates the string "my_data" with the node. You should see:
[zkshell: 11] ls /
[zookeeper, zk_test]
Next, verify that the data was associated with the znode by running the get command, as in:
We can change the data associated with zk_test by issuing the set command, as in:
(Notice we did a get after setting the data and it did, indeed, change.
Finally, let's delete the node by issuing:
Copyright © 2008-2013 The Apache Software Foundation. All rights reserved. Page 5
ZooKeeper Getting Started Guide
[zookeeper]
[zkshell: 18]
That's it for now. To explore more, continue with the rest of this document and see the
Programmer's Guide.
tickTime=2000
dataDir=/var/lib/zookeeper
clientPort=2181
initLimit=5
syncLimit=2
server.1=zoo1:2888:3888
server.2=zoo2:2888:3888
server.3=zoo3:2888:3888
The new entry, initLimit is timeouts ZooKeeper uses to limit the length of time the
ZooKeeper servers in quorum have to connect to a leader. The entry syncLimit limits how
far out of date a server can be from a leader.
With both of these timeouts, you specify the unit of time using tickTime. In this example,
the timeout for initLimit is 5 ticks at 2000 milleseconds a tick, or 10 seconds.
The entries of the form server.X list the servers that make up the ZooKeeper service. When
the server starts up, it knows which server it is by looking for the file myid in the data
directory. That file has the contains the server number, in ASCII.
Finally, note the two port numbers after each server name: " 2888" and "3888". Peers use
the former port to connect to other peers. Such a connection is necessary so that peers
can communicate, for example, to agree upon the order of updates. More specifically, a
ZooKeeper server uses this port to connect followers to the leader. When a new leader arises,
a follower opens a TCP connection to the leader using this port. Because the default leader
Copyright © 2008-2013 The Apache Software Foundation. All rights reserved. Page 6
ZooKeeper Getting Started Guide
election also uses TCP, we currently require another port for leader election. This is the
second port in the server entry.
Note:
If you want to test multiple servers on a single machine, specify the servername as localhost with
unique quorum & leader election ports (i.e. 2888:3888, 2889:3889, 2890:3890 in the example above)
for each server.X in that server's config file. Of course separate dataDirs and distinct clientPorts are
also necessary (in the above replicated example, running on a single localhost, you would still have
three config files).
Copyright © 2008-2013 The Apache Software Foundation. All rights reserved. Page 7