Questions tagged [zookeeper]
The zookeeper tag has no summary.
47 questions
1 vote
1 answer
67 views
Best network interface assignment for Apache NiFi cluster with multiple networks (service, management, backup)
We have an 8-node Apache NiFi cluster with an external Zookeeper cluster, running on three separated networks: Service Management Backup Currently all NiFi and Zookeeper communication runs through ...
- 11
0 votes
1 answer
194 views
Can I use Zookeeper 3.7.1 with Solr 7.7.3?
Each version of Solr ships with a version of Zookeeper. Solr's docs say that you should upgrade Zookeeper if you upgrade Solr, but can you upgrade Zookeeper to a later version that is shipped with ...
- 155
0 votes
0 answers
177 views
What are the risks in running single Zookeeper instance in production?
I'm considering using Zookeeper to manage shared configuration across multiple services that live on a single application server. Usage would be very low volume, mostly reads. My production system ...
1 vote
1 answer
2k views
zookeeper ssl alert "alert bad certificate"
I am using Kafka (version 2.3.0) and Zookeeper (version 3.5.5-3) - the stable version is 3.6.3. When I test the SSL of my Zookeeper using this command: openssl s_client -showcerts -connect 127.0.0.1:...
- 13
1 vote
0 answers
793 views
Zookeeper ensemble leader reporting incorrect number of followers
I have a zookeeper ensemble running in Kubernetes consisting of 3 instances. The ensemble operates mostly correctly and successfully services the Solr cluster it is backing. One thing does seem ...
- 147
1 vote
0 answers
498 views
How can I further analyze ram usage in a possible leak? [debian@HyperV + Kafka + Zookeeper]
We have a 3-box cluster Kafka+Zookeeper, in a virtualized enviroment (in Windows 2019 HyperV). In the machines' config dynamic memory is disabled, and they have 4G RAM each (I know it's a very few ...
- 11
0 votes
1 answer
3k views
How set a fixed private IP for ECS containers?
I have a Task Definition called kafka-zookeeper, it has an Apache Kafka broker and a Zookeeper node in it. Those containers need to communicate with each other (that's easy) and with the kafka and ...
- 171
17 votes
9 answers
43k views
Unable to start kafka with zookeeper (kafka.common.InconsistentClusterIdException)
Below the steps I did to get this issue : Launch ZooKeeper Launch Kafka : .\bin\windows\kafka-server-start.bat .\config\server.properties Also note that my OS is Windows And at the second step the ...
- 271
0 votes
0 answers
3k views
zookeeper server due unable to load database on disk
We have kafka cluster with 3 nodes , each kafka include zookeeper server and schema registry We get the following error on one of the zookeeper server [2019-11-12 07:44:20,719] ERROR Unable to load ...
- 521
0 votes
1 answer
315 views
hadoop + can we install zookeeper servers on kafka hosts
we want to dedicated the zookeeper servers only for kafka machines so each kafka machine include the zookeeper server and zookeeper server will serve only the kafka host and not other application in ...
- 521
1 vote
1 answer
312 views
Dose zookeeper servers must use SSD disks?
we want to install kafka cluster and 3 zookeeper servers kafka should use the zookeeper servers in order to save the metadata on the zookeeper servers ZK Data and Log files should be on disks, which ...
- 521
2 votes
3 answers
10k views
ZooKeeper not starting because acceptedEpoch is less than the currentEpoch
I have zookeeper.version=3.4.10, and I see: https://issues.apache.org/jira/browse/ZOOKEEPER-2307 that is however in unresolved status. The problem appeared because of filling up the disk space. Now ...
- 201
1 vote
1 answer
475 views
Zookeeper best practice - using only SSD disks
we have HDP clusters version 2.6.0 / 2.6.1 ( hortonworks ) , and maybe in the future the version 3.0 I searched a lot in HORTONWORKS documentation , but not found the details about using SSD disks ...
- 521
0 votes
1 answer
6k views
kafka with ACL fails to connect zk and stops
I have a kafka installation (with ssl listener and ssl client authentication). It works fine until I try to add ACL. this is the error (full error in the bottom): [edit-1] the first error on kafka ...
- 131
1 vote
2 answers
5k views
init script for zookeeper
i have seen that the developers of zookeeper have a great zkServer.sh script to start,stop, restart etc zookeeper, but i have no idea why in the world they decided to skip init script to use. With ...
- 533
4 votes
1 answer
2k views
Kafka compatible with Zookeeper 3.5 feature 'Rebalancing Client Connections'
In this document https://zookeeper.apache.org/doc/trunk/zookeeperReconfig.html dynamic configuration functionality is described for Zookeeper 3.5. There are 2 important points in this document: When ...
- 141
2 votes
0 answers
2k views
kafka docker - ERROR when sending a message
I would like to implement kafka in a docker container. I use the official zookeper instance for kafka as docker container, too. When I want to write a message about the terminal, on my linux mint 18....
- 387
0 votes
1 answer
3k views
How to manage failover in ZooKeeper across datacenters using observers
I have an application running in 3 different datacenters that uses ZooKeeper for many tasks. Following the recommended practices, we have deployed three ZooKeeper ensembles where one datacenter ...
- 191
2 votes
0 answers
116 views
How to make ActiveMQ nodes keep their database synchronized?
I have 3 servers with Zookeeper and ActiveMQ installed. Everything seems to be working fine, however, when one of my node dies, and a new election occurs, however the new leader don't have the same ...
- 190
5 votes
1 answer
3k views
Why would using MongoDB in lieu of etcd as a key value store be a good or bad idea? [closed]
I'd like to get general thoughts from the community as to why MongoDB for key/value would OR would not be a suitable replacement for etcd or other purpose-built key/value store system (consol, ...
- 230
15 votes
1 answer
50k views
Get zookeeper cluster status
Is there a cli or some command-line, that I can use to find the zookeeper cluster status. Basically I want to know how to member in cluster or which nodes is acting as a leader. Any pointers will be ...
- 255
2 votes
1 answer
1k views
Port out of range in ReplicatedDB ActiveMQ
I have 3 replicated machines with Zookeeper and ActiveMQ (linux). I can confirm that zookeeper works correctly since I can see their ports (2888 and 3888) listening via netstat. The problem is ...
- 121
0 votes
1 answer
886 views
Why does DFSZKFailoverController kills Namenode process in hadoop?
I try to configure hadoop high availability cluster by following this tutorial: http://www.edureka.co/blog/how-to-set-up-hadoop-cluster-with-hdfs-high-availability/ When I follow that article I faces ...
- 793
2 votes
0 answers
345 views
Restoring Solr Cloud 4.7 index
I have a test environment which is created every morning and then destroyed every night. Part of the environment is a SolrCloud (version 4.7) instance connected to a remote Zookeeper cluster. The ...
- 309
4 votes
0 answers
157 views
Kafka using a distant Zookeeper instance?
we have an existing Zookeeper instance, and want to build a Kafka cluster in a remote location (not on the same side of the Atlantic ocean). Can we use that existing Zookeeper for our new Kafka usage ...
- 141
1 vote
1 answer
1k views
Zookeeper - faulty cluster member replacement
I am aware that as long as there is quorum my zookeeper ensemble will keep working. But does the missing server have any notable impact on the cluster performance? Let's suppose 1 of 3 servers ...
- 173
2 votes
2 answers
8k views
Solrcloud: Error 500 after restart
I have 3 vm windows, on all of them is installed solr 5.4.0 and 3.4.6 zookeeper; the two services start automatically when the vm start. After reboot vms the solr does not respond correctly, it gives ...
- 73
1 vote
1 answer
65 views
Issuing a single command from a cluster of servers?
I have a cluster of servers that will be running a simple ruok command with fallover. The command will be something simple like curl -X POST http://foo.com/status. Due to the fact that I will have ...
- 617
1 vote
1 answer
3k views
How to upgrade zookeeper from 3.4.5 to 3.4.6 on Ubuntu 14.04.3
I am having trouble with a zookeeper ensamble where one node is not able to join the quorum. Zookeeper will not join the cluster. How to apply patch/upgrade? This seems to be related to a bug which ...
- 2,262
0 votes
1 answer
3k views
Zookeeper will not join the cluster. How to apply patch/upgrade?
I am running a 3 node zookeeper ensemble on ubuntu 14.04. After noticing that node1 was not running, I had to remove the snapshots of this node and now the server did start, but refuses to join the ...
- 2,262
3 votes
1 answer
4k views
Zookeeper node is not able to load database on production server anymore
I am running a zookeeper ensemble of 3 on three different ubuntu 14.04 nodes. The setup used to work OK, but now I noticed the zk1 is not operational. It does also not restart: :/home/www$ sudo /etc/...
- 2,262
1 vote
0 answers
666 views
Unable to create index on solr, when using Zookeeper
Evening, I've created a what I believe to be a simple SOLR cluster, with Zookeeper (external binaries instead of the embeded). For simplicity, this cluster is: Master: SOLR1 Slave: SOLR2 Both ...
1 vote
1 answer
3k views
Gracefully take down a Zookeeper Node
I have had a hard disk begin to fail on one of my Zookeeper nodes in a cluster of 3 nodes. It is only a matter of time until the disk dies completely. Rather than waiting for this, I'd like to remove ...
- 139
1 vote
1 answer
69 views
Define marathon services listening interface
I have a mesos install with 3 VPS. I use a virtual private network for internal networking. Everytime marathon starts and bind a service to a new port, it binds it to 0.0.0.0. No matter if I had a ...
- 177
1 vote
1 answer
532 views
How to maintain zookeeper ensemble?
I have a 3 node zookeeper ensemble running from where I had trouble with one node showing a corrupt db. Now I found in the docs that it has to be cleared regularily with the help of cron running this ...
- 2,262
0 votes
2 answers
3k views
How to add second ZooKeeper to same machine?
I am running 2 dedicated servers on which I plan to install Solrcloud. I have installed ZooKeeper using apt-get install zookeeperd and ZooKeeper is running on both systems. From solr docs I learned ...
- 2,262
6 votes
4 answers
45k views
How can I stop ZooKeeper on Ubuntu?
I have installed zookeeperd on Ubuntu 14.04 (Trusty Tahr) as suggested here: Unfortunately this process is somehow not stoppable. I tried even kill -9 user@node1:/opt/zookeeper-3.4.6$ ps -ef | ...
- 2,262
0 votes
1 answer
305 views
Why does Accumulo require $ZOOKEEPER_HOME in addition to the IPs of the Zookeeper ensemble?
According to the documentation, Accumulo requires you to set $ZOOKEEPER_HOME (a local path) in the configuration files, and also requires a list of IPs for the Zookeeper ensemble. Why are IPs alone ...
1 vote
1 answer
2k views
Error 127 when trying to run Zookeeper through supervisord?
I'm getting (exit status 127; not expected) when I try to run Zookeeper through supervisord, and the errors I'm getting back aren't helpful. Running it as the normal user works just fine: [ec2-user@...
- 111
1 vote
2 answers
2k views
Apache Kafka 0.8.1.1 clean shutdown not working
I have a: single instance of Apache Kafka (2.9.2-0.8.1.1) installed from the source, using the default configuration (server.properties etc.), Zookeeper (3.4.5+dfsg-2) stand-alone, installed from the ...
- 1,415
0 votes
1 answer
6k views
HDFS' ZKFC service unable to start
CDH4's ZooKeeper Failover Controller (ZKFC) has been installed. Starting the ZKFC service: [vagrant@localhost ~]$ sudo service hadoop-hdfs-zkfc start Starting Hadoop zkfc: ...
- 6,105
2 votes
2 answers
5k views
Unable to convert HDFS from non-HA to HA
Introduction Aim: Convert HDFS from non-HA to HA. Method: According to this documentation it should be possible to convert HFDS from non- to HA by implementing following configuration: /etc/hadoop/...
- 6,105
28 votes
3 answers
65k views
What command could be issued to check whether a ZooKeeper server is a Leader or a Follower?
A ZooKeeper Quorum consisting of three ZooKeeper servers has been created. The zoo.cfg located on all three ZooKeeper servers looks as follows: maxClientCnxns=50 # The number of milliseconds of each ...
- 6,105
8 votes
1 answer
13k views
Could not start ZK at requested port of 2181, while export HBASE_MANAGES_ZK=false
Problem The first aim was to run HBase standalone. Navigating to ip:60010/master-status is succesfull once HBase has been started. The second aim is to run a distinct ZooKeeper quorum. ZooKeeper has ...
- 6,105
2 votes
2 answers
4k views
How to use nagios to monitor Zookeeper nodes
Sorry this may be a basic question, but I am new to both nagios, and zookeeper. My company has an application that uses zookeeper to track job status, by creating/destroying nodes. I need to be able ...
- 123
1 vote
1 answer
4k views
Apache Kafka consumer client connecting to Apache Zookeeper: EndOfStreamException
I get an error when trying to 'consume' messages from Kafka (2.9.2-0.8.1) with a Zookeer stand-alone (3.4.5). You can see the source code below as well as the error message and logfile from Zookeeper. ...
- 121
2 votes
2 answers
2k views
Zookeeper starts using bin/zkServer.sh but not with service nor zookeeper-server
On Linux Scientific I have installed ZooKeeper from CDH5. When starting zookeeper using sudo service zookeeper-server start or zookeeper-server start it reports the server running, but fails silently....
- 21