Geek Answers Handbook

What are the differences between zookeeper, node task log and quorum log manager in hadoop?

When studying material on several sites and videos, I am confused with the functionality and differences for the three components of hadoop ZooKeeper, Journal Node, and Quorum magazine manager.

Can someone explain to me the reasons for inventing each of the above and the differences in the goals and functions of the three above-mentioned components?

Thanks in advance.

+4
source share
3 answers

: zookeeper - , factory , node - , factory . QJM - HA .

zookeeper hbase regionservers hadoop, zookeeper.

node datanodes namenode.

QJM , node

hasoop node

+5

-, . , "", , ; . Zookeeper Journal Nodes.

.

Zookeeper: Zookeeper , . , , , ( ) .. . , 80 , , . . , 12 . . zookeeper. Zookeeper . ( . why?), Zookeeper ( ) .

Node. Hadoop Namenodes, / . Active namenode node . node node , . Zookeeper, ( . ?), node Quorum.

, node, (vm ).

+2

1. Zookeeper

ZooKeeper - , , .

Zookeeper Hadoop:

Hadoop Namenode ZooKeeper , , node - .

:

Hadoop Namenode?

2. JournalNode ( Namenode)

, Standby node Active node, , "JournalNodes" (JNs).

JournalNode - , JournalNodes. JournalNode , Hadoop, NameNodes, JobTracker YARN ResourceManager.

. 3 JournalNode , JN. .

3. Quorum Journal (QJM)

It is important to note that when using the Quorum Log Manager , only one NameNode will be allowed to be written to JournalNodes , therefore there is no potential for distorting file system metadata from a split-brain script.

0
source

More articles:


All Articles