I try to run the Hadoop balancing command as follows:
hasoop balancer -threshold 1
But I get some WARN messages as
Failed to move blk_1073742036_1212 with size = 134217728 from 192.168.30.4►0010 to 192.168.30.2►0010 to 192.168.30.4►0010: block move was blocked: could not get block 1073742036 from /192.168.10.3: 53115 because the thread quota was exceeded.
And at the end ...
No block was moved for 5 iterations. Exit ... Balancing took 4.092883333333333 minutes
I set ulimit values as follows:
size of the main file (blocks, -c) 0
data seg size (kbytes, -d) unlimited
planning priority (-e) 0
file size (blocks, -f) unlimited
waiting signals (-i) 2065455
maximum locked memory (kbytes, - l) unlimited
maximum memory (kbytes, -m) unlimited
open files (-n) 64000
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited maximum user processes (-u) 65535
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
But still I get the same error.
-, , . .