How to configure Hadoop in Docker Swarm?

Question

I would like to be able to start a Hadoop cluster in Docker by distributing Hadoop nodes to different physical nodes using swarm .

I found a sequenceiq image that allows hadoop to run in a docker container, but that does not allow me to use multiple nodes. I also looked at the cloudbreak project, but it seems to need an openstack installation, which seems a bit overkill, because it seems to me that only a swarm should be enough to do what we need.

I also found this Question + question in Stackoverflow, which relies on weaving that requires sudo rights that our admin won't give everyone.

Is there a solution, so the beginning of the hadoop cluster boils down to launching several containers through a swarm?

Answer 1

I can’t give a definitive answer, but if you want to install it without administrator privileges and all the answers to this question , I’m not afraid that you may be lucky.

Consider asking the administrator why he does not want to grant access to the court, there is a possibility that either you can take away his doubts, or it turns out that what you want to do is undesirable.