Geek Answers Handbook

Software needed to create a cluster

I was thinking about getting a little greener with my computers and using a few lower power mini x-boards on my next computer. Some can generate less than 10 watts and are quite inexpensive.

So, I thought that if such a low cost and low power, why not try to make a cluster of them? However, I'm not quite sure what I need to do in terms of the operating system or management software to make this happen?

Can someone give advice on existing software to do this, or any ideas on how to create your own?

+4
source share
4 answers

What you want to actually do with your type of cluster decides what software you need.

  • Do you need work planning?
  • Monitoring tools?
  • Do you need to deploy software across all nodes at once without any problems?
  • One file system on all nodes (recommended).

You can just as easily install Linux or * BSD on boards and just use ssh to manage and run jobs across all nodes. No other software is required.

Software you may find useful:

  • PBS (mainly job scheduling, google)
  • Kerrighed (Single System Image, Linux distro)
  • Rocks (Cluster Based Distribution)
  • Mosix (cluster management, openMosix also)
  • Ganglia (Monitoring, possibly for the kill for you)
  • Luster (Sun's super fast, open source file server)
+5
source

Take a look at beowulf to get started.

As the saying goes, the best advice I can give is to carefully measure whether you are actually more green with your cluster. I used to be a little behind this path, and, in my experience, the losses associated with having many separate computers ultimately destroy any energy savings. Keep in mind that every computer needs a power source that converts your household voltage to the level that your computer needs. Conversion is inefficient and generates heat (which is why power supplies have fans). The same can be said for every hard drive, RAM-board and motherboard that you need.

This should not impede you in the project. Just be sure to profile. Just like writing software! :)

+2
source

You can use Beowulf to start a cluster.

+1
source

There is a lot in this matter.

Firstly, if you just want to start a cluster and start it, there are many suggestions listed here. However, as soon as you start the cluster, you are just starting.

At this point, you need to have software that will work correctly in the cluster. If you are working on your software, you will need to parallelize it in the cluster using something like MPI .

Without software written to work on a cluster, a cluster is nothing more than a highly customizable box that does nothing special ...

0
source

More articles:


All Articles