Cluster computing in Go

Question

Is there a platform for cluster computing in Go? (I want to combine several PCs for user parallel computing and wonder if Go might be the right language to use).

Answer 1

I do not know the level of connectivity that you plan to have in your cluster, but the transition of the RPC packet makes communication between nodes trivial. Most likely, this will be the basis of your work, and you can create abstractions on top of it (for example, if you need multicast requests to different nodes). The examples in this document assume that your nodes will communicate via HTTP, but this bit is abstracted into net / rpc to allow various transports.

http://golang.org/pkg/net/rpc/

Answer 2

You can use Hadoop Streaming with Go. See the (A bit dated) example here .

Answer 3

You can try using https://github.com/bketelsen/skynet . This is a service oriented structure based on doozer.

Answer 4

You should take a look at Go Circuit .

Quote from the introduction:

The scheme reduces the cost of human development and life support of complex large-scale systems almost to the level of their uniprocessor counterparts ....

... and:

For isntance, we were able to write large real-world cloud applications - for example, MapReduce multi-stage streaming pipelines - in as many as 200 lines of code from ground to top.

Also, for some simpler use cases, you can check out Golem .