Geek Answers Handbook

Open Source Raster Computing / Cloud Computing

I was wondering if anyone knows of good open source projects for distributed computing? I have a program that uses computing resources intensively, which can benefit from distributed computing (a la SETI @Home, etc.) And you want to know if anyone saw such a thing, or I will develop it from scratch ?

+4
source share
6 answers

Here is one for java and one for C #, but here is the open source toolkit .

+2
source

I see that this is more than a year, but this is a new and relevant answer

http://openstack.org/

+3
source

SETI @Home uses BOINC

+2
source

Hadoop, if you want to start the machines yourself. Amazon Elastic MapReduce if you want others to manage your workers. Amazon Elastic MapReduce is based on Hadoop.

0
source

MPAPI - View of parallel and distributed applications.

  • Sector 0 Article: http://sector0.dk/?page_id=15 .

  • Gives a good overview of the framework, architecture and
    theories behind her.

  • Runs on the same machine up to 'n'
    cars.

  • Design distributed logic in a system.

  • Focuses on messaging to isolate a state in which each thread has access, for example, without a general message state.

  • Is open source =] and is MONO Compatible YAY!

Architecture in a Nutshell

Cluster

  • Single Home Node
  • Manages a cluster
  • Numerous nodes (one per machine) that are the workhorses of the cluster
  • Single registration server - binds the cluster together, allowing nodes to register / unregister with cluster notification existing nodes

Communication

  • Node to Node. Each worker communicates with others through node.
  • Messages are not propagated down through the remote until two different nodes are involved.
0
source

I personally used BOINC , which is a reliable solution, widely used and offers you a wide range of options in terms of customization.
This is the most complete solution that I know. The only problems I encountered were that it was difficult to use for a remote job (if you do not have access to the server), and this might be a little longer to configure. But overall this is a very good solution.

If you prefer to implement distributed computing only through a local grid, you can use GridCompute , which you need to quickly configure and allow you to use your application through python scripts.

PS: I'm a GridCompute developer.

0
source

More articles:


All Articles