Geek Answers Handbook

How to share python tasks over a network

I have a python program that runs several independent and time-consuming processes. Python code is usually an automaton that calls multiple batch files through popen.

The program currently takes several hours, so I would like to share it on several machines. How can I share tasks for processing in parallel with python through the intranet?

+5
source share
3 answers

There are many Python parallelization structures. Only two options:

  • IPython Parallel Computing

  • Structure parallelization jug

+5
source

execnet. ?

0

I could offer STAF . It is touted as a software testing platform, but it allows you to distribute actions across multiple PCs (and across multiple platforms). You can run scripts, copy data, and easily communicate between multiple sessions. Best of all, it integrates quite easily with existing scripts.

0
source

More articles:


All Articles