Geek Answers Handbook

Array memory allocation using MPI

I use C and MPI. How is memory allocated for arrays if the program runs on multiple processors on the same computer? Is this array distributed among all participating tasks or does each task have its own copy?

+5
source share
2 answers

Each rank has its own copy of the data. They usually run in separate processes and thus do not have a virtual address space.

Implementations such as Adaptive MPI and Phoenix have added several ranks on threads in the overall process, but they take steps to isolate each rank to think that it works as a separate process.

+6
source

MPI is distributed memory. It has only a limited concept of shared memory processing. If shared memory plays an important role in the performance of your program, I suggest you study OpenMP ; both can be combined in one application. (Ie, each node will work, ideally, with one OpenMP-based process that will communicate with other instances via MPI.)

+3
source

More articles:


All Articles