Geek Answers Handbook

Is there a parallel way to access Netcdf files in Python

Is there a way to do parallel I / O for Netcdf files in Python?

I understand that there is a PyPNetCDF project, but it seems to be old, not updatable, and doesn't seem to work at all. Has anyone had success with parallel IOs with NetCDF in Python?

Any help is appreciated

+4
source share
2 answers

I have not seen good examples from the two Python NetCDF modules, see https://github.com/Unidata/netcdf4-python/issues/345 However, if you only need to read files and they are in NetCDF4 format, you should be able to directly use HDF5 - http://docs.h5py.org/en/latest/mpi.html because NetCDF4 is basically HDF5 with a limited data model. Probably will not work with NetCDF3.

+1
source

Too bad PyPnetcdf is no more mature. I see hardcoded paths and domain names left. It doesn't look like it takes a lot of something to compile the compilation, but then the problem is to get it to actually work ...

  • setup.py library_dirs_list include_dirs_list, , Northwestern/Argonne Parallel-NetCDF MPI-.

  • , pypnetcdf pnetcdf. ( , ) .

+2

More articles:


All Articles