paranyversion

Parallelize any computation

Generalized map reduce for parallel computers (not distributed computing). Can process in parallel an infinite stream of elements.

Can process a very large file in parallel on a multicore computer; provided there is a way to cut your file into independent blocks (the 'demux' function). The processing function is called 'work'. The function gathering the results is called 'mux'. The number of processors running your computation in parallel is called 'nprocs'. The chunk size (number of items) processed by one call to the 'work' function is called 'csize'.

There is a minimalist Parmap module, if you want to switch to/from Parmap easily.

Read the corresponding ocamldoc before using.

USING THIS LIBRARY IN A MISSION CRITICAL, LONG-RUNNING SOFTWARE THAT IS NEVER SUPPOSED TO CRASH IS NOT ADVIZED. WHILE THIS LIBRARY IS HIGH PERFORMANCE, IT IS ALSO DANGEROUS. USE AT YOUR OWN RISKS.

AuthorFrancois Berenger
LicenseLGPL-2.0-or-later
Published
Homepagehttps://github.com/UnixJunkie/parany
Issue Trackerhttps://github.com/UnixJunkie/parany/issues
Maintainerunixjunkie@sdf.org
Dependencies
Source [http] https://github.com/UnixJunkie/parany/archive/v12.0.2.tar.gz
sha256=22a1a4d2d6779d1580a6b0d7ce68ea8ec7a1f9a09046b5531b70159bc82005b4
md5=152ce95487d98b8546757c6e31a455aa
Edithttps://github.com/ocaml/opam-repository/tree/master/packages/parany/parany.12.0.2/opam
Required by