bistro

Author Philippe Veber <philippe.veber@gmail.com>
License GPL
Homepage https://github.com/pveber/bistro/
Issue Tracker https://github.com/pveber/bistro/issues
Maintainer Philippe Veber <philippe.veber@gmail.com>
Dependencies
& core
dbm
lwt
oasis
ocamlfind
ppx_tools
pvem
rresult
sexplib 113.24.00
Published May 19, 2016
Source [http] http://github.com/pveber/bistro/archive/v0.1.0.tar.gz
2e1b5dabade11d518da4549b6c93e161
Statistics Installed 6 times in last month.
Edit https://github.com/ocaml/opam-repository/tree/master/packages/bistro/bistro.0.1.0/opam

A library to build and run distributed workflows

bistro is an OCaml library to build and run computations represented by a collection of interdependent scripts, as is often found in data analysis (especially computational biology).

Features:

  • build complex and composable workflows declaratively
  • simple and lightweight wrapping of new components
  • resume-on-failure: if something fails, fix it and the workflow will restart from where it stopped
  • parallel workflow execution (locally or over a PBS cluster)
  • development-friendly: when a script is modified, bistro automatically finds out what needs to be recomputed
  • automatic naming of generated files
  • static typing: detect file format errors at compile time!

The library provides a datatype to represent scripts (including metadata and dependencies), an engine to run workflows and a standard library providing components for popular tools (although mostly related to computational biology and unix for now).

No package is dependent