thumperversion Documentation on ocaml.org

Micro-benchmarks as regression tests for OCaml

Thumper measures OCaml micro-benchmarks and checks them against a committed baseline, so a dune rule fails the build when a case regresses beyond its budget. The baseline stores the evidence, sorted timing samples and exact allocation counts, in one section per machine. A timing comparison is a rank test, and a regression or improvement stands only when a confirmation pass in the same run reproduces it; an exact count compares as an integer. A comparison that cannot decide is inconclusive and fails nothing. A case with no baseline row yet is proposed and passes, and fails only under --strict; bless records the baseline. Thumper depends on the unix library alone. On Unix each case runs in a forked worker.

AuthorThibaut Mattio <thibaut.mattio@gmail.com>
LicenseISC
Published
Homepagehttps://github.com/invariant-hq/thumper
Issue Trackerhttps://github.com/invariant-hq/thumper/issues
MaintainerThibaut Mattio <thibaut.mattio@gmail.com>
Dependencies
Source [http] https://github.com/invariant-hq/thumper/releases/download/v0.1.0/thumper-0.1.0.tbz
sha256=ccf45c4d2bfd6444270c51317e2b83e531d8e4bdc09d5bdb1d0069cd7fe2e43d
sha512=68510d10a959bb89e0a03b48b136f65b31904dfcbc37f2ecd2c8b58f0dd852b6aed5d03fc659c952ca5745762b35ce6042ef147f63360db4270d6da6a20589cc
Edithttps://github.com/ocaml/opam-repository/tree/master/packages/thumper/thumper.0.1.0/opam
No package is dependent