@hackage kudzu0.1.1.0

coverage driven random testing framework

KUDZU will slowly grow to cover all of your code

Kudzu is a library that throws test cases at your property tests until the code coverage no longer increases.

WHY?

Property testing has no feedback loop, you randomly choose a number of test cases and hope for the best.

How do you know if your property tests were any good? The best feedback I know is to use hpc and look at the pretty colored HTML output to see what code was exercised.

But wait, why do I have to look at the output? Isn't that why we have computers?

HOW?

In Haskell, you can get code coverage results while your program is running!

WHAT FEEDBACK LOOP?

The simplest feedback loop is to keep running random tests until new code coverage stops increasing.

HOW DO I MAKE IT GO?

  1. add kudzu to your test-suite depends,
  2. import the Kudzu module
  3. call the testUntil function of your choice
    1. testUntilSameQCMany or testUntilSameQC
    2. testUntilSameHHMany or testUntilSameHH
    3. testUntilSameLCMany or testUntilsameLC
  4. run with cabal test --enable-coverage

TELL ME MORE

The best write up of this idea is Random Test Generation, Coverage Based.

TODO

  • support HedgeHog
  • support QuickCheck
  • support LeanCheck
  • figure out how to use Kudzu on Kudzu without looping forever

EXAMPLE

You can see kudzu in use in the tests for takedouble