So I wrote this benchmark analyzer to analyze benchmarks that have many parameters and try to figure out what the important ones are. To that end, it creates a decision tree in R, and also generates lots of boxplots to visualize the different parameters. Here’s a sample report (with boring data). It also (somewhat cleverly) saves the original .csv file with the web page it generates, so you can save the page and send it to a colleague who can play with the options and rerun the analysis.
It occurred to me as I was prettying this up that most benchmarks don’t involve lots of parameters, and so the probability that anyone else is going to find this useful is pretty low. I’m OK with that because
– it’s useful to me right this very moment for work stuff
– I had fun writing it and learned some more about R
– pretty graphs!
– it was good to work on something other than whereslunch.org for a while