The mean is a terrible estimator in the presence of outliers, in https://tealquaternion.camdvr.org/compare.html?start=dd0802b7462871a7d454af069fa0677c20d2edb0&end=0f2031fd150d453d8e86990e500f26c78c43adfa&stat=min-wall-time
I'd be more interested in seeing the median than the mean (or perhaps both, which is what BenchmarkTools.jl does).
CC @Zentrik.
The mean is a terrible estimator in the presence of outliers, in https://tealquaternion.camdvr.org/compare.html?start=dd0802b7462871a7d454af069fa0677c20d2edb0&end=0f2031fd150d453d8e86990e500f26c78c43adfa&stat=min-wall-time
I'd be more interested in seeing the median than the mean (or perhaps both, which is what BenchmarkTools.jl does).
CC @Zentrik.