Tom Lane wrote:
>I have noticed an increasing tendency among the buildfarm crew to think
>that the regression tests should show zero diffs on all platforms no
>matter what. That is not the design goal. The intent is to tell you
>about possible problems. If you decide that a particular diff isn't
>really a problem, fine, but that doesn't mean we should mask the same
>symptom everywhere.
>
>
>
>
I don't want to mask anything that shouldn't be. I made the suggestion
in this particular case because we already have a number of alternative
result files caused by FP differences.
The buildfarm is a dashboard application - when everything is OK you
want it to show all green. If that's not a goal, then some redesign is
appropriate. Perhaps buildfarm needs its own test suite, rather than
leveraging those in the distribution, although that would be a pity, to
say the least.
cheers
andrew
