New regression test time - Mailing list pgsql-hackers

From Josh Berkus
Subject New regression test time
Date
Msg-id 51CDF9A3.2060003@agliodbs.com
Whole thread Raw
Responses Re: New regression test time  (Andres Freund <andres@2ndquadrant.com>)
Re: New regression test time  (Stephen Frost <sfrost@snowman.net>)
Re: New regression test time  (Alvaro Herrera <alvherre@2ndquadrant.com>)
List pgsql-hackers
Hackers,

Per discussion on these tests, I ran "make check" against 9.4 head,
applied all of the regression tests other than DISCARD.

Time for 3 "make check" runs without new tests: 65.9s

Time for 3 "make check runs with new tests: 71.7s

So that's an increase of about 10% in test runtime (or 2 seconds per run
on my laptop), in order to greatly improve regression test coverage.
I'd say that splitting the tests is not warranted, and that we should go
ahead with these tests on their testing merits, not based on any extra
check time they might add.

-- 
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com



pgsql-hackers by date:

Previous
From: Robins Tharakan
Date:
Subject: Re: Add more regression tests for dbcommands
Next
From: Nicholas White
Date:
Subject: Re: Request for Patch Feedback: Lag & Lead Window Functions Can Ignore Nulls