Re: float output precision questions - Mailing list pgsql-hackers

From Bruno Wolff III
Subject Re: float output precision questions
Date
Msg-id 20021031233328.GA16088@wolff.to
Whole thread Raw
In response to Re: float output precision questions  (Tom Lane <tgl@sss.pgh.pa.us>)
Responses Re: float output precision questions  (Tom Lane <tgl@sss.pgh.pa.us>)
List pgsql-hackers
On Thu, Oct 31, 2002 at 12:58:21 -0500, Tom Lane <tgl@sss.pgh.pa.us> wrote:
> 
> But I think an EXTRA_DIGITS setting might be interesting.  In
> particular, suppose we allowed EXTRA_DIGITS to be negative?  Setting
> it to -1 or -2 would go a long way towards eliminating our problems
> with platform variations in the geometry regression test.

My attempt to avoid this problem with the earthdistance regression used
a cast to numeric to limit the number of digits to the right of the
decimal point.

If the normal number of digits displayed is different between two systems,
than displaying a fixed number less digits is still going to result in
differences.


pgsql-hackers by date:

Previous
From: Tom Lane
Date:
Subject: Re: pg_dump and large files - is this a problem?
Next
From: Tom Lane
Date:
Subject: Re: float output precision questions