Error: "Out of memory while reading tuples." in pushing table from SAS to PostgreSQL on Mac - Mailing list pgsql-general

From wetter wetterana
Subject Error: "Out of memory while reading tuples." in pushing table from SAS to PostgreSQL on Mac
Date
Msg-id CAMPbDaX3QP0Rsj8yp+fVP=c_nUm5WvGvbCfrSMrcKLL3axuLbw@mail.gmail.com
Whole thread Raw
Responses Re: Error: "Out of memory while reading tuples." in pushing table from SAS to PostgreSQL on Mac  (Adrian Klaver <adrian.klaver@aklaver.com>)
Re: Error: "Out of memory while reading tuples." in pushing table from SAS to PostgreSQL on Mac  (Andy Colson <andy@squeakycode.net>)
List pgsql-general
Hi,

I'm passing rows from SAS to PostgreSQL (I assign a libname and use a PROC APPEND).  This works fine with smaller tables (~below 1 million rows).  However, as tables get larger I receive the following error messages:


"ERROR: CLI describe error: Out of memory while reading tuples.; No query has been executed with that handle"
and
"GLOBAL SYSDBMSG POSTGRES: Out of memory while reading tuples.; No query has been executed with that handle
GLOBAL SYSDBRC HY000"

I've tried to change memory settings on the PostgreSQL server, but can't solve the problem.  As far as I could understand—I'm new to PostgreSQL ;)—it seems that PostgreSQL want to somehow read information on the whole table before processing it and this behavior could eventually be switched off, but I might be wrong here. 

FYI: 
- I run SAS 9.4 on a windows machine.  
- I run PostgreSQL server on a MAC: PostgreSQL 9.3.5 on x86_64-apple-darwin12.5.0, compiled by Apple LLVM version 5.1, 64-bit
  I've Pgadmin 1.18.1 installed. 

Any help would be much appreciated!!

THANKS!


PS: For several reasons, I cannot use the bulkload feature in SAS for this job.

pgsql-general by date:

Previous
From: Andy Colson
Date:
Subject: Re: Database and OS monitoring
Next
From: Michael Nolan
Date:
Subject: Blocking access by remote users for a specific time period