pg_dump out of memory for large table with LOB - Mailing list pgsql-general

From Jean-Marc Lessard
Subject pg_dump out of memory for large table with LOB
Date
Msg-id 8FC5F25FF3EC4744ADFCF20CBA3F44BE016811BCEF@SRV-CAMTL-EXCH2.Forensictech.com
Whole thread Raw
Responses Re: pg_dump out of memory for large table with LOB
Re: pg_dump out of memory for large table with LOB
List pgsql-general

I am running PostgreSQL 9.6.5 on x86_64-pc-mingw64, compiled by gcc.exe (Rev5, Built by MSYS2 project) 4.9.2, 64-bit

on win2012 with 12Gb RAM

The dumped table is 0.5TB, 17 million rows and LOB uses about 99% of the space.

The pg_dump consumes the entire system memory and swap, then terminates with out of memory error

Is it a bug or normal behavior?

If I do not include LOB in the dump, it works fine.

 

Here is the dump output:

C:\Users\Administrator> pg_dump -h localhost -Fc -a -b -t signatures -v > d:\postgresql\sig.dmp

pg_dump: last built-in OID is 16383

...

pg_dump: reading row security enabled for table "ibisl1.signatures"

pg_dump: reading policies for table "ibisl1.signatures"

pg_dump: reading large objects

pg_dump: reading dependency data

pg_dump: saving encoding = UTF8

pg_dump: saving standard_conforming_strings = on

out of memory

Jean-Marc Lessard
Administrateur de base de données / Database Administrator
Ultra Electronics Forensic Technology Inc.
T +1 514 489 4247 x4164
www.ultra-forensictechnology.com

pgsql-general by date:

Previous
From: Laurenz Albe
Date:
Subject: Re: index only scan question
Next
From: Ron
Date:
Subject: Re: pg_dump out of memory for large table with LOB