Re: Excessive memory used for INSERT - Mailing list pgsql-performance

From Torsten Zuehlsdorff
Subject Re: Excessive memory used for INSERT
Date
Msg-id 5491A0A8.7010506@toco-domains.de
Whole thread Raw
In response to Excessive memory used for INSERT  (Alessandro Ipe <Alessandro.Ipe@meteo.be>)
Responses Re: Excessive memory used for INSERT  (Tom Lane <tgl@sss.pgh.pa.us>)
Re: Excessive memory used for INSERT  (Alessandro Ipe <Alessandro.Ipe@meteo.be>)
List pgsql-performance
Hello Alessandro,

> 2014-12-15 17:54:07 GMT DETAIL: Failed process was running: WITH upsert
> AS (update MSG set
> (slot,MSG,HRV,VIS006,VIS008,IR_016,IR_039,WV_062,WV_073,IR_087,IR_097,IR_108,IR_120,IR_134,PRO,EPI,CLM,TAPE)
> = (to_timestamp('201212032145',
>
'YYYYMMDDHH24MI'),2,'\xffffff','\xff','\xff','\xff','\xff','\xff','\xff','\xff','\xff','\xff','\xff','\xff','\x01','\x01','\x7f','LTO5_020')
> where slot=to_timestamp('201212032145', 'YYYYMMDDHH24MI') and MSG=2
> RETURNING *) insert into MSG
> (slot,MSG,HRV,VIS006,VIS008,IR_016,IR_039,WV_062,WV_073,IR_087,IR_097,IR_108,IR_120,IR_134,PRO,EPI,CLM,TAPE)
> select to_timestamp('201212032145',
>
'YYYYMMDDHH24MI'),2,'\xffffff','\xff','\xff','\xff','\xff','\xff','\xff','\xff','\xff','\xff','\xff','\xff','\x01','\x01','\x7f','LTO5_020'
> WHERE NOT EXISTS (SELECT * FROM upsert);

How many rows is "(SELECT * FROM upsert)" returning? Without knowing
more i would guess, that the result-set is very big and that could be
the reason for the memory usage.

I would add an WHERE clause to reduce the result-set (an correct index
can fasten this method even more).

Greetings,
Torsten


pgsql-performance by date:

Previous
From: Alessandro Ipe
Date:
Subject: Excessive memory used for INSERT
Next
From: Tom Lane
Date:
Subject: Re: Excessive memory used for INSERT