Re: [8.0.0] out of memory on large UPDATE - Mailing list pgsql-bugs

From Marc G. Fournier
Subject Re: [8.0.0] out of memory on large UPDATE
Date
Msg-id 20050811231801.I1002@ganymede.hub.org
Whole thread Raw
In response to Re: [8.0.0] out of memory on large UPDATE  ("Marc G. Fournier" <scrappy@postgresql.org>)
List pgsql-bugs
Just as a reminder, this is an 8.0.0 install, so if you think this might
have been fixed in later sub-releases, plesae let me know and I'll
upgrade/test again ...

On Thu, 11 Aug 2005, Marc G. Fournier wrote:

> On Thu, 11 Aug 2005, Marc G. Fournier wrote:
>
>> On Thu, 11 Aug 2005, Tom Lane wrote:
>>
>>> "Marc G. Fournier" <scrappy@postgresql.org> writes:
>>>> On Thu, 11 Aug 2005, Tom Lane wrote:
>>>>> If you've got any AFTER UPDATE triggers on that table, you could be
>>>>> running out of memory for the pending-triggers list.
>>>
>>>> Nope, only have a BEFORE UPDATE, or would that be similar except for at
>>>> which point it runs out of memory?
>>>
>>> Nope, BEFORE UPDATE shouldn't result in any permanent memory
>>> accumulation.
>>>
>>> An out-of-memory error should result in a long report in the postmaster
>>> log about how many bytes in each memory context --- can you post that?
>>
>> This is all I'm seeing in the logs:
>>
>> # grep "\[653\]" pgsql
>> Aug 11 08:45:47 pgsql80 pg[653]: [34-1] ERROR:  out of memory
>> Aug 11 08:45:47 pgsql80 pg[653]: [34-2] DETAIL:  Failed on request of size
>> 32.
>
> 'k, does this help any?
>
> TopMemoryContext: 40960 total in 4 blocks; 8632 free (10 chunks); 32328 used
> SPI Plan: 3072 total in 2 blocks; 1728 free (0 chunks); 1344 used
> TopTransactionContext: 534765568 total in 74 blocks; 2144 free (68 chunks);
> 534763424 used
> ExecutorState: 8192 total in 1 blocks; 7648 free (3 chunks); 544 used
> MessageContext: 57344 total in 3 blocks; 30312 free (11 chunks); 27032 used
> PortalMemory: 8192 total in 1 blocks; 8040 free (0 chunks); 152 used
> PortalHeapMemory: 1024 total in 1 blocks; 896 free (0 chunks); 128 used
> ExecutorState: 122880 total in 4 blocks; 98912 free (127 chunks); 23968 used
> ExprContext: 8192 total in 1 blocks; 7656 free (0 chunks); 536 used
> ExprContext: 0 total in 0 blocks; 0 free (0 chunks); 0 used
> CacheMemoryContext: 516096 total in 6 blocks; 134272 free (3 chunks); 381824
> used
> xa_url_tuid_idx: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> xa_url_spiderlite_signature_check_idx: 1024 total in 1 blocks; 912 free (0
> chunks); 112 used
> xa_url_priority_idx: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> urls_status: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> urls_logger_status: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> url_url: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> xa_url_id_pk: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> pg_index_indrelid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112
> used
> pg_attrdef_adrelid_adnum_index: 1024 total in 1 blocks; 848 free (0 chunks);
> 176 used
> pg_type_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> pg_type_typname_nsp_index: 1024 total in 1 blocks; 848 free (0 chunks); 176
> used
> pg_statistic_relid_att_index: 1024 total in 1 blocks; 848 free (0 chunks);
> 176 used
> pg_shadow_usesysid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112
> used
> pg_rewrite_rel_rulename_index: 1024 total in 1 blocks; 848 free (0 chunks);
> 176 used
> pg_proc_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> pg_proc_proname_args_nsp_index: 1024 total in 1 blocks; 712 free (0 chunks);
> 312 used
> pg_operator_oprname_l_r_n_index: 1024 total in 1 blocks; 712 free (0 chunks);
> 312 used
> pg_namespace_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> pg_namespace_nspname_index: 1024 total in 1 blocks; 912 free (0 chunks); 112
> used
> pg_language_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> pg_language_name_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> pg_inherits_relid_seqno_index: 1024 total in 1 blocks; 848 free (0 chunks);
> 176 used
> pg_group_sysid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> pg_group_name_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> pg_conversion_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112
> used
> pg_conversion_name_nsp_index: 1024 total in 1 blocks; 848 free (0 chunks);
> 176 used
> pg_conversion_default_index: 1024 total in 1 blocks; 712 free (0 chunks); 312
> used
> pg_opclass_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> pg_opclass_am_name_nsp_index: 1024 total in 1 blocks; 776 free (0 chunks);
> 248 used
> pg_cast_source_target_index: 1024 total in 1 blocks; 848 free (0 chunks); 176
> used
> pg_attribute_relid_attnam_index: 1024 total in 1 blocks; 848 free (0 chunks);
> 176 used
> pg_amop_opr_opc_index: 1024 total in 1 blocks; 848 free (0 chunks); 176 used
> pg_aggregate_fnoid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112
> used
> pg_shadow_usename_index: 1024 total in 1 blocks; 912 free (0 chunks); 112
> used
> pg_trigger_tgrelid_tgname_index: 1024 total in 1 blocks; 848 free (0 chunks);
> 176 used
> pg_operator_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> pg_amproc_opc_proc_index: 1024 total in 1 blocks; 776 free (0 chunks); 248
> used
> pg_amop_opc_strat_index: 1024 total in 1 blocks; 776 free (0 chunks); 248
> used
> pg_index_indexrelid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112
> used
> pg_attribute_relid_attnum_index: 1024 total in 1 blocks; 848 free (0 chunks);
> 176 used
> pg_class_oid_index: 1024 total in 1 blocks; 912 free (0 chunks); 112 used
> pg_amproc_opc_proc_index: 1024 total in 1 blocks; 776 free (0 chunks); 248
> used
> pg_amop_opc_strat_index: 1024 total in 1 blocks; 776 free (0 chunks); 248
> used
> pg_class_relname_nsp_index: 1024 total in 1 blocks; 848 free (0 chunks); 176
> used
> MdSmgr: 8192 total in 1 blocks; 5968 free (0 chunks); 2224 used
> DynaHash: 8192 total in 1 blocks; 6088 free (0 chunks); 2104 used
> Type information cache: 8192 total in 1 blocks; 2008 free (0 chunks); 6184
> used
> PLpgSQL function cache: 24576 total in 2 blocks; 14280 free (7 chunks); 10296
> used
> CFuncHash: 8192 total in 1 blocks; 5080 free (0 chunks); 3112 used
> Operator class cache: 8192 totalin 1 blocks; 5080 free (0 chunks); 3112 used
> smgr relation table: 8192 total in 1 blocks; 1984 free (0 chunks); 6208 used
> Portal hash: 8192 total in 1 blocks; 2008 free (0 chunks); 6184 used
> Relcache by OID: 8192 total in 1 blocks; 3520 free (0 chunks); 4672 used
> Relcache by name: 24576 total in 2 blocks; 13240 free (5 chunks); 11336 used
> LockTable (locallock hash): 8192 total in 1 blocks; 4056 free (0 chunks);
> 4136 used
> ErrorContext: 8192 total in 1 blocks; 8176 free (4 chunks); 16 used
>
> ----
> Marc G. Fournier           Hub.Org Networking Services (http://www.hub.org)
> Email: scrappy@hub.org           Yahoo!: yscrappy              ICQ: 7615664
>

----
Marc G. Fournier           Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org           Yahoo!: yscrappy              ICQ: 7615664

pgsql-bugs by date:

Previous
From: "Marc G. Fournier"
Date:
Subject: Re: [8.0.0] out of memory on large UPDATE
Next
From: Tom Lane
Date:
Subject: Re: [8.0.0] out of memory on large UPDATE