Re: tuptoaster.c must *not* use SnapshotAny - Mailing list pgsql-hackers

From Jan Wieck
Subject Re: tuptoaster.c must *not* use SnapshotAny
Date
Msg-id 200201180606.g0I66Bg05438@saturn.janwieck.net
Whole thread Raw
In response to Re: tuptoaster.c must *not* use SnapshotAny  (Hiroshi Inoue <Inoue@tpf.co.jp>)
List pgsql-hackers
Hiroshi Inoue wrote:
[Charset iso-2022-jp unsupported, skipping...]
> Though I've often seen the reference to bytea BLOB
> I remember no clear negation. Don't we have to negate
> it clearly from the first ?
   Any  datatype that has the potential to be loaded into memory   entirely by the backend is dangerous. It  leads  to
problems  like  "out  of  swapspace",  which  aren't  really  funny  in   production.
 
   We need something that  is  restricted  to  streaming  access   only.  Yet, it needs to have copy semantics.
   That  means to me, that this will not only be a new datatype,   but  some  more  infrastructure  too.  We  need
INSERT  ...   RETURNING  ...   where  the  values  for  BLOBs  are given as   NEW_BLOB() and the returned identifier is
subsequently  used   to open the created BLOBs for writing and pump the data in.
 
   We  need  heap  access level tuple support to duplicate those   values on INSERT ... SELECT, to remove them on
DELETEand  to   manipulate them on UPDATE.
 
   We  need new functionality in procedural languages to support   streaming in and out of these guy's, where the
actualdata is   buffered  in  temp  files  and  only  blob identifiers passed   around.
 
   I see the final storage of blob data to happen in  the  toast   table,   sliced,   diced   and   handy   (most
probably not   compressed). But I don't see an easy way to abuse  the  bytea   datatype for real blob support.
 


Jan

--

#======================================================================#
# It's easier to get forgiveness for being wrong than for being right. #
# Let's break this rule - forgive me.                                  #
#================================================== JanWieck@Yahoo.com #



_________________________________________________________
Do You Yahoo!?
Get your free @yahoo.com address at http://mail.yahoo.com



pgsql-hackers by date:

Previous
From: Joe Conway
Date:
Subject: Re: tuptoaster.c must *not* use SnapshotAny
Next
From: Tom Lane
Date:
Subject: Geometric types (was Re: [PATCHES] guc)