F.15. dbms_lob — operate on large objects #
dbms_lob is a Postgres Pro extension that allows operating on LOBs: BLOB
, CLOB
, BFILE
, and temporary LOBs. The extension can be used to access and manipulate specific parts of a LOB or complete LOBs. The functionality provided by this module overlaps substantially with the functionality of Oracle's DBMS_LOB
package.
Note
Note that the dbms_lob extension depends on the pgpro_sfile extension so the latter must be installed first. For more information, see its documentation.
F.15.1. Installation #
The dbms_lob
extension is a built-in extension included into Postgres Pro Enterprise. To enable dbms_lob
, create the extension using the following query:
CREATE EXTENSION dbms_lob;
F.15.2. Data Types #
The dbms_lob extension works with several data types:
The
bfile
type is provided by pgpro_bfile.CREATE TYPE BFILE AS ( dir_id int, file_name text );
Table F.13.
bfile
ParametersParameter Description dir_id
The ID of the directory where the bfile
is stored.file_name
The name of the file to read the bfile
from.The
blob
type stores binary data and has the same interface as Oracle'sBLOB
. It is provided by pgpro_sfile.CREATE TYPE dbms_lob.blob AS ( temp_data bytea, mime text, sf @extschema:pgpro_sfile@.sfile );
Table F.14.
blob
ParametersParameter Description sf
sfile
object on disk, which contains BLOB.temp_data
Temporary BLOB data stored in memory. mime
Auxiliary data defining the type of data stored in BLOB. The
clob
type is the equivalent of Oracle'sCLOB
andNCLOB
. Only the UTF-8 encoding is supported.CREATE TYPE CLOB AS ( t text, istemp bool, mime text );
Table F.15.
clob
ParametersParameter Description t
text
object on disk, which stores data.istemp
Defines if the object is temporary. mime
Auxiliary data defining the type of data stored in CLOB.
F.15.3. Utility Functions #
-
bfilename(
#dirname
text
,filename
text
) returnsbfile
Creates a
bfile
object associated with a physical file in the file system. Heredirname
is the name of the directory object created withbfile_directory_create()
where the filefilename
is located.-
empty_blob() returns
#blob
Creates an empty
blob
object, which contains ansfile
without data. It can be populated with data using write functions.-
empty_clob() returns
#clob
Creates an empty
clob
object, which contains an empty string. It can be populated with data using write functions.-
to_blob(
b
bytea
) returnsblob
to_blob(
#f
bfile
,mime_type
text
) returnsblob
Converts a
bytea
object to ablob
. If the original file isbfile
, themime
data type can be specified.-
to_clob(
t
text
) returnsclob
to_clob(
t
varchar
) returnsclob
to_clob(
#b
bfile
,int
csid
,mime
text
) returnsclob
Converts text objects to
clob
objects. If the original file isbfile
, its data is read and converted intoclob
. Only the UTF-8 encoding is supported.-
to_raw(
b
blob
) returnsclob
to_raw(
#b
bfile
) returnsclob
Copies the data from a
blob
orbfile
file into abytea
. Only the first GB of data is processed.
F.15.4. dbms_lob Functions and Procedures #
F.15.4.1. Opening and Closing LOBs #
-
open(
file_loc
IN OUTbfile
,open_mode
INint
)
open(
lob_loc
IN OUTblob
,open_mode
INint
)
open(
#lob_loc
IN OUTclob
,open_mode
INint
) open(
opens abfile
)bfile
object. Theopen_mode
parameter specifies if the file is to be open in read/write or read-only mode. Forbfile
, only read-only mode is supported (0). The functionsopen(
andblob
)open(
do nothing and exist only for syntax compatibility.clob
)-
isopen(
file_loc
INbfile
)
isopen(
lob_loc
INblob
)
isopen(
#lob_loc
INclob
) isopen(
checks if abfile
)bfile
object is open. Returns 1 if the LOB is open, otherwise 0. The functionsisopen(
andblob
)isopen(
always return 1 and exist only for syntax compatibility.clob
)-
close(
file_loc
IN OUTbfile
)
close(
lob_loc
IN OUTblob
)
close(
#lob_loc
IN OUTclob
) close(
checks if abfile
)bfile
object is open, and if it is, closes it. The functionsclose(
andblob
)close(
do nothing and exist only for syntax compatibility.clob
)-
createtemporary(
lob_loc
IN OUTblob
,cache
INbool
,dur
INint
default 10)
createtemporary(
#lob_loc
IN OUTclob
,cache
INbool
,dur
INint
default 10) Creates a temporary LOB, with
blob
data stored asbytea
andclob
data stored astext
.-
freetemporary(
lob_loc
IN OUTblob
)
freetemporary(
#lob_loc
IN OUTclob
) Releases resources associated with the temporary LOB.
F.15.4.2. Reading LOBs #
-
getlength(
file_loc
INbfile
)
getlength(
lob_loc
INblob
)
getlength(
#lob_loc
INclob
) Returns the length of a
blob
orbfile
in bytes or aclob
in characters.-
read(
file_loc
INbfile
,amount
IN OUTint
,offset
INint
,buffer
OUTbytea
)
read(
lob_loc
INblob
,amount
IN OUTint
,offset
INint
,buffer
OUTbytea
)
read(
#lob_loc
INclob
,amount
IN OUTint
,offset
INint
,buffer
OUTtext
) Reads a piece of a LOB, and writes the specified amount of bytes (
blob
/bfile
) or characters (clob
) into thebuffer
parameter, starting from an absoluteoffset
from the beginning of the LOB. Note thatoffset
1 should be specified to read from the beginning.-
get_storage_limit(
lob_loc
INblob
)
get_storage_limit(
#lob_loc
INclob
) Returns the LOB storage limit for the specified LOB.
-
substr(
file_loc
INbfile
,amount
INint
,offset
INint
)
substr(
lob_loc
INblob
,amount
INint
,offset
INint
)
substr(
#lob_loc
INclob
,amount
INint
,offset
INint
) Returns
amount
of bytes (blob
/bfile
) or characters (clob
) of a LOB, starting from an absoluteoffset
from the beginning of the LOB.-
instr(
file_loc
INbfile
,pattern
INint
,offset
INbigint
default 1,nth
INbigint
default 1)
instr(
lob_loc
INblob
,pattern
INint
,offset
INbigint
default 1,nth
INbigint
default 1)
instr(
#lob_loc
INclob
,pattern
INint
,offset
INbigint
default 1,nth
INbigint
default 1) Returns the matching position of the
nth
occurrence of thepattern
in the LOB, starting from the specifiedoffset
. Returns 0 if thepattern
is not found. Only the first GB of data is searched.
F.15.4.3. Updating LOBs #
-
write(
lob_loc
IN OUTblob
,amount
INint
,offset
INbigint
,buffer
INbytea
)
write(
#lob_loc
IN OUTclob
,amount
INint
,offset
INint
,buffer
INtext
) Writes a specified
amount
of data into an internal LOB, starting from an absoluteoffset
from the beginning of the LOB. The data is written from thebuffer
parameter. If the specifiedoffset
is beyond the end of the data currently in the LOB, then zero-byte fillers (blob
) or spaces (clob
) are inserted.-
writeappend(
lob_loc
IN OUTblob
,amount
INint
,buffer
INbytea
)
writeappend(
#lob_loc
IN OUTclob
,amount
INint
,buffer
INtext
) Writes a specified
amount
of data to the end of an internal LOB. The data is written from thebuffer
parameter.-
erase(
lob_loc
IN OUTblob
,amount
IN OUTint
,offset
INbigint
default 1)
erase(
#lob_loc
IN OUTclob
,amount
IN OUTint
,offset
INint
default 1) Erases an entire internal LOB or part of an internal LOB. When data is erased from the middle of a LOB, zero-byte fillers (temporary
blob
) or spaces (clob
) are written. Non-temporaryblob
objects can only be deleted as a whole.-
trim(
lob_loc
IN OUTblob
,newlen
INbigint
)
trim(
#lob_loc
IN OUTclob
,newlen
INint
) Trims the value of the internal LOB to the length you specify in the
newlen
parameter. Specify the length in bytes for temporaryblob
, and specify the length in characters forclob
. For non-temporaryblob
, works only if the new length is 0, which means erasing the object.
F.15.4.4. Operations with Multiple LOBs #
-
compare(
lob_1
INbfile
,lob_2
INbfile
,amount
INbigint
,offset_1
INbigint
default 1,offset_2
INbigint
default 1) returns int
compare(
lob_1
INblob
,lob_2
INblob
,amount
INint
default 1024*1024*1024-8,offset_1
INbigint
default 1,offset_2
INbigint
default 1) returns int
compare(
#lob_1
INclob
,lob_2
INclob
,amount
INint
default (1024*1024*1024-8)/2,offset_1
INint
default 1,offset_2
INint
default 1) returns int Compares two entire LOBs or parts of two LOBs. You can only compare LOBs of the same datatype. For
bfile
andblob
, binary comparison is performed. Forclob
, files are compared according to the current database collation.-
append(
lob_1
IN OUTblob
,lob_2
INblob
)
append(
#lob_1
IN OUTclob
,lob_2
INclob
) Appends the contents of a source internal LOB to a destination LOB. It appends the complete source LOB.
-
copy(
dest_lob
IN OUTblob
,src_lob
INblob
,amount
INbigint
,dest_offset
INbigint
default 1,src_offset
INbigint
default 1) returnsint
copy(
#dest_lob
IN OUTclob
,src_lob
INclob
,amount
INint
,dest_offset
INint
default 1,src_offset
INint
default 1) returnsint
Copies all, or a part of, a source internal LOB to a destination internal LOB. You can specify the offsets for both the source and destination LOBs, and the number of bytes or characters to copy.
-
converttoblob(
#dest_lob
IN OUTblob
,src_clob
INclob
,amount
INint
,dest_offset
IN OUTbigint
,src_offset
IN OUTint
,blob_csid
INint
,lang_context
IN OUTint
,warning
OUTint
) Reads character data from a source
clob
, converts the character data to the specified character set, writes the converted data to a destinationblob
in binary format, and returns the new offsets. Only the UTF-8 encoding is supported.-
converttoclob(
#dest_lob
IN OUTclob
,src_blob
INblob
,amount
INint
,dest_offset
IN OUTint
,src_offset
IN OUTbigint
,blob_csid
INint
,lang_context
IN OUTint
,warning
OUTint
) Reads binary data from a source
blob
, converts it into UTF-8 encoding, and writes the converted character data to a destinationclob
.
F.15.4.5. Legacy API #
-
fileexists(
#file_loc
INbfile
) returnsint
Finds out if a specified
bfile
locator points to a file that actually exists on the server file system. Implemented asbfile_fileexists
.-
fileopen(
#file_loc
IN OUTbfile
,open_mode
INint
) returnsint
Opens the specified
bfile
for read-only access. Implemented asbfile_open
.-
fileisopen(
#file_loc
INbfile
) returnsint
Finds out whether the specified
bfile
was opened.-
loadfromfile(
#dest_lob
IN OUTblob
,src_bfile
INbfile
,amount
INint
default 1024*1024*1024-8,dest_offset
INbigint
default 1,src_offset
INbigint
default 1) Converts data from the specified
bfile
toblob
.-
fileclose(
#file_loc
IN OUTbfile
) Closes the previously opened
bfile
. Implemented asbfile_close
.-
filecloseall()
# Closes all
bfile
files opened in the session. Implemented asbfile_close_all
.-
filegetname(
#file_loc
INbfile
,dir_alias
OUTtext
,filename
OUTtext
) Determines the directory object and filename. This function only indicates the directory object name and filename assigned to the locator, not if the physical file or directory actually exists. Implemented as
bfile_directory_get_alias_by_id
.
F.15.4.6. Other Operations #
-
loadblobfromfile(
#dest_lob
IN OUTblob
,src_bfile
INbfile
,amount
INint
default 1024*1024*1024-8,dest_offset
INbigint
default 1,src_offset
INbigint
default 1) returnsint
Synonym for
loadfromfile()
.-
loadclobfromfile(
#dest_lob
IN OUTclob
,src_bfile
INbfile
,amount
INint
,dest_offset
IN OUTint
,src_offset
IN OUTbigint
,bfile_csid
INint
,lang_context
IN OUTint
,warning
OUTint
) Loads data from a
bfile
to an internalclob
.-
setcontenttype(
lob_loc
IN OUTblob
,contenttype
INtext
)
setcontenttype(
#lob_loc
IN OUTclob
,contenttype
INtext
) Sets the content type string associated with the LOB.
-
getcontenttype(
lob_loc
INblob
) returnstext
getcontenttype(
#lob_loc
INclob
) returnstext
Returns the content type string associated with the LOB.
-
getchunksize(
lob_loc
INblob
) returnstext
getchunksize(
#lob_loc
INclob
) returnstext
Returns the amount of space used in the LOB chunk to store the LOB value.
F.15.5. Example #
DO $$ DECLARE cur_clob dbms_lob.clob; buffer text; amount int := 3000; BEGIN cur_clob := dbms_lob.empty_clob(); cur_clob.t := 'just some sample text'; raise notice 'clob length: %', dbms_lob.getlength(cur_clob); call dbms_lob.read(cur_clob, amount, 1, buffer); raise notice 'all clob read: %', buffer; amount := 6; call dbms_lob.read(cur_clob, amount, 4, buffer); raise notice 'clob read from 4 position for 6 symbols: %', buffer; raise notice 'storage limit: %', dbms_lob.get_storage_limit(cur_clob); raise notice 'clob substr from 6 position for 8 symbols: %', dbms_lob.substr(cur_clob, 8, 6); raise notice 'third postion of letter s in clob: %', dbms_lob.instr(cur_clob, 's', 1, 3); call dbms_lob.write(cur_clob, 6, 4, 'foobar'); raise notice 'new clob contents: %', cur_clob.t; call dbms_lob.write(cur_clob, 3, 25, 'baz'); raise notice 'new clob contents: %', cur_clob.t; call dbms_lob.writeappend(cur_clob, 4, 'test'); raise notice 'new clob contents: %', cur_clob.t; amount := 3; call dbms_lob.erase(cur_clob, amount, 2); raise notice 'amount of symbols deleted: %', amount; raise notice 'new clob contents: %', cur_clob.t; call dbms_lob.erase(cur_clob, amount, 30); raise notice 'amount of symbols deleted: %', amount; raise notice 'new clob contents: %', cur_clob.t; call dbms_lob.trim_(cur_clob, 22); raise notice 'new clob contents: %', cur_clob.t; END; $$; --output NOTICE: clob length: 21 NOTICE: all clob read: just some sample text NOTICE: clob read from 4 position for 6 symbols: t some NOTICE: storage limit: 536870908 NOTICE: clob substr from 6 position for 8 symbols: some sam NOTICE: third postion of letter s in clob: 11 NOTICE: new clob contents: jusfoobar sample text NOTICE: new clob contents: jusfoobar sample text baz NOTICE: new clob contents: jusfoobar sample text baztest NOTICE: amount of symbols deleted: 3 NOTICE: new clob contents: j oobar sample text baztest NOTICE: amount of symbols deleted: 2 NOTICE: new clob contents: j oobar sample text bazte NOTICE: new clob contents: j oobar sample text