Thread: Can not input large text data

Can not input large text data

From

qk22@gmx.co.uk (qk22)

Date:

18 October 2001, 13:00:40

I am using PostgreSQL 7.1.3. I found that I can not input text data
for more than 7MB. When I tried to input text data more than about
7MB, I got the error message:" Network error: Connect reset by peer).
I don't know why.
Can anybody help me with the problem?

Re: Can not input large text data

From

Tom Lane

Date:

18 October 2001, 20:06:18

qk22@gmx.co.uk (qk22) writes:
> I am using PostgreSQL 7.1.3. I found that I can not input text data
> for more than 7MB. When I tried to input text data more than about
> 7MB, I got the error message:" Network error: Connect reset by peer).
> I don't know why.

Neither will anyone else, with only that much information.  What are
you doing *exactly* to input this data?  What client software are you
using?

            regards, tom lane

Re: Can not input large text data

From

qk22@gmx.co.uk (qk22)

Date:

23 October 2001, 22:35:12

tgl@sss.pgh.pa.us (Tom Lane) wrote in message news:<25124.1003431283@sss.pgh.pa.us>...
> qk22@gmx.co.uk (qk22) writes:
> > I am using PostgreSQL 7.1.3. I found that I can not input text data
> > for more than 7MB. When I tried to input text data more than about
> > 7MB, I got the error message:" Network error: Connect reset by peer).
> > I don't know why.
>
> Neither will anyone else, with only that much information.  What are
> you doing *exactly* to input this data?  What client software are you
> using?
>
>             regards, tom lane
>
> ---------------------------(end of broadcast)---------------------------
> TIP 3: if posting/reading through Usenet, please send an appropriate
> subscribe-nomail command to majordomo@postgresql.org so that your
> message can get through to the mailing list cleanly

I am using phpPgAdmin2.3--(apache+php+pgsql) as the form interface to
input data within Netscape Navigator, in fact the text fields can
input data very well exceed the 8k and 32k limits. The problem is that
you still can not input data with fairly large size such as 7MB or
above, and I don't know if there is anything wrong with the database.

Re: Can not input large text data

From

"Aasmund Midttun Godal"

Date:

24 October 2001, 04:07:36

Maybe this is a problem - take a look at your watch. See how long time it takes. then check out httpd.conf look for
timeout(probably 300 secs). 

Reagards,

Aasmund

On 20 Oct 2001 11:25:19 -0700, qk22@gmx.co.uk (qk22) wrote:
> tgl@sss.pgh.pa.us (Tom Lane) wrote in message news:<25124.1003431283@sss.pgh.pa.us>...
>
> I am using phpPgAdmin2.3--(apache+php+pgsql) as the form interface to
> input data within Netscape Navigator, in fact the text fields can
> input data very well exceed the 8k and 32k limits. The problem is that
> you still can not input data with fairly large size such as 7MB or
> above, and I don't know if there is anything wrong with the database.
>
> ---------------------------(end of broadcast)---------------------------
> TIP 5: Have you checked our extensive FAQ?
>
> http://www.postgresql.org/users-lounge/docs/faq.html

Aasmund Midttun Godal

aasmund@godal.com - http://www.godal.com/
+47 40 45 20 46

Re: Can not input large text data

From

qk22@gmx.co.uk (qk22)

Date:

24 October 2001, 17:56:59

postgresql@envisity.com ("Aasmund Midttun Godal") wrote in message news:<20011024001923.22212.qmail@ns.krot.org>...
> Maybe this is a problem - take a look at your watch. See how long time it takes. then check out httpd.conf look for
timeout(probably 300 secs). 
>
> Reagards,
>
> Aasmund
>
> On 20 Oct 2001 11:25:19 -0700, qk22@gmx.co.uk (qk22) wrote:
> > tgl@sss.pgh.pa.us (Tom Lane) wrote in message news:<25124.1003431283@sss.pgh.pa.us>...
> >
> > I am using phpPgAdmin2.3--(apache+php+pgsql) as the form interface to
> > input data within Netscape Navigator, in fact the text fields can
> > input data very well exceed the 8k and 32k limits. The problem is that
> > you still can not input data with fairly large size such as 7MB or
> > above, and I don't know if there is anything wrong with the database.
> >
> > ---------------------------(end of broadcast)---------------------------
> > TIP 5: Have you checked our extensive FAQ?
> >
> > http://www.postgresql.org/users-lounge/docs/faq.html
>
> Aasmund Midttun Godal
>
> aasmund@godal.com - http://www.godal.com/
> +47 40 45 20 46
>
> ---------------------------(end of broadcast)---------------------------
> TIP 3: if posting/reading through Usenet, please send an appropriate
> subscribe-nomail command to majordomo@postgresql.org so that your
> message can get through to the mailing list cleanly

I checked httpd.conf and found the "timeout" setting is 300, I tried
again and the error message in netscape appears immediately as
following:
______________________________________
A network error occurred while netscape
was sending data.
(Network Error: Connection reset by peer)

Try connection again
______________________________________
I want to know if there are some configuration changes that can be
made in order to enable the input of large text data though web
server.

Thank you

qk22

Re: Can not input large text data

From

Tom Lane

Date:

24 October 2001, 20:57:09

qk22@gmx.co.uk (qk22) writes:
> I checked httpd.conf and found the "timeout" setting is 300, I tried
> again and the error message in netscape appears immediately as
> following:
> ______________________________________
> A network error occurred while netscape
> was sending data.
> (Network Error: Connection reset by peer)

Hmm.  What shows up in the postmaster's log (stderr output)?

            regards, tom lane

Re: Can not input large text data

From

"Johnny Jørgensen"

Date:

24 October 2001, 22:53:09

That sounds very much like the POST maximum file size, set in php.ini. try phpinfo(), and see what your size is, the
defaultis somewhere pretty near 7MB 

*********** REPLY SEPARATOR  ***********

On 24-10-2001 at 07:23 qk22@gmx.co.uk wrote:

>postgresql@envisity.com ("Aasmund Midttun Godal") wrote in message
>news:<20011024001923.22212.qmail@ns.krot.org>...
>> Maybe this is a problem - take a look at your watch. See how long time
>it takes. then check out httpd.conf look for timeout (probably 300 secs).
>>
>> Reagards,
>>
>> Aasmund
>>
>> On 20 Oct 2001 11:25:19 -0700, qk22@gmx.co.uk (qk22) wrote:
>> > tgl@sss.pgh.pa.us (Tom Lane) wrote in message
>news:<25124.1003431283@sss.pgh.pa.us>...
>> >
>> > I am using phpPgAdmin2.3--(apache+php+pgsql) as the form interface to
>> > input data within Netscape Navigator, in fact the text fields can
>> > input data very well exceed the 8k and 32k limits. The problem is that
>> > you still can not input data with fairly large size such as 7MB or
>> > above, and I don't know if there is anything wrong with the database.
>> >
>> > ---------------------------(end of
>broadcast)---------------------------
>> > TIP 5: Have you checked our extensive FAQ?
>> >
>> > http://www.postgresql.org/users-lounge/docs/faq.html
>>
>> Aasmund Midttun Godal
>>
>> aasmund@godal.com - http://www.godal.com/
>> +47 40 45 20 46
>>
>> ---------------------------(end of broadcast)---------------------------
>> TIP 3: if posting/reading through Usenet, please send an appropriate
>> subscribe-nomail command to majordomo@postgresql.org so that your
>> message can get through to the mailing list cleanly
>
>I checked httpd.conf and found the "timeout" setting is 300, I tried
>again and the error message in netscape appears immediately as
>following:
>______________________________________
>A network error occurred while netscape
>was sending data.
>(Network Error: Connection reset by peer)
>
>Try connection again
>______________________________________
>I want to know if there are some configuration changes that can be
>made in order to enable the input of large text data though web
>server.
>
>Thank you
>
>qk22
>
>---------------------------(end of broadcast)---------------------------
>TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org


Mvh,

Johnny Jørgensen

johnny@halfahead.dk
+45 6315 7328

Re: Can not input large text data

From

"Aasmund Midttun Godal"

Date:

24 October 2001, 23:52:53

Well did you wait 300 secs or did it come immediately? because if you did then it is the webserver that cuts the
connectionbecause you have surpassed the timeout. Simply increasing the 300 value may work. however some browsers have
atimeout on their side too. 

I believe that the problem is probably caused by something other than postgres, (it may be any number of things) just
tryswapping around a lot of different things and settings - try storing the file to disk instead - does that work? try
readingthe post input directly and see if it is all there? if it comes immediately - has it already transferred the 7
mb?try setting boobie-traps in your script - what is the size of the actual post? have you remembered to set the
appropriateenctype in the form ('multipart/form-data') there are simply too many things that can cause this. Try to
narrowthe problem down - and if it turns out to be postgres,  then I do not know what the problem might be - somebody
elsehere might though. I just uploaded a 10mb file through http into postgres - no problem. 
On 24 Oct 2001 07:23:59 -0700, qk22@gmx.co.uk (qk22) wrote:
> postgresql@envisity.com ("Aasmund Midttun Godal") wrote in message news:<20011024001923.22212.qmail@ns.krot.org>...
>
> I checked httpd.conf and found the "timeout" setting is 300, I tried
> again and the error message in netscape appears immediately as
> following:
> ______________________________________
> A network error occurred while netscape
> was sending data.
> (Network Error: Connection reset by peer)
>
> Try connection again
> ______________________________________
> I want to know if there are some configuration changes that can be
> made in order to enable the input of large text data though web
> server.
>
> Thank you
>
> qk22
>
> ---------------------------(end of broadcast)---------------------------
> TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org

Aasmund Midttun Godal

aasmund@godal.com - http://www.godal.com/
+47 40 45 20 46

Re: Can not input large text data -- problem solved --Thank you!

From

qk22@gmx.co.uk

Date:

25 October 2001, 17:27:32


Johnny Jørgensen wrote:

>That sounds very much like the POST maximum file size, set in php.ini. try phpinfo(), and see what your size is, the
defaultis somewhere pretty near 7MB 
>
>*********** REPLY SEPARATOR  ***********
>
>On 24-10-2001 at 07:23 qk22@gmx.co.uk wrote:
>
>>postgresql@envisity.com ("Aasmund Midttun Godal") wrote in message
>>news:<20011024001923.22212.qmail@ns.krot.org>...
>>
>>>Maybe this is a problem - take a look at your watch. See how long time
>>>
>>it takes. then check out httpd.conf look for timeout (probably 300 secs).
>>
>>>Reagards,
>>>
>>>Aasmund
>>>
>>>On 20 Oct 2001 11:25:19 -0700, qk22@gmx.co.uk (qk22) wrote:
>>>
>>>>tgl@sss.pgh.pa.us (Tom Lane) wrote in message
>>>>
>>news:<25124.1003431283@sss.pgh.pa.us>...
>>
>>>>I am using phpPgAdmin2.3--(apache+php+pgsql) as the form interface to
>>>>input data within Netscape Navigator, in fact the text fields can
>>>>input data very well exceed the 8k and 32k limits. The problem is that
>>>>you still can not input data with fairly large size such as 7MB or
>>>>above, and I don't know if there is anything wrong with the database.
>>>>
>>>>---------------------------(end of
>>>>
>>broadcast)---------------------------
>>
>>>>TIP 5: Have you checked our extensive FAQ?
>>>>
>>>>http://www.postgresql.org/users-lounge/docs/faq.html
>>>>
>>>Aasmund Midttun Godal
>>>
>>>aasmund@godal.com - http://www.godal.com/
>>>+47 40 45 20 46
>>>
>>>---------------------------(end of broadcast)---------------------------
>>>TIP 3: if posting/reading through Usenet, please send an appropriate
>>>subscribe-nomail command to majordomo@postgresql.org so that your
>>>message can get through to the mailing list cleanly
>>>
>>I checked httpd.conf and found the "timeout" setting is 300, I tried
>>again and the error message in netscape appears immediately as
>>following:
>>______________________________________
>>A network error occurred while netscape
>>was sending data.
>>(Network Error: Connection reset by peer)
>>
>>Try connection again
>>______________________________________
>>I want to know if there are some configuration changes that can be
>>made in order to enable the input of large text data though web
>>server.
>>
>>Thank you
>>
>>qk22
>>
>>---------------------------(end of broadcast)---------------------------
>>TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org
>>
>
>
>Mvh,
>
>Johnny Jørgensen
>
>johnny@halfahead.dk
>+45 6315 7328
>
>
You are right! I checked and realized the line "post_max_size 8M " in
"phpinfo.php" test page, so I changed the "post_max_size" to 800M in
"php.ini" and "Timeout" value to 3000 in httpd.conf. Then everything is
ok now. So that was the Apache and PHP configuration problem.
Thank you for all.

Best regards

qk22

Re: Can not input large text data

From

qk22@gmx.co.uk (qk22)

Date:

29 October 2001, 13:16:18

johnny@halfahead.dk (=?ISO-8859-1?Q?=22Johnny_J=F8rgensen=22?=) wrote in message
news:<200110242321330793.0215978B@mail.halfahead.dk>...

> That sounds very much like the POST maximum file size, set in php.ini. try phpinfo(), and see what your size is, the
defaultis somewhere pretty near 7MB 

>

> *********** REPLY SEPARATOR  ***********

>

> On 24-10-2001 at 07:23 qk22@gmx.co.uk wrote:

>

> >postgresql@envisity.com ("Aasmund Midttun Godal") wrote in message

> >news:<20011024001923.22212.qmail@ns.krot.org>...

> >> Maybe this is a problem - take a look at your watch. See how long time

>  it takes. then check out httpd.conf look for timeout (probably 300 secs).

> >>

> >> Reagards,

> >>

> >> Aasmund

> >>

> >> On 20 Oct 2001 11:25:19 -0700, qk22@gmx.co.uk (qk22) wrote:

> >> > tgl@sss.pgh.pa.us (Tom Lane) wrote in message

>  news:<25124.1003431283@sss.pgh.pa.us>...

> >> >

> >> > I am using phpPgAdmin2.3--(apache+php+pgsql) as the form interface to

> >> > input data within Netscape Navigator, in fact the text fields can

> >> > input data very well exceed the 8k and 32k limits. The problem is that

> >> > you still can not input data with fairly large size such as 7MB or

> >> > above, and I don't know if there is anything wrong with the database.

> >> >

> >> > ---------------------------(end of

>  broadcast)---------------------------

> >> > TIP 5: Have you checked our extensive FAQ?

> >> >

> >> > http://www.postgresql.org/users-lounge/docs/faq.html

> >>

> >> Aasmund Midttun Godal

> >>

> >> aasmund@godal.com - http://www.godal.com/

> >> +47 40 45 20 46

> >>

> >> ---------------------------(end of broadcast)---------------------------

> >> TIP 3: if posting/reading through Usenet, please send an appropriate

> >> subscribe-nomail command to majordomo@postgresql.org so that your

> >> message can get through to the mailing list cleanly

> >

> >I checked httpd.conf and found the "timeout" setting is 300, I tried

> >again and the error message in netscape appears immediately as

> >following:

> >______________________________________

> >A network error occurred while netscape

> >was sending data.

> >(Network Error: Connection reset by peer)

> >

> >Try connection again

> >______________________________________

> >I want to know if there are some configuration changes that can be

> >made in order to enable the input of large text data though web

> >server.

> >

> >Thank you

> >

> >qk22

> >

> >---------------------------(end of broadcast)---------------------------

> >TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org

>

>

> Mvh,

>

> Johnny Jørgensen

>

> johnny@halfahead.dk

> +45 6315 7328

>

>

> ---------------------------(end of broadcast)---------------------------

> TIP 4: Don't 'kill -9' the postmaster



You are right! I checked and realized the line "post_max_size 8M " in
"phpinfo.php" test page, so I changed the "post_max_size" to 800M in
"php.ini" and "Timeout" value to 3000 in httpd.conf. Then everything
is ok now. So that was the Apache and PHP configuration problem.
Thank you for all.

Best regards

qk22