Thread: trouble with pg_dumpall

trouble with pg_dumpall

From
"Tena Sakai"
Date:

Hi Everybody,

I started running 8.3.0 recently on dell hardware
with redhat advanced server 4.

I have a problem with pg_dumpall via crontab.
I had a simple crontab to do the same thing on
8.2.4 and the same thing doesn't work.

Here's my very simple crontab entry:

  xx xx * * * sh /usr/local/pgsql/cron_dir/moo.sh

and moo.sh is eqally simple:
  #! /bin/bash

  . .bashrc

  filename=`date +%G%m%d.%w`.gz
  /usr/local/pgsql/bin/pg_dumpall > $filename

Here's what I get back as output is:

  Password:
  pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied

This is not what happened on 8.2.4.  I read 8.3.0 man
page on pg_dumpall.  Here's what it told me:

  The file .pgpass in a user's home directory or the file referenced
  by PGPASSFILE can contain passwords to be used if the connection
  requires a password (and no password has been specified otherwise).

I have .pgpass in /usr/local/pgsql and when I type
  psql dbname
It lets me in without asking the password.  So I don't
understand why I get what I get: fe_sendauth: no password supplied

I ran a different cron job which looks like:

  #! /bin/bash

  . .bashrc

  echo PGUSER: $PGUSER
  echo PGDATABASE: $PGDATABASE
  echo PGHOST: $PGHOST
  echo PGPASSFILE: $PGPASSFILE
  echo PGDATA: $PGDATA

and everything it told me checks out with what I get from
interactive session.

Please tell me what I am doing wrong.  I am at the
end of my wits.

Regards,

Tena Sakai
tsakai@gallo.ucsf.edu

Re: trouble with pg_dumpall

From
"Phillip Smith"
Date:
Try explicitly setting those variables in your script:
    $PGUSER
    $PGDATABASE
    $PGHOST
    $PGPASSFILE
    $PGDATA


THINK BEFORE YOU PRINT - Save paper if you don't really need to print this

*******************Confidentiality and Privilege Notice*******************

The material contained in this message is privileged and confidential to
the addressee.  If you are not the addressee indicated in this message or
responsible for delivery of the message to such person, you may not copy
or deliver this message to anyone, and you should destroy it and kindly
notify the sender by reply email.

Information in this message that does not relate to the official business
of Weatherbeeta must be treated as neither given nor endorsed by Weatherbeeta.
Weatherbeeta, its employees, contractors or associates shall not be liable
for direct, indirect or consequential loss arising from transmission of this
message or any attachments
e-mail.

Re: trouble with pg_dumpall

From
"Tena Sakai"
Date:

Hi Phillip,

Thank you for your suggestion.  So my script
file now looks like:

  #! /bin/bash

  PGUSER=postgres
  PGDATABASE=canon
  PGHOST=vixen
  PGPASSFILE=winkwink
  PGDATA=/usr/local/pgsql/data
  LD_LIBRARY_PATH=/usr/local/pgsql/lib
  export PGUSER PGDATABASE PGHOST PGPASSFILE PGDATA LD_LIBRARY_PATH
  # echo +++++++++
  # echo PGUSER: $PGUSER
  # echo PGDATABASE: $PGDATABASE
  # echo PGHOST: $PGHOST
  # echo PGPASSFILE: $PGPASSFILE
  # echo PGDATA: $PGDATA

  filename=`date +%G%m%d.%w`.gz
  /usr/local/pgsql/bin/pg_dumpall > $filename

and I still get the same output:

  Password:
  pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied

I just don't get it...

Tena Sakai
tsakai@gallo.ucsf.edu




-----Original Message-----
From: Phillip Smith [mailto:phillip.smith@weatherbeeta.com.au]
Sent: Wed 2/27/2008 5:19 PM
To: Tena Sakai; pgsql-admin@postgresql.org
Subject: RE: [ADMIN] trouble with pg_dumpall

Try explicitly setting those variables in your script:
        $PGUSER
        $PGDATABASE
        $PGHOST
        $PGPASSFILE
        $PGDATA


THINK BEFORE YOU PRINT - Save paper if you don't really need to print this

*******************Confidentiality and Privilege Notice*******************

The material contained in this message is privileged and confidential to
the addressee.  If you are not the addressee indicated in this message or
responsible for delivery of the message to such person, you may not copy
or deliver this message to anyone, and you should destroy it and kindly
notify the sender by reply email.

Information in this message that does not relate to the official business
of Weatherbeeta must be treated as neither given nor endorsed by Weatherbeeta.
Weatherbeeta, its employees, contractors or associates shall not be liable
for direct, indirect or consequential loss arising from transmission of this
message or any attachments
e-mail.

Re: trouble with pg_dumpall

From
"Tena Sakai"
Date:

Hi Everybody,

I have turned every stone over and I am
pretty close to convince myself that the
way I am doing doesn't work.  I can't
believe I am the one to discover such a
bug.  I would love to hear somebody prove
me wrong.

But in the meantime, maybe I will take a
bit different approach.  Namely:

Is there anyway I can pass the password to
pg_dumpall via crontab?

Maybe via argv?  Then I would be able to
say via crontab entry:

  xx xx * * * bash /usr/local/pgsql/cronbase/moo.sh "password!"

Of course, what I am stating above doesn't work.
I am asking if you have any suggestion in a
similar fashion.

I am all ears.

Regards,

Tena Sakai
tsakai@gallo.ucsf.edu


-----Original Message-----
From: pgsql-admin-owner@postgresql.org on behalf of Tena Sakai
Sent: Wed 2/27/2008 5:40 PM
To: Phillip Smith; pgsql-admin@postgresql.org
Subject: Re: [ADMIN] trouble with pg_dumpall

Hi Phillip,

Thank you for your suggestion.  So my script
file now looks like:

  #! /bin/bash

  PGUSER=postgres
  PGDATABASE=canon
  PGHOST=vixen
  PGPASSFILE=winkwink
  PGDATA=/usr/local/pgsql/data
  LD_LIBRARY_PATH=/usr/local/pgsql/lib
  export PGUSER PGDATABASE PGHOST PGPASSFILE PGDATA LD_LIBRARY_PATH
  # echo +++++++++
  # echo PGUSER: $PGUSER
  # echo PGDATABASE: $PGDATABASE
  # echo PGHOST: $PGHOST
  # echo PGPASSFILE: $PGPASSFILE
  # echo PGDATA: $PGDATA

  filename=`date +%G%m%d.%w`.gz
  /usr/local/pgsql/bin/pg_dumpall > $filename

and I still get the same output:

  Password:
  pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied

I just don't get it...

Tena Sakai
tsakai@gallo.ucsf.edu




-----Original Message-----
From: Phillip Smith [mailto:phillip.smith@weatherbeeta.com.au]
Sent: Wed 2/27/2008 5:19 PM
To: Tena Sakai; pgsql-admin@postgresql.org
Subject: RE: [ADMIN] trouble with pg_dumpall

Try explicitly setting those variables in your script:
        $PGUSER
        $PGDATABASE
        $PGHOST
        $PGPASSFILE
        $PGDATA


THINK BEFORE YOU PRINT - Save paper if you don't really need to print this

*******************Confidentiality and Privilege Notice*******************

The material contained in this message is privileged and confidential to
the addressee.  If you are not the addressee indicated in this message or
responsible for delivery of the message to such person, you may not copy
or deliver this message to anyone, and you should destroy it and kindly
notify the sender by reply email.

Information in this message that does not relate to the official business
of Weatherbeeta must be treated as neither given nor endorsed by Weatherbeeta.
Weatherbeeta, its employees, contractors or associates shall not be liable
for direct, indirect or consequential loss arising from transmission of this
message or any attachments
e-mail.


Re: trouble with pg_dumpall

From
"Phillip Smith"
Date:
Can you post your pg_hba.conf file to the list please?


THINK BEFORE YOU PRINT - Save paper if you don't really need to print this

*******************Confidentiality and Privilege Notice*******************

The material contained in this message is privileged and confidential to
the addressee.  If you are not the addressee indicated in this message or
responsible for delivery of the message to such person, you may not copy
or deliver this message to anyone, and you should destroy it and kindly
notify the sender by reply email.

Information in this message that does not relate to the official business
of Weatherbeeta must be treated as neither given nor endorsed by Weatherbeeta.
Weatherbeeta, its employees, contractors or associates shall not be liable
for direct, indirect or consequential loss arising from transmission of this
message or any attachments
e-mail.

Re: trouble with pg_dumpall

From
"Joshua D. Drake"
Date:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Wed, 27 Feb 2008 18:26:54 -0800
"Tena Sakai" <tsakai@gallo.ucsf.edu> wrote:


> But in the meantime, maybe I will take a
> bit different approach.  Namely:
> 
> Is there anyway I can pass the password to
> pg_dumpall via crontab?

You can use a pgpass file as the user calling the cron.

http://www.postgresql.org/docs/current/interactive/libpq-pgpass.html

Or you can use PGPASSWORD="foo"

But that can be dangerous.

Joshua D. Drake
- -- 
The PostgreSQL Company since 1997: http://www.commandprompt.com/ 
PostgreSQL Community Conference: http://www.postgresqlconference.org/
Donate to the PostgreSQL Project: http://www.postgresql.org/about/donate
PostgreSQL SPI Liaison | SPI Director |  PostgreSQL political pundit

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)

iD8DBQFHxh2tATb/zqfZUUQRAoTWAKCD7dgA5pSlDcu3xTWvei4K/KFqxACfQbVq
dJvLDR1LKM6yt2RyewQfNQI=
=y55x
-----END PGP SIGNATURE-----

Re: trouble with pg_dumpall

From
"Tena Sakai"
Date:

Hi Phiilip,

Here it is.

Tena

# PostgreSQL Client Authentication Configuration File
# ===================================================
#
# Refer to the "Client Authentication" section in the
# PostgreSQL documentation for a complete description
# of this file.  A short synopsis follows.
#
# This file controls: which hosts are allowed to connect, how clients
# are authenticated, which PostgreSQL user names they can use, which
# databases they can access.  Records take one of these forms:
#
# local      DATABASE  USER  METHOD  [OPTION]
# host       DATABASE  USER  CIDR-ADDRESS  METHOD  [OPTION]
# hostssl    DATABASE  USER  CIDR-ADDRESS  METHOD  [OPTION]
# hostnossl  DATABASE  USER  CIDR-ADDRESS  METHOD  [OPTION]
#
# (The uppercase items must be replaced by actual values.)
#
# The first field is the connection type: "local" is a Unix-domain socket,
# "host" is either a plain or SSL-encrypted TCP/IP socket, "hostssl" is an
# SSL-encrypted TCP/IP socket, and "hostnossl" is a plain TCP/IP socket.
#
# DATABASE can be "all", "sameuser", "samerole", a database name, or
# a comma-separated list thereof.
#
# USER can be "all", a user name, a group name prefixed with "+", or
# a comma-separated list thereof.  In both the DATABASE and USER fields
# you can also write a file name prefixed with "@" to include names from
# a separate file.
#
# CIDR-ADDRESS specifies the set of hosts the record matches.
# It is made up of an IP address and a CIDR mask that is an integer
# (between 0 and 32 (IPv4) or 128 (IPv6) inclusive) that specifies
# the number of significant bits in the mask.  Alternatively, you can write
# an IP address and netmask in separate columns to specify the set of hosts.
#
# METHOD can be "trust", "reject", "md5", "crypt", "password",
# "krb5", "ident", "pam" or "ldap".  Note that "password" sends passwords
# in clear text; "md5" is preferred since it sends encrypted passwords.
#
# OPTION is the ident map or the name of the PAM service, depending on METHOD.
#
# Database and user names containing spaces, commas, quotes and other special
# characters must be quoted. Quoting one of the keywords "all", "sameuser" or
# "samerole" makes the name lose its special character, and just match a
# database or username with that name.
#
# This file is read on server startup and when the postmaster receives
# a SIGHUP signal.  If you edit the file on a running system, you have
# to SIGHUP the postmaster for the changes to take effect.  You can use
# "pg_ctl reload" to do that.

# Put your actual configuration here
# TYPE  DATABASE    USER        CIDR-ADDRESS          METHOD
# host  all     donder          172.16.1.107/32 ldap ldap://amarula.egcrc.org
# host  all     donder          172.16.1.107/32 ldap ldap://amarula.egcrc.org/dc=egcrc,dc=org;amarula\
local   all     +analysis       md5
local   all     +wetlab md5
local   all     +adm    md5
local   all     +contractors            md5
local   all     gadb            md5
local   all     donder          md5
local   all     tsakai          md5
local   all     gbrush          md5
local   all     postgres                md5
### local   all         all                               trust
# local sameuser        +contractors            trust
# ----------------------------------
#
# If you want to allow non-local connections, you need to add more
# "host" records. In that case you will also need to make PostgreSQL listen
# on a non-local interface via the listen_addresses configuration parameter,
# or via the -i or -h command line switches.
#

# CAUTION: Configuring the system for local "trust" authentication allows
# any local user to connect as any PostgreSQL user, including the database
# superuser. If you do not trust all your local users, use another
# authentication method.


# TYPE  DATABASE    USER        CIDR-ADDRESS          METHOD

# "local" is for Unix domain socket connections only
### local   all         all                               trust
host            canon   gjoslyn 172.16.0.110/32 md5
host            canon   gbrush  172.16.0.106/32 md5
host            canon   all     172.16.0.0/22   md5     # tws, 20071001
host            canon   all     172.16.1.106/32 md5     # blitzen
# IPv4 local connections:
host    all         all         127.0.0.1/32          md5
# IPv6 local connections:
host    all         all         ::1/128               md5


-----Original Message-----
From: pgsql-admin-owner@postgresql.org on behalf of Phillip Smith
Sent: Wed 2/27/2008 6:32 PM
To: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] trouble with pg_dumpall

Can you post your pg_hba.conf file to the list please?


THINK BEFORE YOU PRINT - Save paper if you don't really need to print this

*******************Confidentiality and Privilege Notice*******************

The material contained in this message is privileged and confidential to
the addressee.  If you are not the addressee indicated in this message or
responsible for delivery of the message to such person, you may not copy
or deliver this message to anyone, and you should destroy it and kindly
notify the sender by reply email.

Information in this message that does not relate to the official business
of Weatherbeeta must be treated as neither given nor endorsed by Weatherbeeta.
Weatherbeeta, its employees, contractors or associates shall not be liable
for direct, indirect or consequential loss arising from transmission of this
message or any attachments
e-mail.

---------------------------(end of broadcast)---------------------------
TIP 1: if posting/reading through Usenet, please send an appropriate
       subscribe-nomail command to majordomo@postgresql.org so that your
       message can get through to the mailing list cleanly

Re: trouble with pg_dumpall

From
Jeff Frost
Date:
On Wed, 27 Feb 2008, Tena Sakai wrote:

> Hi Jeff,
>
> Thanks for your reply, but I think you might
> have missed an earlier thread.  I am afraid
> I have tried what you suggest.  Below's my
> previous post.
>
>
>  filename=`date +%G%m%d.%w`.gz
>  /usr/local/pgsql/bin/pg_dumpall > $filename
>
> Here's what I get back as output is:
>
>  Password:
>  pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied
>
> This is not what happened on 8.2.4.  I read 8.3.0 man
> page on pg_dumpall.  Here's what it told me:
>
>  The file .pgpass in a user's home directory or the file referenced
>  by PGPASSFILE can contain passwords to be used if the connection
>  requires a password (and no password has been specified otherwise).
>
> I have .pgpass in /usr/local/pgsql and when I type
>  psql dbname
> It lets me in without asking the password.  So I don't
> understand why I get what I get: fe_sendauth: no password supplied
>

Please reply-all and don't top-post. :-)

I bet the $HOME environment variable isn't being set by your cron
implementation.  Is this gentoo perhaps?  Try putting an echo $HOME in your
script and see if it's defined.

--
Jeff Frost, Owner     <jeff@frostconsultingllc.com>
Frost Consulting, LLC     http://www.frostconsultingllc.com/
Phone: 650-780-7908    FAX: 650-649-1954

Re: trouble with pg_dumpall

From
Jeff Frost
Date:
On Wed, 27 Feb 2008, Tena Sakai wrote:

> I have turned every stone over and I am
> pretty close to convince myself that the
> way I am doing doesn't work.  I can't
> believe I am the one to discover such a
> bug.  I would love to hear somebody prove
> me wrong.
>
> But in the meantime, maybe I will take a
> bit different approach.  Namely:
>
> Is there anyway I can pass the password to
> pg_dumpall via crontab?
>
> Maybe via argv?  Then I would be able to
> say via crontab entry:
>
>  xx xx * * * bash /usr/local/pgsql/cronbase/moo.sh "password!"
>
> Of course, what I am stating above doesn't work.
> I am asking if you have any suggestion in a
> similar fashion.
>
> I am all ears.

Just use the .pgpass file.  Here's the documentation page for 8.2:
http://www.postgresql.org/docs/8.2/static/libpq-pgpass.html

--
Jeff Frost, Owner     <jeff@frostconsultingllc.com>
Frost Consulting, LLC     http://www.frostconsultingllc.com/
Phone: 650-780-7908    FAX: 650-649-1954

Re: trouble with pg_dumpall

From
"Tena Sakai"
Date:

Hi Jeff,

> I bet the $HOME environment variable isn't
> being set by your cron implementation.
> Try putting an echo $HOME in your script and
> see if it's defined.

I did.  Here's the result:

  +++++++++
  PGUSER: postgres
  PGDATABASE: canon
  PGHOST: localhost
  PGPASSFILE: /usr/local/pgsql/.pgpass
  PGDATA: /usr/local/pgsql/data
  +++++++++
  HOME: /usr/local/pgsql
  Password:
  pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied

> Is this gentoo perhaps?

It is Redhat Advanced Server 4 on Dell hardware.

Regards,

Tena




-----Original Message-----
From: Jeff Frost [mailto:jeff@frostconsultingllc.com]
Sent: Wed 2/27/2008 6:59 PM
To: Tena Sakai
Cc: pgsql-admin@postgresql.org
Subject: RE: [ADMIN] trouble with pg_dumpall

On Wed, 27 Feb 2008, Tena Sakai wrote:

> Hi Jeff,
>
> Thanks for your reply, but I think you might
> have missed an earlier thread.  I am afraid
> I have tried what you suggest.  Below's my
> previous post.
>
>
>  filename=`date +%G%m%d.%w`.gz
>  /usr/local/pgsql/bin/pg_dumpall > $filename
>
> Here's what I get back as output is:
>
>  Password:
>  pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied
>
> This is not what happened on 8.2.4.  I read 8.3.0 man
> page on pg_dumpall.  Here's what it told me:
>
>  The file .pgpass in a user's home directory or the file referenced
>  by PGPASSFILE can contain passwords to be used if the connection
>  requires a password (and no password has been specified otherwise).
>
> I have .pgpass in /usr/local/pgsql and when I type
>  psql dbname
> It lets me in without asking the password.  So I don't
> understand why I get what I get: fe_sendauth: no password supplied
>

Please reply-all and don't top-post. :-)

I bet the $HOME environment variable isn't being set by your cron
implementation.  Is this gentoo perhaps?  Try putting an echo $HOME in your
script and see if it's defined.

--
Jeff Frost, Owner       <jeff@frostconsultingllc.com>
Frost Consulting, LLC   http://www.frostconsultingllc.com/
Phone: 650-780-7908     FAX: 650-649-1954

Re: trouble with pg_dumpall

From
Steve Holdoway
Date:
On Wed, 27 Feb 2008 17:12:40 -0800
"Tena Sakai" <tsakai@gallo.ucsf.edu> wrote:

Here's your problem.
>   . .bashrc

You have an extremely minimal environment when running from cron, and you certainly *aren't* running from the home
directoryof the relevant user. You need to set up your PATH and HOME manually, and cd to your home directory before
sourcing.bashrc for this to work. 

. ~/.bashrc *might* work, but it's better to be specific (:

hth,

Steve

--
Steve Holdoway <steve.holdoway@firetrust.com>

Re: trouble with pg_dumpall

From
Jeff Frost
Date:
On Wed, 27 Feb 2008, Tena Sakai wrote:

> Hi Jeff,
>
>> I bet the $HOME environment variable isn't
>> being set by your cron implementation.
>> Try putting an echo $HOME in your script and
>> see if it's defined.
>
> I did.  Here's the result:
>
>  +++++++++
>  PGUSER: postgres
>  PGDATABASE: canon
>  PGHOST: localhost
>  PGPASSFILE: /usr/local/pgsql/.pgpass
>  PGDATA: /usr/local/pgsql/data
>  +++++++++
>  HOME: /usr/local/pgsql
>  Password:
>  pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied

You might need to export the variables and not just set it.  I think you're
doing that with the other variables already, but I didn't see HOME being
exported.  I've never had to explicitly export these on Redhat derivatives,
so I doubt that's the problem.

What does your .pgpass look like?

I couldn't find it in the message archives.


--
Jeff Frost, Owner     <jeff@frostconsultingllc.com>
Frost Consulting, LLC     http://www.frostconsultingllc.com/
Phone: 650-780-7908    FAX: 650-649-1954

Re: trouble with pg_dumpall

From
"Tena Sakai"
Date:

Hi Steve,

I have changed my script to:

  #! /bin/bash
   PATH=/usr/local/pgsql/bin:/bin:/usr/kerberos/bin:/usr/local/java/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/ant/bin:.
  PGHOME=/usr/local/pgsql
  PGUSER=postgres
  PGDATABASE=canon
  PGHOST=localhost
  PGPASSFILE=/usr/local/pgsql/.pgpass
  PGDATA=/usr/local/pgsql/data
  LD_LIBRARY_PATH=/usr/local/pgsql/lib
  export PGUSER PGDATABASE PGHOST PGPASSFILE PGDATA LD_LIBRARY_PATH
  export PGHOME PATH
  echo +++++++++
  echo PGUSER: $PGUSER
  echo PGDATABASE: $PGDATABASE
  echo PGHOST: $PGHOST
  echo PGPASSFILE: $PGPASSFILE
  echo PGDATA: $PGDATA
  echo HOME: $HOME
  echo PATH: $PATH

  filename=`date +%G%m%d.%w`.gz
  /usr/local/pgsql/bin/pg_dumpall > $filename

And here's the result:

  +++++++++
  PGUSER: postgres
  PGDATABASE: canon
  PGHOST: localhost
  PGPASSFILE: /usr/local/pgsql/.pgpass
  PGDATA: /usr/local/pgsql/data
  HOME: /usr/local/pgsql
  PATH: /usr/local/pgsql/bin:/bin:/usr/kerberos/bin:/usr/local/java/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/ant/bin:.
Password:
pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied

As you can see, I am afraid my point still holds.

Regards,

Tena Sakai
tsakai@gallo.ucsf.edu


-----Original Message-----
From: pgsql-admin-owner@postgresql.org on behalf of Steve Holdoway
Sent: Wed 2/27/2008 7:33 PM
To: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] trouble with pg_dumpall

On Wed, 27 Feb 2008 17:12:40 -0800
"Tena Sakai" <tsakai@gallo.ucsf.edu> wrote:

Here's your problem.
>   . .bashrc

You have an extremely minimal environment when running from cron, and you certainly *aren't* running from the home directory of the relevant user. You need to set up your PATH and HOME manually, and cd to your home directory before sourcing .bashrc for this to work.

. ~/.bashrc *might* work, but it's better to be specific (:

hth,

Steve

--
Steve Holdoway <steve.holdoway@firetrust.com>

---------------------------(end of broadcast)---------------------------
TIP 3: Have you checked our extensive FAQ?

               http://www.postgresql.org/docs/faq

Re: trouble with pg_dumpall

From
Jeff Frost
Date:
On Wed, 27 Feb 2008, Tena Sakai wrote:

>  +++++++++
>  PGUSER: postgres
>  PGDATABASE: canon
>  PGHOST: localhost
>  PGPASSFILE: /usr/local/pgsql/.pgpass
>  PGDATA: /usr/local/pgsql/data
>  HOME: /usr/local/pgsql
>  PATH:
/usr/local/pgsql/bin:/bin:/usr/kerberos/bin:/usr/local/java/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/ant/bin:.
> Password:
> pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied

Hey Tena,

What user is this script running as when running under cron?

Might be time to break out strace and run it like this:

strace -fe trace=file /usr/local/pgsql/bin/pg_dumpall > $filename 2> strace.out

>
> As you can see, I am afraid my point still holds.
>
> Regards,
>
> Tena Sakai
> tsakai@gallo.ucsf.edu
>
>
> -----Original Message-----
> From: pgsql-admin-owner@postgresql.org on behalf of Steve Holdoway
> Sent: Wed 2/27/2008 7:33 PM
> To: pgsql-admin@postgresql.org
> Subject: Re: [ADMIN] trouble with pg_dumpall
>
> On Wed, 27 Feb 2008 17:12:40 -0800
> "Tena Sakai" <tsakai@gallo.ucsf.edu> wrote:
>
> Here's your problem.
>>   . .bashrc
>
> You have an extremely minimal environment when running from cron, and you certainly *aren't* running from the home
directoryof the relevant user. You need to set up your PATH and HOME manually, and cd to your home directory before
sourcing.bashrc for this to work. 
>
> . ~/.bashrc *might* work, but it's better to be specific (:
>
> hth,
>
> Steve
>
>

--
Jeff Frost, Owner     <jeff@frostconsultingllc.com>
Frost Consulting, LLC     http://www.frostconsultingllc.com/
Phone: 650-780-7908    FAX: 650-649-1954

Re: trouble with pg_dumpall

From
"Tena Sakai"
Date:

Hi Jeff,

You cuaght me with a fine point.

> but I didn't see HOME being exported.

I have changed the script accordingly:

  #! /bin/bash

  PATH=/usr/local/pgsql/bin:/bin:/usr/kerberos/bin:/usr/local/java/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/ant/bin:.
  PGHOME=/usr/local/pgsql
  HOME=/usr/local/pgsql
  PGUSER=postgres
  PGDATABASE=canon
  PGHOST=localhost
  PGPASSFILE=/usr/local/pgsql/.pgpass
  PGDATA=/usr/local/pgsql/data
  LD_LIBRARY_PATH=/usr/local/pgsql/lib
  export PGUSER PGDATABASE PGHOST PGPASSFILE PGDATA LD_LIBRARY_PATH
  export PGHOME PATH HOME
  echo +++++++++
  echo PGUSER: $PGUSER
  echo PGDATABASE: $PGDATABASE
  echo PGHOST: $PGHOST
  echo PGPASSFILE: $PGPASSFILE
  echo PGDATA: $PGDATA
  echo HOME: $HOME
  echo PATH: $PATH

  filename=`date +%G%m%d.%w`.gz
  /usr/local/pgsql/bin/pg_dumpall > $filename

And the result/my claim remains the same as before:

  +++++++++
  PGUSER: postgres
  PGDATABASE: canon
  PGHOST: localhost
  PGPASSFILE: /usr/local/pgsql/.pgpass
  PGDATA: /usr/local/pgsql/data
  HOME: /usr/local/pgsql
  PATH: /usr/local/pgsql/bin:/bin:/usr/kerberos/bin:/usr/local/java/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/ant/bin:.
  Password:
  pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied

I see just one more option.  Namely, to change the
postgres user entry for pg_hba.conf to "trust" for
a short period as pg_dumpall starts and then put it
back to the way normally is (md5).  I would rather
not do that and get .pgpass or PGPASSFILE to work
for me.

Regards,

Tena Sakai
tsakai@gallo.ucsf.edu




-----Original Message-----
From: Jeff Frost [mailto:jeff@frostconsultingllc.com]
Sent: Wed 2/27/2008 7:41 PM
To: Tena Sakai
Cc: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] trouble with pg_dumpall

On Wed, 27 Feb 2008, Tena Sakai wrote:

> Hi Jeff,
>
>> I bet the $HOME environment variable isn't
>> being set by your cron implementation.
>> Try putting an echo $HOME in your script and
>> see if it's defined.
>
> I did.  Here's the result:
>
>  +++++++++
>  PGUSER: postgres
>  PGDATABASE: canon
>  PGHOST: localhost
>  PGPASSFILE: /usr/local/pgsql/.pgpass
>  PGDATA: /usr/local/pgsql/data
>  +++++++++
>  HOME: /usr/local/pgsql
>  Password:
>  pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied

You might need to export the variables and not just set it.  I think you're
doing that with the other variables already, but I didn't see HOME being
exported.  I've never had to explicitly export these on Redhat derivatives,
so I doubt that's the problem.

What does your .pgpass look like?

I couldn't find it in the message archives.


--
Jeff Frost, Owner       <jeff@frostconsultingllc.com>
Frost Consulting, LLC   http://www.frostconsultingllc.com/
Phone: 650-780-7908     FAX: 650-649-1954

Re: trouble with pg_dumpall

From
"Phillip Smith"
Date:
> -----Original Message-----
> From: pgsql-admin-owner@postgresql.org
[mailto:pgsql-admin-owner@postgresql.org] On Behalf Of Tena Sakai
> Sent: Thursday, 28 February 2008 15:05
> To: Steve Holdoway; pgsql-admin@postgresql.org
> Subject: Re: [ADMIN] trouble with pg_dumpall
>
> As you can see, I am afraid my point still holds.

Try adding this to your script after the echo PATH: $PATH line, just for
debugging purposes:

/bin/echo "|----------|"
if [ -f ~/.pgpass ] ; then
    /bin/cat ~/.pgpass
else
    /bin/echo ".pgpass missing"
fi
/bin/echo "|----------|"


THINK BEFORE YOU PRINT - Save paper if you don't really need to print this

*******************Confidentiality and Privilege Notice*******************

The material contained in this message is privileged and confidential to
the addressee.  If you are not the addressee indicated in this message or
responsible for delivery of the message to such person, you may not copy
or deliver this message to anyone, and you should destroy it and kindly
notify the sender by reply email.

Information in this message that does not relate to the official business
of Weatherbeeta must be treated as neither given nor endorsed by Weatherbeeta.
Weatherbeeta, its employees, contractors or associates shall not be liable
for direct, indirect or consequential loss arising from transmission of this
message or any attachments
e-mail.

Re: trouble with pg_dumpall

From
Jeff Frost
Date:
On Wed, 27 Feb 2008, Tena Sakai wrote:

> Hi Jeff,
>
> You cuaght me with a fine point.
>
>> but I didn't see HOME being exported.
>
> I have changed the script accordingly:
>
> And the result/my claim remains the same as before:
>
>  pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied
>
> I see just one more option.  Namely, to change the
> postgres user entry for pg_hba.conf to "trust" for
> a short period as pg_dumpall starts and then put it
> back to the way normally is (md5).  I would rather
> not do that and get .pgpass or PGPASSFILE to work
> for me.

I didn't really expect that to make a difference.  What does your .pgpass look
like?  What OS user are you running the cron job as?  Do you have SELINUX
enabled?  Can you run the script with the strace command I sent in a previous
email so that we can see what's really going on?

--
Jeff Frost, Owner     <jeff@frostconsultingllc.com>
Frost Consulting, LLC     http://www.frostconsultingllc.com/
Phone: 650-780-7908    FAX: 650-649-1954

Re: trouble with pg_dumpall

From
"Tena Sakai"
Date:

Hi Jeff,

> What does your .pgpass look like?
*:5432:canon:postgres:winkwink

> What OS user are you running the cron job as?
User postgres.

> Do you have SELINUX enabled?
I have no idea what SELINUX is.

> Can you run the script with the strace command
> I sent in a previous email so that we can see
> what's really going on?
Yes, it is running and I expect it to go for another
10 to 15 minutes.  I will get your the result asap.

Thank you for your invariable assistance.
I am getting excited.

Regards,

Tena Sakai
tsakai@gallo.ucsf.edu


-----Original Message-----
From: Jeff Frost [mailto:jeff@frostconsultingllc.com]
Sent: Wed 2/27/2008 8:32 PM
To: Tena Sakai
Cc: pgsql-admin@postgresql.org
Subject: RE: [ADMIN] trouble with pg_dumpall

On Wed, 27 Feb 2008, Tena Sakai wrote:

> Hi Jeff,
>
> You cuaght me with a fine point.
>
>> but I didn't see HOME being exported.
>
> I have changed the script accordingly:
>
> And the result/my claim remains the same as before:
>
>  pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied
>
> I see just one more option.  Namely, to change the
> postgres user entry for pg_hba.conf to "trust" for
> a short period as pg_dumpall starts and then put it
> back to the way normally is (md5).  I would rather
> not do that and get .pgpass or PGPASSFILE to work
> for me.

I didn't really expect that to make a difference.  What does your .pgpass look
like?  What OS user are you running the cron job as?  Do you have SELINUX
enabled?  Can you run the script with the strace command I sent in a previous
email so that we can see what's really going on?

--
Jeff Frost, Owner       <jeff@frostconsultingllc.com>
Frost Consulting, LLC   http://www.frostconsultingllc.com/
Phone: 650-780-7908     FAX: 650-649-1954

Re: trouble with pg_dumpall

From
Jeff Frost
Date:
On Wed, 27 Feb 2008, Tena Sakai wrote:

> Hi Jeff,
>
>> What does your .pgpass look like?
> *:5432:canon:postgres:winkwink

There's the problem.  That says, any host, port 5432, canon database, postgres
user, password.  But pg_dumpall needs to connect to all the databases
including template1 and postgres DBs.  Change the 'canon' to '*' and I bet it
will be fine.

>
>> What OS user are you running the cron job as?
> User postgres.
>
>> Do you have SELINUX enabled?
> I have no idea what SELINUX is.

cat /etc/selinux/config

>
>> Can you run the script with the strace command
>> I sent in a previous email so that we can see
>> what's really going on?
> Yes, it is running and I expect it to go for another
> 10 to 15 minutes.  I will get your the result asap.
>
> Thank you for your invariable assistance.
> I am getting excited.
>
> Regards,
>
> Tena Sakai
> tsakai@gallo.ucsf.edu
>
>
> -----Original Message-----
> From: Jeff Frost [mailto:jeff@frostconsultingllc.com]
> Sent: Wed 2/27/2008 8:32 PM
> To: Tena Sakai
> Cc: pgsql-admin@postgresql.org
> Subject: RE: [ADMIN] trouble with pg_dumpall
>
> On Wed, 27 Feb 2008, Tena Sakai wrote:
>
>> Hi Jeff,
>>
>> You cuaght me with a fine point.
>>
>>> but I didn't see HOME being exported.
>>
>> I have changed the script accordingly:
>>
>> And the result/my claim remains the same as before:
>>
>>  pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied
>>
>> I see just one more option.  Namely, to change the
>> postgres user entry for pg_hba.conf to "trust" for
>> a short period as pg_dumpall starts and then put it
>> back to the way normally is (md5).  I would rather
>> not do that and get .pgpass or PGPASSFILE to work
>> for me.
>
> I didn't really expect that to make a difference.  What does your .pgpass look
> like?  What OS user are you running the cron job as?  Do you have SELINUX
> enabled?  Can you run the script with the strace command I sent in a previous
> email so that we can see what's really going on?
>
>

--
Jeff Frost, Owner     <jeff@frostconsultingllc.com>
Frost Consulting, LLC     http://www.frostconsultingllc.com/
Phone: 650-780-7908    FAX: 650-649-1954

Re: trouble with pg_dumpall

From
"Tena Sakai"
Date:

Hi Phillip,

I wish I thought of the same thing  What
a fine idea!  And here's the result:

+++++++++
PGUSER: postgres
PGDATABASE: canon
PGHOST: localhost
PGPASSFILE: /usr/local/pgsql/.pgpass
PGDATA: /usr/local/pgsql/data
HOME: /usr/local/pgsql
PATH: /usr/local/pgsql/bin:/bin:/usr/kerberos/bin:/usr/local/java/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/ant/bin:.
|----------|
*:5432:canon:postgres:mysecret
|----------|
Password:
pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied

Regards,

Tena Sakai
tsakai@gallo.ucsf.edu


-----Original Message-----
From: pgsql-admin-owner@postgresql.org on behalf of Phillip Smith
Sent: Wed 2/27/2008 8:31 PM
To: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] trouble with pg_dumpall

> -----Original Message-----
> From: pgsql-admin-owner@postgresql.org
[mailto:pgsql-admin-owner@postgresql.org] On Behalf Of Tena Sakai
> Sent: Thursday, 28 February 2008 15:05
> To: Steve Holdoway; pgsql-admin@postgresql.org
> Subject: Re: [ADMIN] trouble with pg_dumpall
>
> As you can see, I am afraid my point still holds.

Try adding this to your script after the echo PATH: $PATH line, just for
debugging purposes:

/bin/echo "|----------|"
if [ -f ~/.pgpass ] ; then
        /bin/cat ~/.pgpass
else
        /bin/echo ".pgpass missing"
fi
/bin/echo "|----------|"


THINK BEFORE YOU PRINT - Save paper if you don't really need to print this

*******************Confidentiality and Privilege Notice*******************

The material contained in this message is privileged and confidential to
the addressee.  If you are not the addressee indicated in this message or
responsible for delivery of the message to such person, you may not copy
or deliver this message to anyone, and you should destroy it and kindly
notify the sender by reply email.

Information in this message that does not relate to the official business
of Weatherbeeta must be treated as neither given nor endorsed by Weatherbeeta.
Weatherbeeta, its employees, contractors or associates shall not be liable
for direct, indirect or consequential loss arising from transmission of this
message or any attachments
e-mail.

---------------------------(end of broadcast)---------------------------
TIP 6: explain analyze is your friend

Re: trouble with pg_dumpall

From
"Phillip Smith"
Date:
> +++++++++
> PGUSER: postgres
> PGDATABASE: canon
> PGHOST: localhost
> PGPASSFILE: /usr/local/pgsql/.pgpass
> PGDATA: /usr/local/pgsql/data
> HOME: /usr/local/pgsql
> PATH:
/usr/local/pgsql/bin:/bin:/usr/kerberos/bin:/usr/local/java/bin:/usr/local/b
in:/bin:/usr/bin:/usr/X11R6/bin:/usr/local/ant/bin:.
> |----------|
> *:5432:canon:postgres:mysecret
> |----------|
> Password:
> pg_dumpall: could not connect to database "template1": fe_sendauth: no
password supplied

As Jeff said, that's your problem... Change 'canon' to '*' and it should be
fine :)


THINK BEFORE YOU PRINT - Save paper if you don't really need to print this

*******************Confidentiality and Privilege Notice*******************

The material contained in this message is privileged and confidential to
the addressee.  If you are not the addressee indicated in this message or
responsible for delivery of the message to such person, you may not copy
or deliver this message to anyone, and you should destroy it and kindly
notify the sender by reply email.

Information in this message that does not relate to the official business
of Weatherbeeta must be treated as neither given nor endorsed by Weatherbeeta.
Weatherbeeta, its employees, contractors or associates shall not be liable
for direct, indirect or consequential loss arising from transmission of this
message or any attachments
e-mail.

Re: trouble with pg_dumpall

From
"Tena Sakai"
Date:

Yeeeeha!

That did, Jeff!  Fantastic!
*:5432:canon:postgres:winkwink  <- no good
*:5432:*:postgres:winkwink      <- works!

Many thanks to Jeff and everybody else who
stayed with me to see the end of this saga.

I appreciate it wholeheartedly.

Regards,

Tena Sakai
tsakai@gallo.ucsf.edu


-----Original Message-----
From: Jeff Frost [mailto:jeff@frostconsultingllc.com]
Sent: Wed 2/27/2008 8:45 PM
To: Tena Sakai
Cc: pgsql-admin@postgresql.org
Subject: RE: [ADMIN] trouble with pg_dumpall

On Wed, 27 Feb 2008, Tena Sakai wrote:

> Hi Jeff,
>
>> What does your .pgpass look like?
> *:5432:canon:postgres:winkwink

There's the problem.  That says, any host, port 5432, canon database, postgres
user, password.  But pg_dumpall needs to connect to all the databases
including template1 and postgres DBs.  Change the 'canon' to '*' and I bet it
will be fine.

>
>> What OS user are you running the cron job as?
> User postgres.
>
>> Do you have SELINUX enabled?
> I have no idea what SELINUX is.

cat /etc/selinux/config

>
>> Can you run the script with the strace command
>> I sent in a previous email so that we can see
>> what's really going on?
> Yes, it is running and I expect it to go for another
> 10 to 15 minutes.  I will get your the result asap.
>
> Thank you for your invariable assistance.
> I am getting excited.
>
> Regards,
>
> Tena Sakai
> tsakai@gallo.ucsf.edu
>
>
> -----Original Message-----
> From: Jeff Frost [mailto:jeff@frostconsultingllc.com]
> Sent: Wed 2/27/2008 8:32 PM
> To: Tena Sakai
> Cc: pgsql-admin@postgresql.org
> Subject: RE: [ADMIN] trouble with pg_dumpall
>
> On Wed, 27 Feb 2008, Tena Sakai wrote:
>
>> Hi Jeff,
>>
>> You cuaght me with a fine point.
>>
>>> but I didn't see HOME being exported.
>>
>> I have changed the script accordingly:
>>
>> And the result/my claim remains the same as before:
>>
>>  pg_dumpall: could not connect to database "template1": fe_sendauth: no password supplied
>>
>> I see just one more option.  Namely, to change the
>> postgres user entry for pg_hba.conf to "trust" for
>> a short period as pg_dumpall starts and then put it
>> back to the way normally is (md5).  I would rather
>> not do that and get .pgpass or PGPASSFILE to work
>> for me.
>
> I didn't really expect that to make a difference.  What does your .pgpass look
> like?  What OS user are you running the cron job as?  Do you have SELINUX
> enabled?  Can you run the script with the strace command I sent in a previous
> email so that we can see what's really going on?
>
>

--
Jeff Frost, Owner       <jeff@frostconsultingllc.com>
Frost Consulting, LLC   http://www.frostconsultingllc.com/
Phone: 650-780-7908     FAX: 650-649-1954