Thread: Intermittent Startup Failures
I have users experiencing problems with PostgreSQL failing to start up consistently when their machines reboot. (The reboot may or may not be a result of a machine lockup.) No messages have been logged to the /var/log/messages file other than "startup failed", but executing the startup script by hand then successfully starts PostgreSQL. I have also seen the "starup failed" message displayed on reboot, logged to the messages file, but when I checked, postmaster acually is running and I was able to start psql. I'm not a script file or Linux guru, but need to get to the bottom of this problem. Sorry I cannot provide more data, but any suggestions to help me debug this problem would be appreciated. BTW, I'm using PostgreSQL 7.1 with Linux 7.0.
There may be some errors in the script that's loads postgres at startup. Look in the "/etc/rc.d/init/" directory and see if there is an executable named postgres or something similar. If so, post the source of this file to the group so we can take a look. Good Luck! -Ryan Mahoney At 10:22 AM 7/18/01 -0700, Debra LaVille wrote: >I have users experiencing problems with PostgreSQL failing to start up >consistently when their machines reboot. (The reboot may or may not be a >result of a machine lockup.) No messages have been logged to the >/var/log/messages file other than "startup failed", but executing the >startup script by hand then successfully starts PostgreSQL. I have also seen >the "starup failed" message displayed on reboot, logged to the messages >file, but when I checked, postmaster acually is running and I was able to >start psql. I'm not a script file or Linux guru, but need to get to the >bottom of this problem. Sorry I cannot provide more data, but any >suggestions to help me debug this problem would be appreciated. BTW, I'm >using PostgreSQL 7.1 with Linux 7.0. > > > > >---------------------------(end of broadcast)--------------------------- >TIP 5: Have you checked our extensive FAQ? > >http://www.postgresql.org/users-lounge/docs/faq.html > > > >--- >Incoming mail is certified Virus Free. >Checked by AVG anti-virus system (http://www.grisoft.com). >Version: 6.0.251 / Virus Database: 124 - Release Date: 4/26/01 --- Outgoing mail is certified Virus Free. Checked by AVG anti-virus system (http://www.grisoft.com). Version: 6.0.251 / Virus Database: 124 - Release Date: 4/26/01
Debra LaVille wrote: <snip> > suggestions to help me debug this problem would be appreciated. BTW, I'm > using PostgreSQL 7.1 with Linux 7.0. > There is no Linux 7.0. You probably mean redhat 7.0 which shipped with a broken glibc. Upgrade your glibc rpms and see if that changes anything. Also make sure the startup script is symlinked in the right directory. You may have in in rc3.d but the machine is startingup in runlevel 5. -- Joseph Shraibman jks@selectacast.net Increase signal to noise ratio. http://www.targabot.com
I'm using the script file included with the postgresql distribution:
***********************************************************************
# PGVERSION is:
PGVERSION=7.1.2
# Source function library.
INITD=/etc/rc.d/init.d
. $INITD/functions
# Get function listing for cross-distribution logic.
#TYPESET=`typeset -f|grep "declare"`
# Get config.
. /etc/sysconfig/network
# Check that networking is up.
# Pretty much need it for postmaster.
[ "${NETWORKING}" = "no" ] && exit 0
[ -f /usr/bin/postmaster ] || exit 0
start(){
PSQL_START=$"Starting postgresql service: "
export PGDATA=/var/lib/pgsql/data
if [ ! -d $PGDATA/base ]
then
# Check version of existing PGDATA
# No existing PGDATA! Initdb it.
echo -n $"Initializing database: "
if [ ! -d $PGDATA ]
then
mkdir -p $PGDATA
chown postgres.postgres $PGDATA
fi
# Make sure the locale from the initdb is preserved for
later startups...
[ -f /etc/sysconfig/i18n ] && cp /etc/sysconfig/i18n
$PGDATA/../initdb.i18n
# Just in case no locale was set, use en_US
[ ! -f /etc/sysconfig/i18n ] && echo "LANG=en_US" >
$PGDATA/../initdb.i18n
# Is expanded this early to be used in the command su runs
echo "export LANG LC_ALL LC_CTYPE LC_COLLATE LC_NUMERIC
LC_CTYPE LC_TIME" >> $PGDATA/../initdb.i18n
# Initialize the database
su -l postgres -s /bin/sh -c "/usr/bin/initdb
--pgdata=/var/lib/pgsql/data > /dev/null 2>&1" < /dev/null
[ -f $PGDATA/PG_VERSION ] && echo_success
[ ! -f $PGDATA/PG_VERSION ] && echo_failure
echo
fi
# Check for postmaster already running...
pid=`pidof -s postmaster`
if [ $pid ]
then
echo $"Postmaster already running."
else
#all systems go -- remove any stale lock files
rm -f /tmp/.s.PGSQL.* > /dev/null
echo -n "$PSQL_START"
su -l postgres -s /bin/sh -c "/usr/bin/pg_ctl -D $PGDATA -p
/usr/bin/postmaster start > /dev/null 2>&1" < /dev/null
sleep 1
pid=`pidof -s postmaster`
if [ $pid ]
then
echo " [ OK ]"
touch /var/lock/subsys/postgresql
echo $pid > /var/run/postmaster.pid
echo
else
echo " [ FAILED ]"
echo
fi
fi
}
stop(){
echo -n $"Stopping postgresql service: "
# Check for older PGDATA location.
export PGDATA=/var/lib/pgsql/data
su -l postgres -s /bin/sh -c "/usr/bin/pg_ctl stop -D $PGDATA -s -m
fast" > /dev/null 2>&1
ret=$? # This will always be 0, as the return code doesn't
propagate... Fix that some day.
if [ $ret -eq 0 ]; then
echo_success
else
echo_failure
fi
echo
rm -f /var/run/postmaster.pid
rm -f /var/lock/subsys/postgresql
}
restart(){
stop
start
}
condrestart(){
[ -e /var/lock/subsys/postgresql ] && restart || :
}
# This script is slightly unusual in that the name of the daemon
(postmaster)
# is not the same as the name of the subsystem (postgresql)
# See how we were called.
case "$1" in
start)
start
;;
stop)
stop
;;
status)
status postmaster
;;
restart)
restart
;;
condrestart)
condrestart
;;
*)
echo $"Usage: $0 {start|stop|status|restart|condrestart}"
exit 1
esac
exit 0
****************************************************************************
***
-----Original Message-----
From: Ryan Mahoney [mailto:ryan@paymentalliance.net]
Sent: Wednesday, July 18, 2001 12:43 PM
To: Debra LaVille; pgsql-general@postgresql.org
Subject: Re: Intermittent Startup Failures
There may be some errors in the script that's loads postgres at
startup. Look in the "/etc/rc.d/init/" directory and see if there is an
executable named postgres or something similar. If so, post the source of
this file to the group so we can take a look.
Good Luck!
-Ryan Mahoney
At 10:22 AM 7/18/01 -0700, Debra LaVille wrote:
>I have users experiencing problems with PostgreSQL failing to start up
>consistently when their machines reboot. (The reboot may or may not be a
>result of a machine lockup.) No messages have been logged to the
>/var/log/messages file other than "startup failed", but executing the
>startup script by hand then successfully starts PostgreSQL. I have also
seen
>the "starup failed" message displayed on reboot, logged to the messages
>file, but when I checked, postmaster acually is running and I was able to
>start psql. I'm not a script file or Linux guru, but need to get to the
>bottom of this problem. Sorry I cannot provide more data, but any
>suggestions to help me debug this problem would be appreciated. BTW, I'm
>using PostgreSQL 7.1 with Linux 7.0.
>
>
>
>
>---------------------------(end of broadcast)---------------------------
>TIP 5: Have you checked our extensive FAQ?
>
>http://www.postgresql.org/users-lounge/docs/faq.html
>
>
>
>---
>Incoming mail is certified Virus Free.
>Checked by AVG anti-virus system (http://www.grisoft.com).
>Version: 6.0.251 / Virus Database: 124 - Release Date: 4/26/01
Debra LaVille <debra.laville@digeo.com> writes:
> I'm using the script file included with the postgresql distribution:
Hmm, is this from an RPM? It's certainly not part of what *I* consider
the Postgres distribution ...
> #all systems go -- remove any stale lock files
> rm -f /tmp/.s.PGSQL.* > /dev/null
> echo -n "$PSQL_START"
> su -l postgres -s /bin/sh -c "/usr/bin/pg_ctl -D $PGDATA -p
> /usr/bin/postmaster start > /dev/null 2>&1" < /dev/null
> sleep 1
> pid=`pidof -s postmaster`
> if [ $pid ]
> then
> echo " [ OK ]"
> touch /var/lock/subsys/postgresql
> echo $pid > /var/run/postmaster.pid
> echo
> else
> echo " [ FAILED ]"
> echo
> fi
Since this thing is sending the postmaster's stderr output to /dev/null,
it's impossible to tell what's going wrong. Change the su line to be
something like
su -l postgres -s /bin/sh -c "/usr/bin/pg_ctl -D $PGDATA -p /usr/bin/postmaster start >> /some/handy/logfile 2>&1" <
/dev/null
and then let us know what you see in /some/handy/logfile after you get a
failure.
regards, tom lane