Re: psql: FATAL: the database system is starting up - Mailing list pgsql-general
| From | Tom K |
|---|---|
| Subject | Re: psql: FATAL: the database system is starting up |
| Date | |
| Msg-id | CAE3EmBDE2=0dPJhTpcdyieKjHMs1-M6E+Da23vYQkH+FVyUJyQ@mail.gmail.com Whole thread Raw |
| In response to | Re: psql: FATAL: the database system is starting up (Adrian Klaver <adrian.klaver@aklaver.com>) |
| Responses |
Re: psql: FATAL: the database system is starting up
|
| List | pgsql-general |
On Sat, Jun 1, 2019 at 5:51 PM Adrian Klaver <adrian.klaver@aklaver.com> wrote:
On 6/1/19 2:31 PM, Tom K wrote:
>
>
>
> Spoke too soon. There's no tables when it's started without the
> recovery.conf file.
Where there any errors in the start up?
Nothing I would discern as a startup error:
[root@psql03 patroni]# sudo su - postgres
Last login: Sat Jun 1 17:30:31 EDT 2019 on pts/1
-bash-4.2$ /usr/pgsql-10/bin/postgres -D /data/patroni --config-file=/data/patroni/postgresql.conf --listen_addresses=192.168.0.118 --max_worker_processes=8 --max_locks_per_transaction=64 --wal_level=replica --track_commit_timestamp=off --max_prepared_transactions=0 --port=5432 --max_replication_slots=10 --max_connections=100 --hot_standby=on --cluster_name=postgres --wal_log_hints=on --max_wal_senders=10 -d 5
2019-06-01 17:41:27.477 EDT [15209] DEBUG: postgres: PostmasterMain: initial environment dump:
2019-06-01 17:41:27.477 EDT [15209] DEBUG: -----------------------------------------
2019-06-01 17:41:27.477 EDT [15209] DEBUG: XDG_SESSION_ID=219
2019-06-01 17:41:27.477 EDT [15209] DEBUG: HOSTNAME=psql03.nix.mds.xyz
2019-06-01 17:41:27.477 EDT [15209] DEBUG: SHELL=/bin/bash
2019-06-01 17:41:27.477 EDT [15209] DEBUG: TERM=xterm
2019-06-01 17:41:27.477 EDT [15209] DEBUG: HISTSIZE=1000
2019-06-01 17:41:27.477 EDT [15209] DEBUG: USER=postgres
2019-06-01 17:41:27.477 EDT [15209] DEBUG: LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;05;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.axa=01;36:*.oga=01;36:*.spx=01;36:*.xspf=01;36:
2019-06-01 17:41:27.477 EDT [15209] DEBUG: MAIL=/var/spool/mail/postgres
2019-06-01 17:41:27.477 EDT [15209] DEBUG: PATH=/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/pgsql-10/bin/
2019-06-01 17:41:27.477 EDT [15209] DEBUG: PWD=/var/lib/pgsql
2019-06-01 17:41:27.477 EDT [15209] DEBUG: LANG=en_US.UTF-8
2019-06-01 17:41:27.477 EDT [15209] DEBUG: HISTCONTROL=ignoredups
2019-06-01 17:41:27.477 EDT [15209] DEBUG: SHLVL=1
2019-06-01 17:41:27.477 EDT [15209] DEBUG: HOME=/var/lib/pgsql
2019-06-01 17:41:27.477 EDT [15209] DEBUG: LOGNAME=postgres
2019-06-01 17:41:27.478 EDT [15209] DEBUG: PGDATA=/var/lib/pgsql/10/data
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LESSOPEN=||/usr/bin/lesspipe.sh %s
2019-06-01 17:41:27.478 EDT [15209] DEBUG: _=/usr/pgsql-10/bin/postgres
2019-06-01 17:41:27.478 EDT [15209] DEBUG: PGLOCALEDIR=/usr/pgsql-10/share/locale
2019-06-01 17:41:27.478 EDT [15209] DEBUG: PGSYSCONFDIR=/etc/sysconfig/pgsql
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LC_COLLATE=en_US.UTF-8
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LC_CTYPE=en_US.UTF-8
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LC_MESSAGES=en_US.UTF-8
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LC_MONETARY=C
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LC_NUMERIC=C
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LC_TIME=C
2019-06-01 17:41:27.478 EDT [15209] DEBUG: -----------------------------------------
2019-06-01 17:41:27.494 EDT [15209] DEBUG: registering background worker "logical replication launcher"
2019-06-01 17:41:27.495 EDT [15209] LOG: listening on IPv4 address "192.168.0.118", port 5432
2019-06-01 17:41:27.498 EDT [15209] LOG: listening on Unix socket "./.s.PGSQL.5432"
2019-06-01 17:41:27.499 EDT [15209] DEBUG: invoking IpcMemoryCreate(size=148545536)
2019-06-01 17:41:27.499 EDT [15209] DEBUG: mmap(148897792) with MAP_HUGETLB failed, huge pages disabled: Cannot allocate memory
2019-06-01 17:41:27.514 EDT [15209] DEBUG: SlruScanDirectory invoking callback on pg_notify/0000
2019-06-01 17:41:27.514 EDT [15209] DEBUG: removing file "pg_notify/0000"
2019-06-01 17:41:27.515 EDT [15209] DEBUG: dynamic shared memory system will support 288 segments
2019-06-01 17:41:27.515 EDT [15209] DEBUG: created dynamic shared memory control segment 834455595 (6928 bytes)
2019-06-01 17:41:27.518 EDT [15209] DEBUG: max_safe_fds = 985, usable_fds = 1000, already_open = 5
2019-06-01 17:41:27.519 EDT [15209] LOG: redirecting log output to logging collector process
2019-06-01 17:41:27.519 EDT [15209] HINT: Future log output will appear in directory "log".
2019-06-01 17:41:27.550 EDT [15210] DEBUG: logger shutting down
2019-06-01 17:41:27.550 EDT [15210] DEBUG: shmem_exit(0): 0 before_shmem_exit callbacks to make
2019-06-01 17:41:27.550 EDT [15210] DEBUG: shmem_exit(0): 0 on_shmem_exit callbacks to make
-bash-4.2$ 2019-06-01 17:41:27.550 EDT [15210] DEBUG: proc_exit(0): 0 callbacks to make
2019-06-01 17:41:27.550 EDT [15210] DEBUG: exit(0)
2019-06-01 17:41:27.550 EDT [15210] DEBUG: shmem_exit(-1): 0 before_shmem_exit callbacks to make
2019-06-01 17:41:27.550 EDT [15210] DEBUG: shmem_exit(-1): 0 on_shmem_exit callbacks to make
2019-06-01 17:41:27.550 EDT [15210] DEBUG: proc_exit(-1): 0 callbacks to make
-bash-4.2$
-bash-4.2$
Last login: Sat Jun 1 17:30:31 EDT 2019 on pts/1
-bash-4.2$ /usr/pgsql-10/bin/postgres -D /data/patroni --config-file=/data/patroni/postgresql.conf --listen_addresses=192.168.0.118 --max_worker_processes=8 --max_locks_per_transaction=64 --wal_level=replica --track_commit_timestamp=off --max_prepared_transactions=0 --port=5432 --max_replication_slots=10 --max_connections=100 --hot_standby=on --cluster_name=postgres --wal_log_hints=on --max_wal_senders=10 -d 5
2019-06-01 17:41:27.477 EDT [15209] DEBUG: postgres: PostmasterMain: initial environment dump:
2019-06-01 17:41:27.477 EDT [15209] DEBUG: -----------------------------------------
2019-06-01 17:41:27.477 EDT [15209] DEBUG: XDG_SESSION_ID=219
2019-06-01 17:41:27.477 EDT [15209] DEBUG: HOSTNAME=psql03.nix.mds.xyz
2019-06-01 17:41:27.477 EDT [15209] DEBUG: SHELL=/bin/bash
2019-06-01 17:41:27.477 EDT [15209] DEBUG: TERM=xterm
2019-06-01 17:41:27.477 EDT [15209] DEBUG: HISTSIZE=1000
2019-06-01 17:41:27.477 EDT [15209] DEBUG: USER=postgres
2019-06-01 17:41:27.477 EDT [15209] DEBUG: LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;05;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.axa=01;36:*.oga=01;36:*.spx=01;36:*.xspf=01;36:
2019-06-01 17:41:27.477 EDT [15209] DEBUG: MAIL=/var/spool/mail/postgres
2019-06-01 17:41:27.477 EDT [15209] DEBUG: PATH=/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/pgsql-10/bin/
2019-06-01 17:41:27.477 EDT [15209] DEBUG: PWD=/var/lib/pgsql
2019-06-01 17:41:27.477 EDT [15209] DEBUG: LANG=en_US.UTF-8
2019-06-01 17:41:27.477 EDT [15209] DEBUG: HISTCONTROL=ignoredups
2019-06-01 17:41:27.477 EDT [15209] DEBUG: SHLVL=1
2019-06-01 17:41:27.477 EDT [15209] DEBUG: HOME=/var/lib/pgsql
2019-06-01 17:41:27.477 EDT [15209] DEBUG: LOGNAME=postgres
2019-06-01 17:41:27.478 EDT [15209] DEBUG: PGDATA=/var/lib/pgsql/10/data
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LESSOPEN=||/usr/bin/lesspipe.sh %s
2019-06-01 17:41:27.478 EDT [15209] DEBUG: _=/usr/pgsql-10/bin/postgres
2019-06-01 17:41:27.478 EDT [15209] DEBUG: PGLOCALEDIR=/usr/pgsql-10/share/locale
2019-06-01 17:41:27.478 EDT [15209] DEBUG: PGSYSCONFDIR=/etc/sysconfig/pgsql
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LC_COLLATE=en_US.UTF-8
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LC_CTYPE=en_US.UTF-8
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LC_MESSAGES=en_US.UTF-8
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LC_MONETARY=C
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LC_NUMERIC=C
2019-06-01 17:41:27.478 EDT [15209] DEBUG: LC_TIME=C
2019-06-01 17:41:27.478 EDT [15209] DEBUG: -----------------------------------------
2019-06-01 17:41:27.494 EDT [15209] DEBUG: registering background worker "logical replication launcher"
2019-06-01 17:41:27.495 EDT [15209] LOG: listening on IPv4 address "192.168.0.118", port 5432
2019-06-01 17:41:27.498 EDT [15209] LOG: listening on Unix socket "./.s.PGSQL.5432"
2019-06-01 17:41:27.499 EDT [15209] DEBUG: invoking IpcMemoryCreate(size=148545536)
2019-06-01 17:41:27.499 EDT [15209] DEBUG: mmap(148897792) with MAP_HUGETLB failed, huge pages disabled: Cannot allocate memory
2019-06-01 17:41:27.514 EDT [15209] DEBUG: SlruScanDirectory invoking callback on pg_notify/0000
2019-06-01 17:41:27.514 EDT [15209] DEBUG: removing file "pg_notify/0000"
2019-06-01 17:41:27.515 EDT [15209] DEBUG: dynamic shared memory system will support 288 segments
2019-06-01 17:41:27.515 EDT [15209] DEBUG: created dynamic shared memory control segment 834455595 (6928 bytes)
2019-06-01 17:41:27.518 EDT [15209] DEBUG: max_safe_fds = 985, usable_fds = 1000, already_open = 5
2019-06-01 17:41:27.519 EDT [15209] LOG: redirecting log output to logging collector process
2019-06-01 17:41:27.519 EDT [15209] HINT: Future log output will appear in directory "log".
2019-06-01 17:41:27.550 EDT [15210] DEBUG: logger shutting down
2019-06-01 17:41:27.550 EDT [15210] DEBUG: shmem_exit(0): 0 before_shmem_exit callbacks to make
2019-06-01 17:41:27.550 EDT [15210] DEBUG: shmem_exit(0): 0 on_shmem_exit callbacks to make
-bash-4.2$ 2019-06-01 17:41:27.550 EDT [15210] DEBUG: proc_exit(0): 0 callbacks to make
2019-06-01 17:41:27.550 EDT [15210] DEBUG: exit(0)
2019-06-01 17:41:27.550 EDT [15210] DEBUG: shmem_exit(-1): 0 before_shmem_exit callbacks to make
2019-06-01 17:41:27.550 EDT [15210] DEBUG: shmem_exit(-1): 0 on_shmem_exit callbacks to make
2019-06-01 17:41:27.550 EDT [15210] DEBUG: proc_exit(-1): 0 callbacks to make
-bash-4.2$
-bash-4.2$
This message:
mmap(148897792) with MAP_HUGETLB failed, huge pages disabled: Cannot allocate memory
doesn't seem to have been a problem. I doubled the memory on the VM but the message remained.
Are there databases in the clusters system(template1, postgres, etc) or
user?
No.
Did you start against the correct PG_DATA directory?
Yes.
--
Adrian Klaver
adrian.klaver@aklaver.com
pgsql-general by date: