Thread: postgresql-11 installation errors via deb package on ubuntu 16
Hey Guys, I do not know if this list is also for asking ubuntu package related queries. We have been recently getting a lot of below errors, as a result of which the entire postgresql installation gets broken. the config folder /etc/postgresql/* is empty, initdb fails to initialize the db and we cannot move forward. the problem is this is happening only on a certain set of servers, but not all. so i do not know if this is an issue with the package or anything else? maybe bad mirror? i came across a similar issue but this is ages back. https://stackoverflow.com/questions/2748607/how-to-thoroughly-purge-and-reinstall-postgresql-on-ubuntu and it was marked close for some reasons. i get the part that removing everything and reinstalling the package resolves the issue, 24 service postgresql stop 25 rm -rf /etc/postgresql* 26 rm -rf /var/lib/postgresql* 27 rm -rf /var/run/postgresql* 28 rm /var/cache/apt/archives/postgresql-* 29 apt-get purge postgresql-11 30 apt-get purge postgresql-client-common 31 rm -rf /var/log/postgresql* 32 puppet agent -t --debug --verbose (this takes care of installation) and then things are fine from here on. error messages from /var/log/apt/term.log Preparing to unpack .../postgresql-11_11.2-1.pgdg16.04+1_amd64.deb ... Unpacking postgresql-11 (11.2-1.pgdg16.04+1) ... Processing triggers for postgresql-common (199.pgdg16.04+1) ... Building PostgreSQL dictionaries from installed myspell/hunspell packages... Removing obsolete dictionary files: Setting up postgresql-11 (11.2-1.pgdg16.04+1) ... Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Unescaped left brace in regex is deprecated, passed through in regex; marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at /usr/sbin/pam_getenv line 78. Configuring already existing cluster (configuration: /etc/postgresql/11/main, data: /var/lib/postgresql/11/main, owner: 112:118) Error: move_conffile: required configuration file /var/lib/postgresql/11/main/postgresql.conf does not exist Error: could not create default cluster. Please create it manually with pg_createcluster 11 main --start ---- all installation happen via deb http://apt.postgresql.org/pub/repos/apt/ xenial-pgdg main 11 this has been really painful to debug, coz i do not know how randomly we get these errors and sometimes not. Regards, Vijay
On 3/18/19 7:24 AM, Vijaykumar Jain wrote: > Hey Guys, > > I do not know if this list is also for asking ubuntu package related queries. > > We have been recently getting a lot of below errors, as a result of > which the entire postgresql installation gets broken. > the config folder /etc/postgresql/* is empty, initdb fails to > initialize the db and we cannot move forward. > > the problem is this is happening only on a certain set of servers, but not all. > so i do not know if this is an issue with the package or anything else? > maybe bad mirror? Per the package below the servers are all Xenial, correct? More below. > > i came across a similar issue but this is ages back. > https://stackoverflow.com/questions/2748607/how-to-thoroughly-purge-and-reinstall-postgresql-on-ubuntu > and it was marked close for some reasons. > i get the part that removing everything and reinstalling the package > resolves the issue, > > > 24 service postgresql stop > 25 rm -rf /etc/postgresql* > 26 rm -rf /var/lib/postgresql* > 27 rm -rf /var/run/postgresql* > 28 rm /var/cache/apt/archives/postgresql-* > 29 apt-get purge postgresql-11 > 30 apt-get purge postgresql-client-common > 31 rm -rf /var/log/postgresql* > 32 puppet agent -t --debug --verbose (this takes care of installation) So what is Puppet actually doing? Do you have Postgres clusters that exist before you try the initial install? > > and then things are fine from here on. > > > > error messages from /var/log/apt/term.log > > > Preparing to unpack .../postgresql-11_11.2-1.pgdg16.04+1_amd64.deb ... > Unpacking postgresql-11 (11.2-1.pgdg16.04+1) ... > Processing triggers for postgresql-common (199.pgdg16.04+1) ... > Building PostgreSQL dictionaries from installed myspell/hunspell packages... > Removing obsolete dictionary files: > Setting up postgresql-11 (11.2-1.pgdg16.04+1) ... > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Unescaped left brace in regex is deprecated, passed through in regex; > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > /usr/sbin/pam_getenv line 78. > Configuring already existing cluster (configuration: > /etc/postgresql/11/main, data: /var/lib/postgresql/11/main, owner: > 112:118) > Error: move_conffile: required configuration file > /var/lib/postgresql/11/main/postgresql.conf does not exist > Error: could not create default cluster. Please create it manually with > > pg_createcluster 11 main --start > > ---- > all installation happen via > deb http://apt.postgresql.org/pub/repos/apt/ xenial-pgdg main 11 > > this has been really painful to debug, coz i do not know how randomly > we get these errors and sometimes not. > > > > Regards, > Vijay > > -- Adrian Klaver adrian.klaver@aklaver.com
Vijaykumar Jain <vjain@opentable.com> writes:
> I do not know if this list is also for asking ubuntu package related queries.
Not really; you'd be better off filing a bug with ubuntu where their
packager(s) will see it.
The symptoms you describe definitely look like there is something
wrong with a packager-supplied configuration adjustment script.
More than that is hard to say without familiarity with the ubuntu
postgres packages, which I lack.
regards, tom lane
Re: [External] Re: postgresql-11 installation errors via deb packageon ubuntu 16
From
Vijaykumar Jain
Date:
uname -a Linux <hostname> 4.4.0-116-generic #140-Ubuntu SMP Mon Feb 12 21:23:04 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux lsb_release -a Distributor ID: Ubuntu Description: Ubuntu 16.04.4 LTS Release: 16.04 Codename: xenial no, these fresh installations. existing installations do not have issues. we have customization, but at the core, this is the part which is installing the package. https://github.com/puppetlabs/puppetlabs-postgresql/blob/master/manifests/server/install.pp (the puppet module version being 4.9.0 though) now this never happens in my vagrant (I am from india) and all my runs are clean. this happens when we run installations on US machines, but coz this is not reproducible, i do not know if this is package issue or something else. also i tried to check if there are issues with apt database etc, but none of the other packages show errors in installation but this. from /var/lib/dpkg/status, both package show as installed ok. Package: postgresql-common Status: install ok installed Priority: optional Section: database Installed-Size: 627 Maintainer: Debian PostgreSQL Maintainers <team+postgresql@tracker.debian.org> Architecture: all Multi-Arch: foreign Version: 199.pgdg16.04+1 Depends: adduser, debconf (>= 0.5.00) | debconf-2.0, lsb-base (>= 3.0-3), postgresql-client-common (= 199.pgdg16.04+1), procps, ssl-cert (>= 1.0.11), ucf, init-system-helpers (>= 1.18~) Recommends: e2fsprogs, logrotate Suggests: libjson-perl Breaks: postgresql-9.1 (<< 9.1.1-3~), systemd (<< 204) Conflicts: postgresql-7.4, postgresql-8.0 Conffiles: /etc/apt/apt.conf.d/01autoremove-postgresql ce792928ef7a41f68842bb9380ddcc48 /etc/init.d/postgresql 1b9da643d7a403248d70e1776fb98458 /etc/logrotate.d/postgresql-common 101326ef5d138998692ece35109ef1a2 /etc/sysctl.d/30-postgresql-shm.conf 9453b06c646f9033eada574154c31a9d Description: PostgreSQL database-cluster manager The postgresql-common package provides a structure under which multiple versions of PostgreSQL may be installed and/or multiple clusters maintained at one time. . The commands provided are pg_conftool, pg_createcluster, pg_ctlcluster, pg_dropcluster, pg_lsclusters, pg_renamecluster, pg_upgradecluster, pg_virtualenv. . PostgreSQL is a fully featured object-relational database management system. It supports a large part of the SQL standard and is designed to be extensible by users in many aspects. Its features include ACID transactions, foreign keys, views, sequences, subqueries, triggers, outer joins, multiversion concurrency control, and user-defined types and functions. Package: postgresql-11 Status: install ok installed Priority: optional Section: database Installed-Size: 43901 Maintainer: Debian PostgreSQL Maintainers <team+postgresql@tracker.debian.org> Architecture: amd64 Version: 11.2-1.pgdg16.04+1 Provides: postgresql-contrib-11 Depends: locales | locales-all, postgresql-client-11, postgresql-common (>= 194~), ssl-cert, tzdata, debconf (>= 0.5) | debconf-2.0, libc6 (>= 2.17), libgcc1 (>= 1:3.0), libgssapi-krb5-2 (>= 1.8+dfsg), libicu55 (>= 55.1-1~), libldap-2.4-2 (>= 2.4.7), libllvm6.0 (>= 1:6.0~svn298832-1~), libpam0g (>= 0.99.7.1), libpq5 (>= 9.3~), libselinux1 (>= 2.1.12), libssl1.0.0 (>= 1.0.2~beta3), libstdc++6 (>= 5.2), libsystemd0, libuuid1 (>= 2.16), libxml2 (>= 2.7.4), libxslt1.1 (>= 1.1.25), zlib1g (>= 1:1.1.4) Recommends: sysstat Breaks: postgresql-11-citus (<< 8.0.0.PGDG-2~), postgresql-11-cron (<< 1.1.3-2~), postgresql-11-pgextwlist (<< 1.8-2~), postgresql-11-pglogical (<< 2.2.1-4~), postgresql-11-plsh (<< 1.20171014-3~), postgresql-11-rum (<< 1.3.2-4~), postgresql-11-wal2json (<< 1.0-5~) Description: object-relational SQL database, version 11 server PostgreSQL is a powerful, open source object-relational database system. It is fully ACID compliant, has full support for foreign keys, joins, views, triggers, and stored procedures (in multiple languages). It includes most SQL:2008 data types, including INTEGER, NUMERIC, BOOLEAN, CHAR, VARCHAR, DATE, INTERVAL, and TIMESTAMP. It also supports storage of binary large objects, including pictures, sounds, or video. It has native programming interfaces for C/C++, Java, .Net, Perl, Python, Ruby, Tcl, ODBC, among others, and exceptional documentation. . This package provides the database server for PostgreSQL 11. Homepage: http://www.postgresql.org/ Postgresql-Catversion: 201809051 let me know if you need more info. Regards, Vijay On Mon, Mar 18, 2019 at 8:06 PM Adrian Klaver <adrian.klaver@aklaver.com> wrote: > > On 3/18/19 7:24 AM, Vijaykumar Jain wrote: > > Hey Guys, > > > > I do not know if this list is also for asking ubuntu package related queries. > > > > We have been recently getting a lot of below errors, as a result of > > which the entire postgresql installation gets broken. > > the config folder /etc/postgresql/* is empty, initdb fails to > > initialize the db and we cannot move forward. > > > > the problem is this is happening only on a certain set of servers, but not all. > > so i do not know if this is an issue with the package or anything else? > > maybe bad mirror? > > Per the package below the servers are all Xenial, correct? > More below. > > > > > > i came across a similar issue but this is ages back. > > https://stackoverflow.com/questions/2748607/how-to-thoroughly-purge-and-reinstall-postgresql-on-ubuntu > > and it was marked close for some reasons. > > i get the part that removing everything and reinstalling the package > > resolves the issue, > > > > > > 24 service postgresql stop > > 25 rm -rf /etc/postgresql* > > 26 rm -rf /var/lib/postgresql* > > 27 rm -rf /var/run/postgresql* > > 28 rm /var/cache/apt/archives/postgresql-* > > 29 apt-get purge postgresql-11 > > 30 apt-get purge postgresql-client-common > > 31 rm -rf /var/log/postgresql* > > 32 puppet agent -t --debug --verbose (this takes care of installation) > > So what is Puppet actually doing? > > Do you have Postgres clusters that exist before you try the initial install? > > > > > and then things are fine from here on. > > > > > > > > error messages from /var/log/apt/term.log > > > > > > Preparing to unpack .../postgresql-11_11.2-1.pgdg16.04+1_amd64.deb ... > > Unpacking postgresql-11 (11.2-1.pgdg16.04+1) ... > > Processing triggers for postgresql-common (199.pgdg16.04+1) ... > > Building PostgreSQL dictionaries from installed myspell/hunspell packages... > > Removing obsolete dictionary files: > > Setting up postgresql-11 (11.2-1.pgdg16.04+1) ... > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Unescaped left brace in regex is deprecated, passed through in regex; > > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at > > /usr/sbin/pam_getenv line 78. > > Configuring already existing cluster (configuration: > > /etc/postgresql/11/main, data: /var/lib/postgresql/11/main, owner: > > 112:118) > > Error: move_conffile: required configuration file > > /var/lib/postgresql/11/main/postgresql.conf does not exist > > Error: could not create default cluster. Please create it manually with > > > > pg_createcluster 11 main --start > > > > ---- > > all installation happen via > > deb http://apt.postgresql.org/pub/repos/apt/ xenial-pgdg main 11 > > > > this has been really painful to debug, coz i do not know how randomly > > we get these errors and sometimes not. > > > > > > > > Regards, > > Vijay > > > > > > > -- > Adrian Klaver > adrian.klaver@aklaver.com
Re: [External] Re: postgresql-11 installation errors via deb packageon ubuntu 16
From
Vijaykumar Jain
Date:
Thanks Tom, I probably thought it was not the right forum, but thanks for being polite and saying no. I just wanted to take a chance if this was known to anyone, coz googling did not show recent issues with the same. But ok, I'll ask in ubuntu forums. Regards, Vijay On Mon, Mar 18, 2019 at 8:15 PM Tom Lane <tgl@sss.pgh.pa.us> wrote: > > Vijaykumar Jain <vjain@opentable.com> writes: > > I do not know if this list is also for asking ubuntu package related queries. > > Not really; you'd be better off filing a bug with ubuntu where their > packager(s) will see it. > > The symptoms you describe definitely look like there is something > wrong with a packager-supplied configuration adjustment script. > More than that is hard to say without familiarity with the ubuntu > postgres packages, which I lack. > > regards, tom lane
Re: [External] Re: postgresql-11 installation errors via deb packageon ubuntu 16
From
Adrian Klaver
Date:
On 3/18/19 7:49 AM, Vijaykumar Jain wrote: > Thanks Tom, > > I probably thought it was not the right forum, but thanks for being > polite and saying no. Given that you are using the PGDG packages I would consider this the correct list. > I just wanted to take a chance if this was known to anyone, coz > googling did not show recent issues with the same. > But ok, I'll ask in ubuntu forums. I would start closer to the package you are actually working with: https://redmine.postgresql.org/projects/pgapt You will need to set up a Postgres community account, if you do not already have one, to access the issue tracker. > > > Regards, > Vijay > > On Mon, Mar 18, 2019 at 8:15 PM Tom Lane <tgl@sss.pgh.pa.us> wrote: >> >> Vijaykumar Jain <vjain@opentable.com> writes: >>> I do not know if this list is also for asking ubuntu package related queries. >> >> Not really; you'd be better off filing a bug with ubuntu where their >> packager(s) will see it. >> >> The symptoms you describe definitely look like there is something >> wrong with a packager-supplied configuration adjustment script. >> More than that is hard to say without familiarity with the ubuntu >> postgres packages, which I lack. >> >> regards, tom lane > > -- Adrian Klaver adrian.klaver@aklaver.com