Thread: Problem mirroring PostgreSQL 9.4 yum repository

Hi,

I cannot reproduce this on my box:
$ rsync rsync://yum.postgresql.org/pgrpm-94/redhat/rhel-7-x86_64/ --list-only
drwxr-xr-x         28,672 2016/01/29 13:57:39 .
-rw-r--r--        329,656 2014/08/19 10:02:21 CGAL-4.0.2-1.el6.x86_64.rpm
...

Please note that you added another rhel-7-x86_64 to the tail of the command.

Regards, Devrim



On Thu, 2016-01-28 at 13:36 +0000, Yonko Todorov wrote:
> Dear Sirs,
>
>
> I would like to kindly ask you for your help with a problem, related
> PostgreSQL 9.4 Yum repository.
>
> We are maintaining local copy of PostgreSQL repositories for version
> 9.4 and above for only x86_64 and only RedHat 7/CentOS 7.
> Unfortunately, for 9.4 we are not able to maintain it automatically
> anymore.
>
> The problem is:
>
> On 21.Jan.2016, a symbolic link rhel-7-x86_64 appeared in the
> repository, accessed by rsync on URL
> rsync://yum.postgresql.org/pgrpm-94/redhat/rhel-7-x86_64/. Since
> then, the following error is raised:
> rsync: readlink_stat("/redhat/rhel-7-x86_64/rhel-7-x86_64" (in pgrpm-
> 94)) failed: Too many levels of symbolic links (40) rsync error: some
> files/attrs were not transferred (see previous errors) (code 23) at
> main.c(1518) [generator=3.0.9]
>
> mrepo: Mirroring failed for rsync://yum.postgresql.org/pgrpm-
> 94/redhat/rhel-7-x86_64 with message:
>   Failed with return code: 5888
>
> We use mrepo for mirroring the repository, but the issue is easily
> reproducible by using plain rsync. The exact command is: rsync
> rsync://yum.postgresql.org/pgrpm-94/redhat/rhel-7-x86_64/rhel-7-
> x86_64/ --list-only. On the other hand, the following command
> succeeds: rsync rsync://yum.postgresql.org/pgrpm-94/redhat/rhel-7-
> x86_64/ --list-only.
>
> Additional information:
> We tried to use also the HTTP location of the repository: http://yum.
> postgresql.org/9.4/redhat/rhel-7-x86_64/ but, unfortunately, after
> downloading bunch of RPMs, it gets stuck on repoview with the
> message:
> repoview: Getting files information (100%) [Waiting for response...]
>
> Apparently, mrepo calls lftp to mirror the repository. Exact command
> is:
> /usr/bin/lftp -c "; set net:timeout 3600; mirror -c -P -v -e -I *.rpm
> -X "/headers/" -X "/repodata/" -X "*.src.rpm" -X "/SRPMS/" -X "*-
> debuginfo-*.rpm" -X "/debug/" http://yum.postgresql.org/9.4/redhat/rh
> el-7-x86_64/ /data/mrepo/Centos7-x86_64/postgres94"
>
> Could you, please, help us resolving the issue?
>
> I will be glad to provide more information if needed.
>
> Thank you in advance!
>
>
> Best regards,
> ------------------------------------------------------------------
> Yonko Todorov
> Senior Software Developer
> CRX Markets AG
> Schäufeleinstrasse 1
> 80687 Munich
> Germany
> www.crxmarkets.com<http://www.crxmarkets.com/>;
>
> Amtsgericht - Nürnberg HRB 31519 | Sitz München |
> Aufsichtsratsvorsitzender: Philip Holzer | Vorstand: Christopher
> Schütz
> This e-mail may contain attorney/client privileged information and
> may therefore be confidential. If you are not the intended recipient
> (or have received this e-mail in error) please notify the sender
> immediately and destroy this e-mail. Any unauthorized copying,
> disclosure or distribution of the material in this e-mail is strictly
> forbidden.
>
> P Save per printed page ca. 200 ml Water, 2 g CO2 und 2 g Wood:
> Therefore please do only print if really necessary.
>

J
--
Devrim GÜNDÜZ
Principal Systems Engineer @ EnterpriseDB: http://www.enterprisedb.com
PostgreSQL Danışmanı/Consultant, Red Hat Certified Engineer
Twitter: @DevrimGunduz , @DevrimGunduzTR

Hello Devrim,


Thank you very much for your investigation.

Apparently, it works now. The last failure we noticed was on 29.01.2016 03:30 CET.

The second "rhel-7-x86_64" was a symbolic link inside the repository, pointing to its parent folder with the same name.
Thenthe nesting becomes with endless depth and that was the reason for failure.
 

I am glad that it works well now.

Thank you once again and I wish you all the best.


Best regards,
------------------------------------------------------------------
Yonko Todorov
IT Operations Manager
CRX Markets AG
Schäufeleinstrasse 1
80687 Munich
Germany
www.crxmarkets.com 

Amtsgericht - Nürnberg HRB 31519 | Sitz München | Aufsichtsratsvorsitzender: Philip Holzer | Vorstand: Christopher
Schütz
This e-mail may contain attorney/client privileged information and may therefore be confidential. If you are not the
intendedrecipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail.
Anyunauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden.
 

 Save per printed page ca. 200 ml Water, 2 g CO2 und 2 g Wood: 
Therefore please do only print if really necessary.


-----Original Message-----
From: Devrim GÜNDÜZ [mailto:devrim@gunduz.org] 
Sent: 10 февруари 2016 г. 12:58
To: Yonko Todorov <todorov@crxmarkets.com>; pgsql-pkg-yum@postgresql.org
Cc: Oleksandr Avramov <avramov@crxmarkets.com>; Pasha Shabalin <shabalin@crxmarkets.com>
Subject: Re: [pgsql-pkg-yum] Problem mirroring PostgreSQL 9.4 yum repository


Hi,

I cannot reproduce this on my box:
$ rsync rsync://yum.postgresql.org/pgrpm-94/redhat/rhel-7-x86_64/ --list-only
drwxr-xr-x         28,672 2016/01/29 13:57:39 .
-rw-r--r--        329,656 2014/08/19 10:02:21 CGAL-4.0.2-1.el6.x86_64.rpm
...

Please note that you added another rhel-7-x86_64 to the tail of the command.

Regards, Devrim



On Thu, 2016-01-28 at 13:36 +0000, Yonko Todorov wrote:
> Dear Sirs,
> 
> 
> I would like to kindly ask you for your help with a problem, related
> PostgreSQL 9.4 Yum repository.
> 
> We are maintaining local copy of PostgreSQL repositories for version
> 9.4 and above for only x86_64 and only RedHat 7/CentOS 7.
> Unfortunately, for 9.4 we are not able to maintain it automatically
> anymore.
> 
> The problem is:
> 
> On 21.Jan.2016, a symbolic link rhel-7-x86_64 appeared in the
> repository, accessed by rsync on URL
> rsync://yum.postgresql.org/pgrpm-94/redhat/rhel-7-x86_64/. Since
> then, the following error is raised:
> rsync: readlink_stat("/redhat/rhel-7-x86_64/rhel-7-x86_64" (in pgrpm-
> 94)) failed: Too many levels of symbolic links (40) rsync error: some
> files/attrs were not transferred (see previous errors) (code 23) at
> main.c(1518) [generator=3.0.9]
> 
> mrepo: Mirroring failed for rsync://yum.postgresql.org/pgrpm-
> 94/redhat/rhel-7-x86_64 with message:
>   Failed with return code: 5888
> 
> We use mrepo for mirroring the repository, but the issue is easily
> reproducible by using plain rsync. The exact command is: rsync
> rsync://yum.postgresql.org/pgrpm-94/redhat/rhel-7-x86_64/rhel-7-
> x86_64/ --list-only. On the other hand, the following command
> succeeds: rsync rsync://yum.postgresql.org/pgrpm-94/redhat/rhel-7-
> x86_64/ --list-only.
> 
> Additional information:
> We tried to use also the HTTP location of the repository: http://yum.
> postgresql.org/9.4/redhat/rhel-7-x86_64/ but, unfortunately, after
> downloading bunch of RPMs, it gets stuck on repoview with the
> message:
> repoview: Getting files information (100%) [Waiting for response...]
> 
> Apparently, mrepo calls lftp to mirror the repository. Exact command
> is:
> /usr/bin/lftp -c "; set net:timeout 3600; mirror -c -P -v -e -I *.rpm
> -X "/headers/" -X "/repodata/" -X "*.src.rpm" -X "/SRPMS/" -X "*-
> debuginfo-*.rpm" -X "/debug/" http://yum.postgresql.org/9.4/redhat/rh
> el-7-x86_64/ /data/mrepo/Centos7-x86_64/postgres94"
> 
> Could you, please, help us resolving the issue?
> 
> I will be glad to provide more information if needed.
> 
> Thank you in advance!
> 
> 
> Best regards,
> ------------------------------------------------------------------
> Yonko Todorov
> Senior Software Developer
> CRX Markets AG
> Schäufeleinstrasse 1
> 80687 Munich
> Germany
> www.crxmarkets.com<http://www.crxmarkets.com/>;
> 
> Amtsgericht - Nürnberg HRB 31519 | Sitz München |
> Aufsichtsratsvorsitzender: Philip Holzer | Vorstand: Christopher
> Schütz
> This e-mail may contain attorney/client privileged information and
> may therefore be confidential. If you are not the intended recipient
> (or have received this e-mail in error) please notify the sender
> immediately and destroy this e-mail. Any unauthorized copying,
> disclosure or distribution of the material in this e-mail is strictly
> forbidden.
> 
> P Save per printed page ca. 200 ml Water, 2 g CO2 und 2 g Wood:
> Therefore please do only print if really necessary.
> 

J
-- 
Devrim GÜNDÜZ
Principal Systems Engineer @ EnterpriseDB: http://www.enterprisedb.com
PostgreSQL Danışmanı/Consultant, Red Hat Certified Engineer
Twitter: @DevrimGunduz , @DevrimGunduzTR