Thread: Migration from CentOS7 to RedHat 9

Migration from CentOS7 to RedHat 9

From
Wasim Devale
Date:
Hi All

I took dump via pg_dump doing ssh from Red hat it took almost 10 hours for 400GB data including 99GB of BLOBS large objects.

ssh postgres@ipaddre "pg_dump -U postgres -d DB1 F c -b -v" > /path/pg.dump

Is this normal?

Thanks,
Wasim 

Re: Migration from CentOS7 to RedHat 9

From
Ron Johnson
Date:
On Sat, Aug 10, 2024 at 7:14 AM Wasim Devale <wasimd60@gmail.com> wrote:
Hi All

I took dump via pg_dump doing ssh from Red hat it took almost 10 hours for 400GB data including 99GB of BLOBS large objects.

ssh postgres@ipaddre "pg_dump -U postgres -d DB1 F c -b -v" > /path/pg.dump

I see a typo.  Is this a copy/paste of what you ran?

Is this normal?

Maybe.  Blobs are slow.  I'd have done a multi-threaded pg_dump, though blobs might be the bottleneck.

--
Death to America, and butter sauce.
Iraq lobster!

Re: Migration from CentOS7 to RedHat 9

From
Wasim Devale
Date:

Yes, I used the same command I changed the values for this email. And that particular table with BLOBS took a longer time.

I am running a pg_restore now using -j 10 in the command. Please confirm, what you anticipate, will it take same time for restoration on Red Hat 9?

Thanks,
Wasim

On Sat, 10 Aug, 2024, 6:35 pm Ron Johnson, <ronljohnsonjr@gmail.com> wrote:
On Sat, Aug 10, 2024 at 7:14 AM Wasim Devale <wasimd60@gmail.com> wrote:
Hi All

I took dump via pg_dump doing ssh from Red hat it took almost 10 hours for 400GB data including 99GB of BLOBS large objects.

ssh postgres@ipaddre "pg_dump -U postgres -d DB1 F c -b -v" > /path/pg.dump

I see a typo.  Is this a copy/paste of what you ran?

Is this normal?

Maybe.  Blobs are slow.  I'd have done a multi-threaded pg_dump, though blobs might be the bottleneck.

--
Death to America, and butter sauce.
Iraq lobster!

Re: Migration from CentOS7 to RedHat 9

From
Ron Johnson
Date:
"RHEL9" has almost nothing to do with how fast it will restore.  It's all about how fast your disk are, number of CPUs, postgresql.conf settings.

And, of course, blobs are slow.

On Sat, Aug 10, 2024 at 9:26 AM Wasim Devale <wasimd60@gmail.com> wrote:

Yes, I used the same command I changed the values for this email. And that particular table with BLOBS took a longer time.

I am running a pg_restore now using -j 10 in the command. Please confirm, what you anticipate, will it take same time for restoration on Red Hat 9?

Thanks,
Wasim

On Sat, 10 Aug, 2024, 6:35 pm Ron Johnson, <ronljohnsonjr@gmail.com> wrote:
On Sat, Aug 10, 2024 at 7:14 AM Wasim Devale <wasimd60@gmail.com> wrote:
Hi All

I took dump via pg_dump doing ssh from Red hat it took almost 10 hours for 400GB data including 99GB of BLOBS large objects.

ssh postgres@ipaddre "pg_dump -U postgres -d DB1 F c -b -v" > /path/pg.dump

I see a typo.  Is this a copy/paste of what you ran?

Is this normal?

Maybe.  Blobs are slow.  I'd have done a multi-threaded pg_dump, though blobs might be the bottleneck.

--
Death to America, and butter sauce.
Iraq lobster!


--
Death to America, and butter sauce.
Iraq lobster!

Re: Migration from CentOS7 to RedHat 9

From
Wasim Devale
Date:

Thanks it took 3 hours to complete the restoration. The existing CentOS7 resources were limited as you rightly said about CPU and all. Thanks

On Sun, 11 Aug, 2024, 12:06 am Ron Johnson, <ronljohnsonjr@gmail.com> wrote:
"RHEL9" has almost nothing to do with how fast it will restore.  It's all about how fast your disk are, number of CPUs, postgresql.conf settings.

And, of course, blobs are slow.

On Sat, Aug 10, 2024 at 9:26 AM Wasim Devale <wasimd60@gmail.com> wrote:

Yes, I used the same command I changed the values for this email. And that particular table with BLOBS took a longer time.

I am running a pg_restore now using -j 10 in the command. Please confirm, what you anticipate, will it take same time for restoration on Red Hat 9?

Thanks,
Wasim

On Sat, 10 Aug, 2024, 6:35 pm Ron Johnson, <ronljohnsonjr@gmail.com> wrote:
On Sat, Aug 10, 2024 at 7:14 AM Wasim Devale <wasimd60@gmail.com> wrote:
Hi All

I took dump via pg_dump doing ssh from Red hat it took almost 10 hours for 400GB data including 99GB of BLOBS large objects.

ssh postgres@ipaddre "pg_dump -U postgres -d DB1 F c -b -v" > /path/pg.dump

I see a typo.  Is this a copy/paste of what you ran?

Is this normal?

Maybe.  Blobs are slow.  I'd have done a multi-threaded pg_dump, though blobs might be the bottleneck.

--
Death to America, and butter sauce.
Iraq lobster!


--
Death to America, and butter sauce.
Iraq lobster!

Re: Migration from CentOS7 to RedHat 9

From
Muhammad Waqas
Date:
what is the bandwidth between source and destination?

what is the memory of your source server?

2024년 8월 10일 (토) 오후 4:14, Wasim Devale <wasimd60@gmail.com>님이 작성:
Hi All

I took dump via pg_dump doing ssh from Red hat it took almost 10 hours for 400GB data including 99GB of BLOBS large objects.

ssh postgres@ipaddre "pg_dump -U postgres -d DB1 F c -b -v" > /path/pg.dump

Is this normal?

Thanks,
Wasim 


--
Muhammad Waqas
Senior Technical Support Engineer - Tech Support Center (Karachi)
Mobile: +92-322-2844150
1st floor, suit no F-04, COLABS Karachi, 8-C Khayaban-e-Tanzeem, 
DHA Phase 5 Tauheed Commercial Area,
Defense V Defense Housing Authority, Karachi, Karachi City, Sindh, 
75500 Pakistan.