Postgres Pro
Downloads
Home   >   mailing lists

Thread: suggestion the process to sync the data from PROD DB to Staging environment

suggestion the process to sync the data from PROD DB to Staging environment

From
postgann2020 s
Date:
Hi Team,

Thanks for your support.

Could someone please suggest the process to sync the data from PROD DB to the Staging environment with minimal manual intervention or automatically.

Thanks & Regards,
Postgann.

Re: suggestion the process to sync the data from PROD DB to Staging environment

From
Luan Huynh
Date:
Hi Postgann,

How frequently do you sync hourly/daily/weekly? Do you have other processes writing data into Staging env?  

Regards,

On Wed, May 27, 2020 at 5:56 PM postgann2020 s <postgann2020@gmail.com> wrote:
Hi Team,

Thanks for your support.

Could someone please suggest the process to sync the data from PROD DB to the Staging environment with minimal manual intervention or automatically.

Thanks & Regards,
Postgann.

Re: suggestion the process to sync the data from PROD DB to Staging environment

From
Luan Huynh
Date:
Hi Postgann,

How frequently do you sync hourly/daily/weekly? Do you have other processes writing data into Staging env?  

Regards,

On Wed, May 27, 2020 at 5:56 PM postgann2020 s <postgann2020@gmail.com> wrote:
Hi Team,

Thanks for your support.

Could someone please suggest the process to sync the data from PROD DB to the Staging environment with minimal manual intervention or automatically.

Thanks & Regards,
Postgann.

Re: suggestion the process to sync the data from PROD DB to Staging environment

From
postgann2020 s
Date:
Hi Luan,

Thanks for your email.

How frequently do you sync hourly/daily/weekly?  > looking for a daily basis. 
Do you have other processes writing data into Staging env?  > Yes, we have old PROD data.

Thanks & Regards,
Postgann. 

On Wed, May 27, 2020 at 9:33 PM Luan Huynh <nnhluan@gmail.com> wrote:
Hi Postgann,

How frequently do you sync hourly/daily/weekly? Do you have other processes writing data into Staging env?  

Regards,

On Wed, May 27, 2020 at 5:56 PM postgann2020 s <postgann2020@gmail.com> wrote:
Hi Team,

Thanks for your support.

Could someone please suggest the process to sync the data from PROD DB to the Staging environment with minimal manual intervention or automatically.

Thanks & Regards,
Postgann.

Re: suggestion the process to sync the data from PROD DB to Staging environment

From
postgann2020 s
Date:
Hi Luan,

Thanks for your email.

How frequently do you sync hourly/daily/weekly?  > looking for a daily basis. 
Do you have other processes writing data into Staging env?  > Yes, we have old PROD data.

Thanks & Regards,
Postgann. 

On Wed, May 27, 2020 at 9:33 PM Luan Huynh <nnhluan@gmail.com> wrote:
Hi Postgann,

How frequently do you sync hourly/daily/weekly? Do you have other processes writing data into Staging env?  

Regards,

On Wed, May 27, 2020 at 5:56 PM postgann2020 s <postgann2020@gmail.com> wrote:
Hi Team,

Thanks for your support.

Could someone please suggest the process to sync the data from PROD DB to the Staging environment with minimal manual intervention or automatically.

Thanks & Regards,
Postgann.

Re: suggestion the process to sync the data from PROD DB to Staging environment

From
"David G. Johnston"
Date:
On Wed, May 27, 2020 at 8:56 AM postgann2020 s <postgann2020@gmail.com> wrote:
Could someone please suggest the process to sync the data from PROD DB to the Staging environment with minimal manual intervention or automatically.

Read up on the general purpose "bash" scripting language, the PostgreSQL "pg_dump" and "pg_restore" commands, "ssh", and "cron".

"cron" and "bash" provide for the "automatically" requirement.

It is possible to assemble something functional with those tools.  Whether it will actually work in your specific situation is impossible to say since you provide zero information about your environment.

David J.

Re: suggestion the process to sync the data from PROD DB to Staging environment

From
"David G. Johnston"
Date:
On Wed, May 27, 2020 at 8:56 AM postgann2020 s <postgann2020@gmail.com> wrote:
Could someone please suggest the process to sync the data from PROD DB to the Staging environment with minimal manual intervention or automatically.

Read up on the general purpose "bash" scripting language, the PostgreSQL "pg_dump" and "pg_restore" commands, "ssh", and "cron".

"cron" and "bash" provide for the "automatically" requirement.

It is possible to assemble something functional with those tools.  Whether it will actually work in your specific situation is impossible to say since you provide zero information about your environment.

David J.

Re: suggestion the process to sync the data from PROD DB to Staging environment

From
postgann2020 s
Date:
Thanks, David,

Please find the environment details.

Environment:
PROD:
OS: RHEL 7.1
Postgres: 9.5.15

Staging:
OS: RHEL 7.1
Postgres: 9.5.15

Thanks&Regards,
PostgAnn.

On Wed, May 27, 2020 at 9:51 PM David G. Johnston <david.g.johnston@gmail.com> wrote:
On Wed, May 27, 2020 at 8:56 AM postgann2020 s <postgann2020@gmail.com> wrote:
Could someone please suggest the process to sync the data from PROD DB to the Staging environment with minimal manual intervention or automatically.

Read up on the general purpose "bash" scripting language, the PostgreSQL "pg_dump" and "pg_restore" commands, "ssh", and "cron".

"cron" and "bash" provide for the "automatically" requirement.

It is possible to assemble something functional with those tools.  Whether it will actually work in your specific situation is impossible to say since you provide zero information about your environment.

David J.

Re: suggestion the process to sync the data from PROD DB to Staging environment

From
postgann2020 s
Date:
Thanks, David,

Please find the environment details.

Environment:
PROD:
OS: RHEL 7.1
Postgres: 9.5.15

Staging:
OS: RHEL 7.1
Postgres: 9.5.15

Thanks&Regards,
PostgAnn.

On Wed, May 27, 2020 at 9:51 PM David G. Johnston <david.g.johnston@gmail.com> wrote:
On Wed, May 27, 2020 at 8:56 AM postgann2020 s <postgann2020@gmail.com> wrote:
Could someone please suggest the process to sync the data from PROD DB to the Staging environment with minimal manual intervention or automatically.

Read up on the general purpose "bash" scripting language, the PostgreSQL "pg_dump" and "pg_restore" commands, "ssh", and "cron".

"cron" and "bash" provide for the "automatically" requirement.

It is possible to assemble something functional with those tools.  Whether it will actually work in your specific situation is impossible to say since you provide zero information about your environment.

David J.

Re: suggestion the process to sync the data from PROD DB to Staging environment

From
"David G. Johnston"
Date:
On Wed, May 27, 2020 at 9:31 AM postgann2020 s <postgann2020@gmail.com> wrote:
Thanks, David,

Please find the environment details.

Environment:
PROD:
OS: RHEL 7.1
Postgres: 9.5.15

Staging:
OS: RHEL 7.1
Postgres: 9.5.15

Ok...not particularly helpful though I do see you are not keeping up with minor and major releases.

Maybe the terms metrics and goals would have been better...like how big is the database and what kind of network do the two machines exist in and how would they communicate data from one to the other...

David J.

Re: suggestion the process to sync the data from PROD DB to Staging environment

From
"David G. Johnston"
Date:
On Wed, May 27, 2020 at 9:31 AM postgann2020 s <postgann2020@gmail.com> wrote:
Thanks, David,

Please find the environment details.

Environment:
PROD:
OS: RHEL 7.1
Postgres: 9.5.15

Staging:
OS: RHEL 7.1
Postgres: 9.5.15

Ok...not particularly helpful though I do see you are not keeping up with minor and major releases.

Maybe the terms metrics and goals would have been better...like how big is the database and what kind of network do the two machines exist in and how would they communicate data from one to the other...

David J.

Re: suggestion the process to sync the data from PROD DB to Stagingenvironment

From
soumitra bhandary
Date:
If possible you can connect staging server as asynchronous slave node to one of the asynchronous node already in production 

Sent from my iPhone

On 27-May-2020, at 9:26 PM, postgann2020 s <postgann2020@gmail.com> wrote:


Hi Team,

Thanks for your support.

Could someone please suggest the process to sync the data from PROD DB to the Staging environment with minimal manual intervention or automatically.

Thanks & Regards,
Postgann.

Re: suggestion the process to sync the data from PROD DB to Stagingenvironment

From
soumitra bhandary
Date:
If possible you can connect staging server as asynchronous slave node to one of the asynchronous node already in production 

Sent from my iPhone

On 27-May-2020, at 9:26 PM, postgann2020 s <postgann2020@gmail.com> wrote:


Hi Team,

Thanks for your support.

Could someone please suggest the process to sync the data from PROD DB to the Staging environment with minimal manual intervention or automatically.

Thanks & Regards,
Postgann.