Thread: Share my experience and Thank you !

Share my experience and Thank you !

From
JingYuan Chen
Date:

Hello,

I want to share my experience about one of my projects and say thank you to the community.

Scenario :
My company's ERP system is SAP and rent a procurement system for bid. It's architecture bases on Webshpere5 and Oracle and IBM Java 1.4. The provider informed us that they decide to close this bid platform on 2016/03/31 about 3 month ago.

The good news is that they can give us the complete source code. But we don't have Webshpere and another Oracle License for this system. Fortunately, I found that there is a PostgreSQL wiki site providing useful information about tools and migration tips. After doing some analysis, I decide to use Jetty 9 and PostgreSQL 9.1 and Oracle Java 1.7 to replace them. Transferring data is another problem. I decide to use Pentaho Data Integration tool. It is an ETL tool. I can learn about the status of transferring until the job was done. It helps me to keep the consistency of data in Oracle and PostgreSQL.

After modifying many SQL commands to be suitable for PostgreSQL and setting  web.xml for Jetty, our procurement system can be active successfully without Webshpere and Oracle. However, its performance is poorly. I found that there are two problems to result in this situation. One is that JVM will crash accidentally. The other is that sometimes JDBC could not connect to PostgreSQL.

Fortunately, Jetty is flexible and Java's garbage collection log provides useful information. I can tune JVM with different parameters while initiating Jetty. The last problem is JDBC. It use DBCP 1.3 as default to connect database. According to our new architecture, I replace DBCP with PGConnectionPoolDataSource.

Now our system is running smoothly with this kind of architecture. I also use some PERL scripts to transfer data and JCO RFC to perform SAP's transaction.

Thank You All !


Regards,

Chingyuan

Re: Share my experience and Thank you !

From
Arthur Silva
Date:

Any specific reason for choosing this old version of postgres?

On May 13, 2016 8:46 AM, "JingYuan Chen" <phil.cyc@gmail.com> wrote:

Hello,

I want to share my experience about one of my projects and say thank you to the community.

Scenario :
My company's ERP system is SAP and rent a procurement system for bid. It's architecture bases on Webshpere5 and Oracle and IBM Java 1.4. The provider informed us that they decide to close this bid platform on 2016/03/31 about 3 month ago.

The good news is that they can give us the complete source code. But we don't have Webshpere and another Oracle License for this system. Fortunately, I found that there is a PostgreSQL wiki site providing useful information about tools and migration tips. After doing some analysis, I decide to use Jetty 9 and PostgreSQL 9.1 and Oracle Java 1.7 to replace them. Transferring data is another problem. I decide to use Pentaho Data Integration tool. It is an ETL tool. I can learn about the status of transferring until the job was done. It helps me to keep the consistency of data in Oracle and PostgreSQL.

After modifying many SQL commands to be suitable for PostgreSQL and setting  web.xml for Jetty, our procurement system can be active successfully without Webshpere and Oracle. However, its performance is poorly. I found that there are two problems to result in this situation. One is that JVM will crash accidentally. The other is that sometimes JDBC could not connect to PostgreSQL.

Fortunately, Jetty is flexible and Java's garbage collection log provides useful information. I can tune JVM with different parameters while initiating Jetty. The last problem is JDBC. It use DBCP 1.3 as default to connect database. According to our new architecture, I replace DBCP with PGConnectionPoolDataSource.

Now our system is running smoothly with this kind of architecture. I also use some PERL scripts to transfer data and JCO RFC to perform SAP's transaction.

Thank You All !


Regards,

Chingyuan

Re: Share my experience and Thank you !

From
JingYuan Chen
Date:
I use Debian Wheezy and PostgreSQL 9.1 is the default package.

On Fri, May 13, 2016 at 3:13 PM, JingYuan Chen <phil.cyc@gmail.com> wrote:
I use Debian Wheezy and PostgreSQL 9.1 is the default package.

On Fri, May 13, 2016 at 3:06 PM, Arthur Silva <arthurprs@gmail.com> wrote:

Any specific reason for choosing this old version of postgres?

On May 13, 2016 8:46 AM, "JingYuan Chen" <phil.cyc@gmail.com> wrote:

Hello,

I want to share my experience about one of my projects and say thank you to the community.

Scenario :
My company's ERP system is SAP and rent a procurement system for bid. It's architecture bases on Webshpere5 and Oracle and IBM Java 1.4. The provider informed us that they decide to close this bid platform on 2016/03/31 about 3 month ago.

The good news is that they can give us the complete source code. But we don't have Webshpere and another Oracle License for this system. Fortunately, I found that there is a PostgreSQL wiki site providing useful information about tools and migration tips. After doing some analysis, I decide to use Jetty 9 and PostgreSQL 9.1 and Oracle Java 1.7 to replace them. Transferring data is another problem. I decide to use Pentaho Data Integration tool. It is an ETL tool. I can learn about the status of transferring until the job was done. It helps me to keep the consistency of data in Oracle and PostgreSQL.

After modifying many SQL commands to be suitable for PostgreSQL and setting  web.xml for Jetty, our procurement system can be active successfully without Webshpere and Oracle. However, its performance is poorly. I found that there are two problems to result in this situation. One is that JVM will crash accidentally. The other is that sometimes JDBC could not connect to PostgreSQL.

Fortunately, Jetty is flexible and Java's garbage collection log provides useful information. I can tune JVM with different parameters while initiating Jetty. The last problem is JDBC. It use DBCP 1.3 as default to connect database. According to our new architecture, I replace DBCP with PGConnectionPoolDataSource.

Now our system is running smoothly with this kind of architecture. I also use some PERL scripts to transfer data and JCO RFC to perform SAP's transaction.

Thank You All !


Regards,

Chingyuan



Re: Share my experience and Thank you !

From
Pierre Chevalier
Date:
Hello,

I think that you can safely add the PostgreSQL repository to your system, so that you can get the latest packages for your Debian.

See there how to do it:
https://wiki.postgresql.org/wiki/Apt

Regards,
Pierre


Le 13 mai 2016 09:14:28 GMT+02:00, JingYuan Chen <phil.cyc@gmail.com> a écrit :
I use Debian Wheezy and PostgreSQL 9.1 is the default package.

On Fri, May 13, 2016 at 3:13 PM, JingYuan Chen <phil.cyc@gmail.com> wrote:
I use Debian Wheezy and PostgreSQL 9.1 is the default package.

On Fri, May 13, 2016 at 3:06 PM, Arthur Silva <arthurprs@gmail.com> wrote:

Any specific reason for choosing this old version of postgres?

On May 13, 2016 8:46 AM, "JingYuan Chen" <phil.cyc@gmail.com> wrote:

Hello,

I want to share my experience about one of my projects and say thank you to the community.

Scenario :
My company's ERP system is SAP and rent a procurement system for bid. It's architecture bases on Webshpere5 and Oracle and IBM Java 1.4. The provider informed us that they decide to close this bid platform on 2016/03/31 about 3 month ago.

The good news is that they can give us the complete source code. But we don't have Webshpere and another Oracle License for this system. Fortunately, I found that there is a PostgreSQL wiki site providing useful information about tools and migration tips. After doing some analysis, I decide to use Jetty 9 and PostgreSQL 9.1 and Oracle Java 1.7 to replace them. Transferring data is another problem. I decide to use Pentaho Data Integration tool. It is an ETL tool. I can learn about the status of transferring until the job was done. It helps me to keep the consistency of data in Oracle and PostgreSQL.

After modifying many SQL commands to be suitable for PostgreSQL and setting  web.xml for Jetty, our procurement system can be active successfully without Webshpere and Oracle. However, its performance is poorly. I found that there are two problems to result in this situation. One is that JVM will crash accidentally. The other is that sometimes JDBC could not connect to PostgreSQL.

Fortunately, Jetty is flexible and Java's garbage collection log provides useful information. I can tune JVM with different parameters while initiating Jetty. The last problem is JDBC. It use DBCP 1.3 as default to connect database. According to our new architecture, I replace DBCP with PGConnectionPoolDataSource.

Now our system is running smoothly with this kind of architecture. I also use some PERL scripts to transfer data and JCO RFC to perform SAP's transaction.

Thank You All !


Regards,

Chingyuan




--
Envoyé de mon appareil Android avec K-9 Mail. Veuillez excuser ma brièveté.

Re: Share my experience and Thank you !

From
Allan Harvey
Date:

Chingyuan,

>I also use some PERL scripts to transfer data and JCO RFC to perform SAP's transaction.

FYI. We also "mate" Postgres with SAP.

Our transactions are exposed on the SAP system via a SOAP interface ( some "switches" your SAP people need to throw ).

Tested and developed with bash scripts and cURL the executable to get the headers etc correct, then our own C executable using cURL as a library, then wrapped Postgres C function call around our C code to have Postgres function.

SAP transactions are fully integrated into the "SQL" of the system.

Allan


Arrium Limited and associated entities are currently in Voluntary Administration. A list of all associated entities in Voluntary Administration may be obtained from: "http://www.arrium.com/~/media/Arrium Mining and Materials/Files/Corporate documents/Arrium Administration_Groups List.pdf". The material contained in this email is confidential and may be subject to legal privilege and/or copyright. Please do not re-transmit, distribute, copy or commercialise any of the material in this message unless you are authorised to do so. If you are not the intended recipient, use, disclosure or copying of this information is prohibited. If you have received this document in error, please advise the sender and delete the document. None of Arrium Limited, its related bodies corporate or the sender accept responsibility for any viruses contained in this email or any attachments. All and any rights as to confidentiality, legal professional privilege and copyright are expressly reserved.