Re:Using PostgreSQL for Machine Learning Data Pipelines - Mailing list pgsql-general

From chris
Subject Re:Using PostgreSQL for Machine Learning Data Pipelines
Date
Msg-id 59caef3f.ab49.16ddc7411b2.Coremail.yuanzefuwater@126.com
Whole thread Raw
In response to Using PostgreSQL for Machine Learning Data Pipelines  (Pankaj Jangid <pankaj.jangid@gmail.com>)
List pgsql-general
font{ line-height: 1.6; } ul,ol{ padding-left: 20px; list-style-position: inside; }
Hi there,

There is a project named Apache MADlib, may help you.


Thanks,

On 10/18/2019 02:04Pankaj Jangid<pankaj.jangid@gmail.com> wrote:
Hi,

I am working on a machine-learning project. Because of the available
study material in the ML area, the team is inclined towards Apache
Kafka, Apache Spark for data-pipelines and analytics.

Our requirement is to store huge amounts of continuously increasing data
that cannot fit into a single machine. The algorithms require data in
batches so it is not necessary to keep full data ready for
consumption. Using Kafka, the data can be distributed and fetched in
varying batch sizes as and when required.

I am more comfortable with PostgreSQL. And wanted to know more about
case-studies where PostgreSQL is deployed for ML use. Any pointers
referring to study material will be helpful. Please share in this
thread.

--
Thanks & Regards,
Pankaj Jangid

pgsql-general by date:

Previous
From: Ron
Date:
Subject: Re: drop database
Next
From: M Tarkeshwar Rao
Date:
Subject: Can you please tell us how set this prefetch attribute in followinglines.