Re: PostgreSQL Volume Question - Mailing list pgsql-general

From Steven Lembark
Subject Re: PostgreSQL Volume Question
Date
Msg-id 20180615082025.3764e4ba@wrkhors.com
Whole thread Raw
In response to PostgreSQL Volume Question  (Data Ace <dataace9@gmail.com>)
List pgsql-general
On Thu, 14 Jun 2018 14:33:54 -0700
Data Ace <dataace9@gmail.com> wrote:

> Hi, I'm new to the community.
> 
> Recently, I've been involved in a project that develops a social
> network data analysis service (and my client's DBMS is based on
> PostgreSQL). I need to gather huge volume of unstructured raw data
> for this project, and the problem is that with PostgreSQL, it would
> be so dfficult to handle this kind of data. Are there any PG
> extension modules or methods that are recommended for my project?

"huge" by modern standards is Petabytes, which might require some
specialized database service for a data lake.

Short of that look up the "jsonb" data type in Postgres.
The nice thing about using PG for this is that you can keep enough
identifying and metadata in a relational system where it is easier
to query and the documents in jsonb where they are still accessable.


-- 
Steven Lembark                                       1505 National Ave
Workhorse Computing                                 Rockford, IL 61103
lembark@wrkhors.com                                    +1 888 359 3508


pgsql-general by date:

Previous
From: Laurenz Albe
Date:
Subject: Re: About "Cost-based Vacuum Delay"
Next
From: Vick Khera
Date:
Subject: Re: Append only replication over intermittent links (with local only delete?)