Re: Real-life range datasets - Mailing list pgsql-hackers

From Stefan Keller
Subject Re: Real-life range datasets
Date
Msg-id CAFcOn2-Bq-tzAfdFVn4wt8mPEcLNHNHebGQO3CRqtUOjHFGCrg@mail.gmail.com
Whole thread Raw
In response to Re: Real-life range datasets  (Alexander Korotkov <aekorotkov@gmail.com>)
List pgsql-hackers
Hi

I'm proposing OpenStreetMap which is of variable size up to >250 GB
XML Data for whole world.
It's downloadable from CloudMade.com or Geofabrik.de and can be
imported into PostgreSQL using osm2pgsql.
It's a key/value schema literally of the real world. I'm using hstore
option of osm2pgsql and hstore index is based on GIST.

I'm running a database instance called "PostGIS Terminal" which is a
daily extract of Switzerland:
http://labs.geometa.info/postgisterminal/?xapi=node%5Bname%3DHochschule%20Rapperswil%5D

This is a typical query which extracts 'real' highways (being of
geometry linestring, aka line/way) with a speed limit >=  100 km/h:

SELECT ST_AsText(way) geom
FROM osm_line
WHERE tags @> '"highway"=>"motorway"'
AND coalesce(substring((tags->'maxspeed') FROM E'[0-9]+')::int,0) >= 100

Yours, Stefan

2011/12/23 Alexander Korotkov <aekorotkov@gmail.com>:
> Hello,
>
> On Thu, Dec 22, 2011 at 12:51 PM, Benedikt Grundmann
> <bgrundmann@janestreet.com> wrote:
>>
>> I should be able to give you a table with the same characteristics as
>> the instruments table but bogus data by replacing all entries in the
>> table with random strings of the same length or something like that.
>> I can probably take a little bit of time during this or the next week
>> to generate such "fake" real world data ;-)   Is there an ftp site to
>> upload the gzipped pg_dump file to?
>
>
> Thank you very much for your response! I'm going to send you accessories for
> upload soon.
>
> -----
> With best regards,
> Alexander Korotkov.


pgsql-hackers by date:

Previous
From: Robert Haas
Date:
Subject: checkpoint writeback via sync_file_range
Next
From: Tom Lane
Date:
Subject: Re: Sending notifications from the master to the standby