Thread: Mirroring PostgreSQL related content
After seeing reports of some very interesting sounding articles that were hosted elsewhere are now 404... Do we make any efforts to mirror the content of PostgreSQL related stories or articles? Presumably this would require contacting authors for permission, but perhaps we can find some enthusiastic newbies to do that... -- Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com Pervasive Software http://pervasive.com work: 512-231-6117 vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461
Seems that your call arrived my mobile phone :):) Instructions on how to proceed apreciated > After seeing reports of some very interesting sounding articles that > were hosted elsewhere are now 404... I was about to contact the authors requesting new url's or the articles themselves, in order to host them directly @ postgresql.org g.- (enthusiastic newbie) On 4/21/06, Jim C. Nasby <jnasby@pervasive.com> wrote: > After seeing reports of some very interesting sounding articles that > were hosted elsewhere are now 404... > > Do we make any efforts to mirror the content of PostgreSQL related > stories or articles? Presumably this would require contacting authors > for permission, but perhaps we can find some enthusiastic newbies to do > that... > -- > Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com > Pervasive Software http://pervasive.com work: 512-231-6117 > vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461 > > ---------------------------(end of broadcast)--------------------------- > TIP 4: Have you searched our list archives? > > http://archives.postgresql.org > -- Guido Barosio ----------------------- http://www.globant.com guido.barosio@globant.com
Jim C. Nasby wrote:
> After seeing reports of some very interesting sounding articles that
> were hosted elsewhere are now 404...
>
> Do we make any efforts to mirror the content of PostgreSQL related
> stories or articles? Presumably this would require contacting authors
> for permission, but perhaps we can find some enthusiastic newbies to do
> that...
It is a heck of a lot more then that... most authors don't have rights
to allow postgresql.org to do that.
Joshua D. Drake
--
=== The PostgreSQL Company: Command Prompt, Inc. ===
Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
Providing the most comprehensive PostgreSQL solutions since 1997
http://www.commandprompt.com/
From: Michael Dean [mailto:mdean@sourceview.com] > Jim C. Nasby wrote: > > After seeing reports of some very interesting sounding articles that > > were hosted elsewhere are now 404... > > > > Do we make any efforts to mirror the content of PostgreSQL related > > stories or articles? Presumably this would require > contacting authors > > for permission, but perhaps we can find some enthusiastic > newbies to do > > that... > > > As a marketing type guy who has eschewed his graduate statistical & > demographic training, I would be glad to work on anything > that smacks at > improving the overall image of postgresql in the world. A > compendium of > articles documenting "everything" would be one decent suggestion, > especially since many of them are written under the creative > commons. A > second suggestion is compiling a list of user applications > that not only > work with postgresql, but is their apparent favorite. For instance, > bitweaver.org, where installation is trivial, as opposed to > drupal.org, > where postgresql appears to work, but installation is not only > non-trivial but fraught with political issues. Let me know the > appropriate mechanism for starting this. Michael Well, the first appropriate mechanism would be to include the list in your replies. ;) I suspect gathering available data would be a good start. I don't know that we'd want to prominently publish stuff in a rawformat, but at least then we'd know what we're working with. I think it'd be very cool to have a site that documents OSSthat supports PostgreSQL. Anyone else have other ideas/suggestions? You might want to take a look at the directory we started at Pervasive (http://www.pervasivepostgres.com/postgresql/pgd/,any additions most welcome!). Also, if you (or anyone else) is interestedin writing articles, whitepapers, etc, etc, we'll both provide assistance and money for your effort: http://www.pervasivepostgres.com/postgresql/partners_in_publishing.asp
On Fri, 21 Apr 2006, Joshua D. Drake wrote: > Jim C. Nasby wrote: >> After seeing reports of some very interesting sounding articles that >> were hosted elsewhere are now 404... >> >> Do we make any efforts to mirror the content of PostgreSQL related >> stories or articles? Presumably this would require contacting authors >> for permission, but perhaps we can find some enthusiastic newbies to do >> that... > > > It is a heck of a lot more then that... most authors don't have rights to > allow postgresql.org to do that. Are there any good 'link checkers' that we could run on the site, say on a daily basis, that would check for failed links? I normally use the web based ones, but for this we'd need something good to run from the command line ... ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664
On Friday 21 April 2006 11:59, Marc G. Fournier wrote: > On Fri, 21 Apr 2006, Joshua D. Drake wrote: > > Jim C. Nasby wrote: > >> After seeing reports of some very interesting sounding articles that > >> were hosted elsewhere are now 404... > >> > >> Do we make any efforts to mirror the content of PostgreSQL related > >> stories or articles? Presumably this would require contacting authors > >> for permission, but perhaps we can find some enthusiastic newbies to do > >> that... > > > > It is a heck of a lot more then that... most authors don't have rights to > > allow postgresql.org to do that. > > Are there any good 'link checkers' that we could run on the site, say on a > daily basis, that would check for failed links? I normally use the web > based ones, but for this we'd need something good to run from the command > line ... wget, lynx, fetch......... > > ---- > Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) > Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664 > > ---------------------------(end of broadcast)--------------------------- > TIP 3: Have you checked our extensive FAQ? > > http://www.postgresql.org/docs/faq -- Darcy Buskermolen Wavefire Technologies Corp. http://www.wavefire.com ph: 250.717.0200 fx: 250.763.1759
On Fri, 21 Apr 2006, Darcy Buskermolen wrote: > On Friday 21 April 2006 11:59, Marc G. Fournier wrote: >> On Fri, 21 Apr 2006, Joshua D. Drake wrote: >>> Jim C. Nasby wrote: >>>> After seeing reports of some very interesting sounding articles that >>>> were hosted elsewhere are now 404... >>>> >>>> Do we make any efforts to mirror the content of PostgreSQL related >>>> stories or articles? Presumably this would require contacting authors >>>> for permission, but perhaps we can find some enthusiastic newbies to do >>>> that... >>> >>> It is a heck of a lot more then that... most authors don't have rights to >>> allow postgresql.org to do that. >> >> Are there any good 'link checkers' that we could run on the site, say on a >> daily basis, that would check for failed links? I normally use the web >> based ones, but for this we'd need something good to run from the command >> line ... > > wget, lynx, fetch......... I didn't know they had an 'auto check' mode taht could be run from cron ... can you let me know what args should be used to traverse the www site to report just those links that are dead? then i can get this into cron ... thanks ... ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664
On Fri, Apr 21, 2006 at 06:07:48PM +0000, Guido Barosio wrote: > > After seeing reports of some very interesting sounding articles that > > were hosted elsewhere are now 404... > > I was about to contact the authors requesting new url's or the > articles themselves, in order to host them directly @ postgresql.org Sounds like a plan, unless someone else has already contacted them. Please cc me (use jim@nasby.net). -- Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com Pervasive Software http://pervasive.com work: 512-231-6117 vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461
On Friday 21 April 2006 12:21, Marc G. Fournier wrote: > On Fri, 21 Apr 2006, Darcy Buskermolen wrote: > > On Friday 21 April 2006 11:59, Marc G. Fournier wrote: > >> On Fri, 21 Apr 2006, Joshua D. Drake wrote: > >>> Jim C. Nasby wrote: > >>>> After seeing reports of some very interesting sounding articles that > >>>> were hosted elsewhere are now 404... > >>>> > >>>> Do we make any efforts to mirror the content of PostgreSQL related > >>>> stories or articles? Presumably this would require contacting authors > >>>> for permission, but perhaps we can find some enthusiastic newbies to > >>>> do that... > >>> > >>> It is a heck of a lot more then that... most authors don't have rights > >>> to allow postgresql.org to do that. > >> > >> Are there any good 'link checkers' that we could run on the site, say on > >> a daily basis, that would check for failed links? I normally use the > >> web based ones, but for this we'd need something good to run from the > >> command line ... > > > > wget, lynx, fetch......... > > I didn't know they had an 'auto check' mode taht could be run from cron > ... can you let me know what args should be used to traverse the www site > to report just those links that are dead? then i can get this into cron > ... Sorry I misunderstood how you were trying to do it. I thought we had a list of these URL's already that we just needed to stat in which case fetch -1 url 2>/dev/null and checking for a non 0 exitstatus would sufice. If you are wanting to crawl the postgresql.org site or a portion of it looking for external links that are not valid, perhaps linkchecker (/usr/ports/www/linkchecker) will do what is intended. > > thanks ... > > ---- > Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) > Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664 > > ---------------------------(end of broadcast)--------------------------- > TIP 4: Have you searched our list archives? > > http://archives.postgresql.org -- Darcy Buskermolen Wavefire Technologies Corp. http://www.wavefire.com ph: 250.717.0200 fx: 250.763.1759
Speaking for my site, www.varlena.com/GeneralBits, only, I prefer to have a prominent (not deep) link on postgresql. I do not want my content mirrored by I want the link to be useful. Although I have been slacking in writing new articles, there is a 3 year repository of articles on my site. The point of these articles was to help postgres users--it is my return to the community. As it stands, most people get to my articles through google and not the postgresql.org web site. This is just one point of view from a heavy content provider of postgresql articles. People who have a few articles may well want them to be hosted on postgresql.org. In the past we have been lax about organizing and maintaining individual informational articles. Techdocs (ack!) It may be possible to push this over onto planetpostgres as long as we give ample visibility to its link. And people know where to post articles or links to them. --elein On Fri, Apr 21, 2006 at 12:55:10PM -0500, Jim C. Nasby wrote: > After seeing reports of some very interesting sounding articles that > were hosted elsewhere are now 404... > > Do we make any efforts to mirror the content of PostgreSQL related > stories or articles? Presumably this would require contacting authors > for permission, but perhaps we can find some enthusiastic newbies to do > that... > -- > Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com > Pervasive Software http://pervasive.com work: 512-231-6117 > vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461 > > ---------------------------(end of broadcast)--------------------------- > TIP 4: Have you searched our list archives? > > http://archives.postgresql.org >
Elein, I agree and I strongly believe it was and remains the idea. (to let the contributor inform and authorize about a certain document, keeping the hits/credits on the contributor side). What about creating a form to save the authors, urls and a short description, letting the comunity create their own entries, saving information in a /the database and regularly cronchecking these objects to avoid 404's ? This should be managed and authorized by someone tho. Wondering, moderators? I can do that, php / perl based. (form php, cron job running a perl script, using lwp or alike). g.- ---- Talking bout link checkers, I used the w3 web based one, which created a good report about the situation. Anyway, what I did was to confirm that these are broken links, and not syntax mistakes, wrong urls. That report is attached as a .zip g.- On 4/21/06, elein <elein@varlena.com> wrote: > Speaking for my site, www.varlena.com/GeneralBits, only, > I prefer to have a prominent (not deep) link on postgresql. > I do not want my content mirrored by I want the link to be useful. > > Although I have been slacking in writing new articles, there is a > 3 year repository of articles on my site. The point of these > articles was to help postgres users--it is my return to the community. > As it stands, most people get to my articles through google and > not the postgresql.org web site. > > This is just one point of view from a heavy content provider of > postgresql articles. People who have a few articles may well > want them to be hosted on postgresql.org. > > In the past we have been lax about organizing and maintaining > individual informational articles. Techdocs (ack!) It may be possible > to push this over onto planetpostgres as long as we give ample > visibility to its link. And people know where to post articles or > links to them. > > --elein > > > On Fri, Apr 21, 2006 at 12:55:10PM -0500, Jim C. Nasby wrote: > > After seeing reports of some very interesting sounding articles that > > were hosted elsewhere are now 404... > > > > Do we make any efforts to mirror the content of PostgreSQL related > > stories or articles? Presumably this would require contacting authors > > for permission, but perhaps we can find some enthusiastic newbies to do > > that... > > -- > > Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com > > Pervasive Software http://pervasive.com work: 512-231-6117 > > vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461 > > > > ---------------------------(end of broadcast)--------------------------- > > TIP 4: Have you searched our list archives? > > > > http://archives.postgresql.org > > > > ---------------------------(end of broadcast)--------------------------- > TIP 2: Don't 'kill -9' the postmaster > -- Guido Barosio ----------------------- http://www.globant.com guido.barosio@globant.com
the attachment :$ On 4/21/06, Guido Barosio <gbarosio@gmail.com> wrote: > Elein, > > I agree and I strongly believe it was and remains the idea. (to let > the contributor inform and authorize about a certain document, keeping > the hits/credits on the contributor side). > > What about creating a form to save the authors, urls and a short > description, letting the comunity create their own entries, saving > information in a /the database and regularly cronchecking these > objects to avoid 404's ? This should be managed and authorized by > someone tho. Wondering, moderators? > > I can do that, php / perl based. (form php, cron job running a perl > script, using lwp or alike). > > g.- > > > > ---- > > Talking bout link checkers, I used the w3 web based one, which created > a good report about the situation. Anyway, what I did was to confirm > that these are broken links, and not syntax mistakes, wrong urls. That > report is attached as a .zip > > g.- > > > On 4/21/06, elein <elein@varlena.com> wrote: > > Speaking for my site, www.varlena.com/GeneralBits, only, > > I prefer to have a prominent (not deep) link on postgresql. > > I do not want my content mirrored by I want the link to be useful. > > > > Although I have been slacking in writing new articles, there is a > > 3 year repository of articles on my site. The point of these > > articles was to help postgres users--it is my return to the community. > > As it stands, most people get to my articles through google and > > not the postgresql.org web site. > > > > This is just one point of view from a heavy content provider of > > postgresql articles. People who have a few articles may well > > want them to be hosted on postgresql.org. > > > > In the past we have been lax about organizing and maintaining > > individual informational articles. Techdocs (ack!) It may be possible > > to push this over onto planetpostgres as long as we give ample > > visibility to its link. And people know where to post articles or > > links to them. > > > > --elein > > > > > > On Fri, Apr 21, 2006 at 12:55:10PM -0500, Jim C. Nasby wrote: > > > After seeing reports of some very interesting sounding articles that > > > were hosted elsewhere are now 404... > > > > > > Do we make any efforts to mirror the content of PostgreSQL related > > > stories or articles? Presumably this would require contacting authors > > > for permission, but perhaps we can find some enthusiastic newbies to do > > > that... > > > -- > > > Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com > > > Pervasive Software http://pervasive.com work: 512-231-6117 > > > vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461 > > > > > > ---------------------------(end of broadcast)--------------------------- > > > TIP 4: Have you searched our list archives? > > > > > > http://archives.postgresql.org > > > > > > > ---------------------------(end of broadcast)--------------------------- > > TIP 2: Don't 'kill -9' the postmaster > > > > > -- > Guido Barosio > ----------------------- > http://www.globant.com > guido.barosio@globant.com > -- Guido Barosio ----------------------- http://www.globant.com guido.barosio@globant.com
Attachment
Yeah, just to clarify we should only mirror content in the event that the original site goes down. We should absolutely send traffic to the people who are working hard to create the content in the first place, I just hate 'losing knowledge' when someone loses interest and their site goes *poof*. On Fri, Apr 21, 2006 at 01:06:38PM -0700, elein wrote: > Speaking for my site, www.varlena.com/GeneralBits, only, > I prefer to have a prominent (not deep) link on postgresql. > I do not want my content mirrored by I want the link to be useful. > > Although I have been slacking in writing new articles, there is a > 3 year repository of articles on my site. The point of these > articles was to help postgres users--it is my return to the community. > As it stands, most people get to my articles through google and > not the postgresql.org web site. > > This is just one point of view from a heavy content provider of > postgresql articles. People who have a few articles may well > want them to be hosted on postgresql.org. > > In the past we have been lax about organizing and maintaining > individual informational articles. Techdocs (ack!) It may be possible > to push this over onto planetpostgres as long as we give ample > visibility to its link. And people know where to post articles or > links to them. > > --elein > > > On Fri, Apr 21, 2006 at 12:55:10PM -0500, Jim C. Nasby wrote: > > After seeing reports of some very interesting sounding articles that > > were hosted elsewhere are now 404... > > > > Do we make any efforts to mirror the content of PostgreSQL related > > stories or articles? Presumably this would require contacting authors > > for permission, but perhaps we can find some enthusiastic newbies to do > > that... > > -- > > Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com > > Pervasive Software http://pervasive.com work: 512-231-6117 > > vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461 > > > > ---------------------------(end of broadcast)--------------------------- > > TIP 4: Have you searched our list archives? > > > > http://archives.postgresql.org > > > > ---------------------------(end of broadcast)--------------------------- > TIP 2: Don't 'kill -9' the postmaster > -- Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com Pervasive Software http://pervasive.com work: 512-231-6117 vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461
On Fri, Apr 21, 2006 at 09:49:38PM +0100, Guido Barosio wrote: > Elein, > > I agree and I strongly believe it was and remains the idea. (to let > the contributor inform and authorize about a certain document, keeping > the hits/credits on the contributor side). > > What about creating a form to save the authors, urls and a short > description, letting the comunity create their own entries, saving > information in a /the database and regularly cronchecking these > objects to avoid 404's ? This should be managed and authorized by > someone tho. Wondering, moderators? This can be done on planetpostgres which is up and running well. --elein > > I can do that, php / perl based. (form php, cron job running a perl > script, using lwp or alike). > > g.- > > > > ---- > > Talking bout link checkers, I used the w3 web based one, which created > a good report about the situation. Anyway, what I did was to confirm > that these are broken links, and not syntax mistakes, wrong urls. That > report is attached as a .zip > > g.- > > > On 4/21/06, elein <elein@varlena.com> wrote: > > Speaking for my site, www.varlena.com/GeneralBits, only, > > I prefer to have a prominent (not deep) link on postgresql. > > I do not want my content mirrored by I want the link to be useful. > > > > Although I have been slacking in writing new articles, there is a > > 3 year repository of articles on my site. The point of these > > articles was to help postgres users--it is my return to the community. > > As it stands, most people get to my articles through google and > > not the postgresql.org web site. > > > > This is just one point of view from a heavy content provider of > > postgresql articles. People who have a few articles may well > > want them to be hosted on postgresql.org. > > > > In the past we have been lax about organizing and maintaining > > individual informational articles. Techdocs (ack!) It may be possible > > to push this over onto planetpostgres as long as we give ample > > visibility to its link. And people know where to post articles or > > links to them. > > > > --elein > > > > > > On Fri, Apr 21, 2006 at 12:55:10PM -0500, Jim C. Nasby wrote: > > > After seeing reports of some very interesting sounding articles that > > > were hosted elsewhere are now 404... > > > > > > Do we make any efforts to mirror the content of PostgreSQL related > > > stories or articles? Presumably this would require contacting authors > > > for permission, but perhaps we can find some enthusiastic newbies to do > > > that... > > > -- > > > Jim C. Nasby, Sr. Engineering Consultant jnasby@pervasive.com > > > Pervasive Software http://pervasive.com work: 512-231-6117 > > > vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461 > > > > > > ---------------------------(end of broadcast)--------------------------- > > > TIP 4: Have you searched our list archives? > > > > > > http://archives.postgresql.org > > > > > > > ---------------------------(end of broadcast)--------------------------- > > TIP 2: Don't 'kill -9' the postmaster > > > > > -- > Guido Barosio > ----------------------- > http://www.globant.com > guido.barosio@globant.com > > ---------------------------(end of broadcast)--------------------------- > TIP 2: Don't 'kill -9' the postmaster >
On Friday 21 April 2006 16:49, Guido Barosio wrote:
> Elein,
>
> I agree and I strongly believe it was and remains the idea. (to let
> the contributor inform and authorize about a certain document, keeping
> the hits/credits on the contributor side).
>
> What about creating a form to save the authors, urls and a short
> description, letting the comunity create their own entries, saving
> information in a /the database and regularly cronchecking these
> objects to avoid 404's ? This should be managed and authorized by
> someone tho. Wondering, moderators?
>
> I can do that, php / perl based. (form php, cron job running a perl
> script, using lwp or alike).
>
Doesn't the new techdocs interface already support this?
--
Robert Treat
Build A Brighter Lamp :: Linux Apache {middleware} PostgreSQL
On Fri, Apr 21, 2006 at 15:51:35 -0500, "Jim C. Nasby" <jnasby@pervasive.com> wrote: > Yeah, just to clarify we should only mirror content in the event that > the original site goes down. We should absolutely send traffic to the > people who are working hard to create the content in the first place, I > just hate 'losing knowledge' when someone loses interest and their site > goes *poof*. The Wayback Machine might help get back some of the articles that have already disappeared.
On 23/4/2006 4:05, "Bruno Wolff III" <bruno@wolff.to> wrote: > On Fri, Apr 21, 2006 at 15:51:35 -0500, > "Jim C. Nasby" <jnasby@pervasive.com> wrote: >> Yeah, just to clarify we should only mirror content in the event that >> the original site goes down. We should absolutely send traffic to the >> people who are working hard to create the content in the first place, I >> just hate 'losing knowledge' when someone loses interest and their site >> goes *poof*. > > The Wayback Machine might help get back some of the articles that have > already disappeared. > > ---------------------------(end of broadcast)--------------------------- > TIP 2: Don't 'kill -9' the postmaster > Maybe someone/a few people can mirror these articles at home and in the event the article gets removed we can upload the mirrored copy. Has anyone thought of searching for the missing article pages in google and getting the cached pages from there?