Thread: Feeds Integration

Feeds Integration

From
David Costa
Date:
Hello All,
I plan to move forward with a gborg and events feed. This as a nice
addition of the existing one (beta version on dotgeek.org).

Problem, for the beta news, I had to do a separate scripts to fetch the
news because I don't have them in a database, then add these locally
and fetch them
for the XML feed.

(how ?

$handle = fopen("http://postgresql.dotgeek.org/", "r");
$file_handler = "";
while (!feof($handle))
    $file_handler .= fgets($handle, 4096);
if (!ereg("<!-- News -->(.+)<!-- Events -->", $file_handler, $news))
    print "error";
$news = str_replace("<tr>\n<td bgcolor=\"#6884A4\">\n<a
name=\"news\">\n<font size=\"+2\"
color=\"#FFFFFF\">News</font></a>\n</td>\n</tr>", "", $news[1]);
$news = ereg_replace("(\n){3,}", "\n", $news);
/*print $news;
print "\n\n\n-------------------------------------------\n\n\n\n";*/
$pattern = "<tr><td><a href=\"(news/[0-9]+\.html)\"
style=\"font-weight: bold; font-size: medium; color: #020169\">";
$pattern .= "([^(</)]+)</a><br>\n<i>Posted on ([0-9]+-[0-9]+-[0-9]+) by
<font color=\"#020169\">([^(</)]+)</font>";
$pattern .= "</i><br>\n([^(</)]+)</td></tr>\n";
$rinfo = array();
$i = 0;
etc etc )

Now, it would be useless to do the same exercise considered that you do
have them in a database. So if I know the db schema, I could possibly
have it to work locally
or upload on my space on your server (thanks Marc !!) something ready
to go.

Ideally (this would work best for me) can someone move on my server
space with you the tables Latest News (gborg) and (events) ? With these
I can do a full test on my box and
upload something ready to go.

For the website integration, I can handle that too but..can I work on
Alexey's beta ? This would allow me to add the feeds links without
having to download
the full site with a CVS checkout and upload something which will have
in any case be modified for Alexey's  new layout.

Of course if you want to implement the news feeds sooner, I could do a
fresh checkout, upload, add the changes and leave it to you.

Thanks again for your time and attention ;)
Cheers
David


Re: Feeds Integration

From
Josh Berkus
Date:
David,

> I plan to move forward with a gborg and events feed. This as a nice
> addition of the existing one (beta version on dotgeek.org).

If it makes any difference, we are currently discussing the possibility of a
gradual migration from GBorg to GForge.   More discussion to come on -hackers
and this list later.

Second, we have a reason to want to *import* and RSS feed.
Opensourcexperts.com is ready to do PostgreSQL job listings, and they will
publish them to us via RSS.   Can you help with this once you're done with
our RSS export?

--
-Josh Berkus
 Aglio Database Solutions
 San Francisco


Re: Feeds Integration

From
Chris Ryan
Date:
David,

    For GBorg specifically the news items are stored on the database. I
forget how it was setup for the main website to access the database
however I can provide a query that would give you the information you
are looking for so you can write a program. Having an RSS feed on GBorg
would be great too. If you have something I can you to generate the
files that would be great.

    Here is a query for getting the 10 latest news items for showing on
the main page of GBorg.

SELECT project_name,
       headline,
       body,
       submit_date   -- date not datetime :(
  FROM project_news, project
 WHERE (project_news.project_id=project.project_id)
   AND (project_news.active=true)
   AND (project_news.on_homepage=true)
 ORDER BY submit_date DESC
 LIMIT 10;


    I will leave issues of access to the GBorg database up to Marc.

Chris Ryan


--- David Costa <geeks@dotgeek.org> wrote:
> Hello All,
> I plan to move forward with a gborg and events feed. This as a nice
> addition of the existing one (beta version on dotgeek.org).
>
> Problem, for the beta news, I had to do a separate scripts to fetch
> the
> news because I don't have them in a database, then add these locally
> and fetch them
> for the XML feed.
>
> (how ?
>
> $handle = fopen("http://postgresql.dotgeek.org/", "r");
> $file_handler = "";
> while (!feof($handle))
>     $file_handler .= fgets($handle, 4096);
> if (!ereg("<!-- News -->(.+)<!-- Events -->", $file_handler, $news))
>     print "error";
> $news = str_replace("<tr>\n<td bgcolor=\"#6884A4\">\n<a
> name=\"news\">\n<font size=\"+2\"
> color=\"#FFFFFF\">News</font></a>\n</td>\n</tr>", "", $news[1]);
> $news = ereg_replace("(\n){3,}", "\n", $news);
> /*print $news;
> print "\n\n\n-------------------------------------------\n\n\n\n";*/
> $pattern = "<tr><td><a href=\"(news/[0-9]+\.html)\"
> style=\"font-weight: bold; font-size: medium; color: #020169\">";
> $pattern .= "([^(</)]+)</a><br>\n<i>Posted on ([0-9]+-[0-9]+-[0-9]+)
> by
> <font color=\"#020169\">([^(</)]+)</font>";
> $pattern .= "</i><br>\n([^(</)]+)</td></tr>\n";
> $rinfo = array();
> $i = 0;
> etc etc )
>
> Now, it would be useless to do the same exercise considered that you
> do
> have them in a database. So if I know the db schema, I could possibly
>
> have it to work locally
> or upload on my space on your server (thanks Marc !!) something ready
>
> to go.
>
> Ideally (this would work best for me) can someone move on my server
> space with you the tables Latest News (gborg) and (events) ? With
> these
> I can do a full test on my box and
> upload something ready to go.
>
> For the website integration, I can handle that too but..can I work on
>
> Alexey's beta ? This would allow me to add the feeds links without
> having to download
> the full site with a CVS checkout and upload something which will
> have
> in any case be modified for Alexey's  new layout.
>
> Of course if you want to implement the news feeds sooner, I could do
> a
> fresh checkout, upload, add the changes and leave it to you.
>
> Thanks again for your time and attention ;)
> Cheers
> David
>
>
> ---------------------------(end of
> broadcast)---------------------------
> TIP 9: the planner will ignore your desire to choose an index scan if
> your
>       joining column's datatypes do not match


__________________________________
Do you Yahoo!?
Yahoo! Mail SpamGuard - Read only the mail you want.
http://antispam.yahoo.com/tools

Re: Feeds Integration

From
David Costa
Date:
On Feb 19, 2004, at 6:32 PM, Chris Ryan wrote:

> David,
>

Hi Chris! ;)

>     For GBorg specifically the news items are stored on the database. I
> forget how it was setup for the main website to access the database
> however I can provide a query that would give you the information you
> are looking for so you can write a program. Having an RSS feed on GBorg
> would be great too.

yes I am doing it, and I try to avoid the same str_replace stuff, so db
is the way to go.

> If you have something I can you to generate the
> files that would be great.
>

well I have it done, will work with any database data in principle.

>     Here is a query for getting the 10 latest news items for showing on
> the main page of GBorg.
>
> SELECT project_name,
>        headline,
>        body,
>        submit_date   -- date not datetime :(
>   FROM project_news, project
>  WHERE (project_news.project_id=project.project_id)
>    AND (project_news.active=true)
>    AND (project_news.on_homepage=true)
>  ORDER BY submit_date DESC
>  LIMIT 10;
>
>

Umh, so what about the link ? is it part of the body ? if that is the
case it might be a problem, can solve that, just not the fast way to
produce the xml from db data.

>     I will leave issues of access to the GBorg database up to Marc.

I can do it without access to gborg.(In my previous email I was under
the impression that you had a separate table for news, but this is
obviously not the case)
Without db access I can still do  the script and add some quick
comments to set it up the right way.

For now the query is fine, but I need to know where the link is stored,
on which row.  for example I used something like this for the main news
array("title" => $row["title"], "link" => $row["url"], "description" =>
$row['news'], "author" => $row["author"] , "date" => date("d-M-Y",
$row["date"]));
see I keep on the beta database the url as a separate entity assigned
to the link field in the XML generation.


For link I mean the "click here for the full story." thing.

Cheers
David Costa

>
> Chris Ryan
>
>
> --- David Costa <geeks@dotgeek.org> wrote:
>> Hello All,
>> I plan to move forward with a gborg and events feed. This as a nice
>> addition of the existing one (beta version on dotgeek.org).
>>
>> Problem, for the beta news, I had to do a separate scripts to fetch
>> the
>> news because I don't have them in a database, then add these locally
>> and fetch them
>> for the XML feed.
>>
>> (how ?
>>
>> $handle = fopen("http://postgresql.dotgeek.org/", "r");
>> $file_handler = "";
>> while (!feof($handle))
>>     $file_handler .= fgets($handle, 4096);
>> if (!ereg("<!-- News -->(.+)<!-- Events -->", $file_handler, $news))
>>     print "error";
>> $news = str_replace("<tr>\n<td DEFANGED_bgcolor='\"#6884A4\"'>\n<a
>> name=\"news\">\n<font DEFANGED_size='\"+2\"'
>> color=\"#FFFFFF\">News</font></a>\n</td>\n</tr>", "", $news[1]);
>> $news = ereg_replace("(\n){3,}", "\n", $news);
>> /*print $news;
>> print "\n\n\n-------------------------------------------\n\n\n\n";*/
>> $pattern = "<tr><td><a href=\"(news/[0-9]+\.html)\"
>> style=\"font-weight: bold; font-size: medium; color: #020169\">";
>> $pattern .= "([^(</)]+)</a><br>\n<i>Posted on ([0-9]+-[0-9]+-[0-9]+)
>> by
>> <font DEFANGED_color='\"#020169\"'>([^(</)]+)</font>";
>> $pattern .= "</i><br>\n([^(</)]+)</td></tr>\n";
>> $rinfo = array();
>> $i = 0;
>> etc etc )
>>
>> Now, it would be useless to do the same exercise considered that you
>> do
>> have them in a database. So if I know the db schema, I could possibly
>>
>> have it to work locally
>> or upload on my space on your server (thanks Marc !!) something ready
>>
>> to go.
>>
>> Ideally (this would work best for me) can someone move on my server
>> space with you the tables Latest News (gborg) and (events) ? With
>> these
>> I can do a full test on my box and
>> upload something ready to go.
>>
>> For the website integration, I can handle that too but..can I work on
>>
>> Alexey's beta ? This would allow me to add the feeds links without
>> having to download
>> the full site with a CVS checkout and upload something which will
>> have
>> in any case be modified for Alexey's  new layout.
>>
>> Of course if you want to implement the news feeds sooner, I could do
>> a
>> fresh checkout, upload, add the changes and leave it to you.
>>
>> Thanks again for your time and attention ;)
>> Cheers
>> David
>>
>>
>> ---------------------------(end of
>> broadcast)---------------------------
>> TIP 9: the planner will ignore your desire to choose an index scan if
>> your
>>       joining column's datatypes do not match
>
>
> __________________________________
> Do you Yahoo!?
> Yahoo! Mail SpamGuard - Read only the mail you want.
> http://antispam.yahoo.com/tools


Re: Feeds Integration

From
Chris Ryan
Date:
>
> Umh, so what about the link ? is it part of the body ? if that is the
>
> case it might be a problem, can solve that, just not the fast way to
> produce the xml from db data.
>

    Here is an updated query. The URL had slipped my mind as one I
build the URLs from knows practices on GBorg and the body is actually
the full story. You'll note as well in the query below that I added in
for getting the submitter of the news item.

SELECT headline AS title,

'http://gborg.postgresql.org/project/'||project_name||'/news/newsfull.php?news_id='||news_id
AS link, -- the fully built url to the news item
       body,   -- the full news text you may want to abbreviate here
       member_name AS author, -- member name on gborg of author
       submit_date   -- date not datetime :(
  FROM project_news, project, member
 WHERE (project_news.project_id=project.project_id)
   AND (project_news.member_id=member.member_id)
   AND (project_news.active=true)
   AND (project_news.on_homepage=true)
 ORDER BY submit_date DESC
 LIMIT 10;



Chris Ryan


__________________________________
Do you Yahoo!?
Yahoo! Mail SpamGuard - Read only the mail you want.
http://antispam.yahoo.com/tools

Re: Feeds Integration

From
David Costa
Date:
On Feb 19, 2004, at 6:55 PM, Josh Berkus wrote:

> David,
>
>> I plan to move forward with a gborg and events feed. This as a nice
>> addition of the existing one (beta version on dotgeek.org).
>
> If it makes any difference, we are currently discussing the
> possibility of a
> gradual migration from GBorg to GForge.   More discussion to come on
> -hackers
> and this list later.

Umh no difference to me unless you change the db schema. Even then, I
will just need to move things around in the query then I am done.
>
> Second, we have a reason to want to *import* and RSS feed.
> Opensourcexperts.com is ready to do PostgreSQL job listings, and they
> will
> publish them to us via RSS.

Looks like a great add on, kudos

>  Can you help with this once you're done with
> our RSS export?
>

by all means. Parsing an existing XML feed is fairly simple©
Amazing how important and useful are XML feeds to open source projects.
I suspect that many news sites like slashdot generate a huge amount of
traffic from their XML syndication.  Perhaps we might even get some of
the major sites like O'Reilly to use our feeds. Worth a try;)

All the best
David Costa
P.S. am I right assuming that all our discussions are live online on
the news list comp.db.postgresql.advocacy ?
seems so at
http://news.gmane.org/group/gmane.comp.db.postgresql.advocacy/last=/
force_load=t
just curious

> --
> -Josh Berkus
>  Aglio Database Solutions
>  San Francisco
>


Re: Feeds Integration

From
David Costa
Date:
>
>     Here is an updated query. The URL had slipped my mind as one I
> build the URLs from knows practices on GBorg and the body is actually
> the full story. You'll note as well in the query below that I added in
> for getting the submitter of the news item.
>
> SELECT headline AS title,
>
> 'http://gborg.postgresql.org/project/'||project_name||'/news/
> newsfull.php?news_id='||news_id
> AS link, -- the fully built url to the news item
>        body,   -- the full news text you may want to abbreviate here
>        member_name AS author, -- member name on gborg of author
>        submit_date   -- date not datetime :(
>   FROM project_news, project, member
>  WHERE (project_news.project_id=project.project_id)
>    AND (project_news.member_id=member.member_id)
>    AND (project_news.active=true)
>    AND (project_news.on_homepage=true)
>  ORDER BY submit_date DESC
>  LIMIT 10;
>

Okay. I will need a sample db table table if you want me to test it.
Else I don't physically have where to run the query :D

Or perhaps I do the script, leave it on my webspace and let you/Marc or
Dave to try this out. That would work for me, I don't really need any
further access. Without the db I can
still do the script ready to run but I cannot test if the query returns
what we would expect or not.

Thanks again for your support,
cheers
David Costa

>
>
> Chris Ryan
>
>
> __________________________________
> Do you Yahoo!?
> Yahoo! Mail SpamGuard - Read only the mail you want.
> http://antispam.yahoo.com/tools


Re: Feeds Integration

From
Chris Ryan
Date:
    If you provide a script I can work through any specific issues
during implementation.

Chris Ryan

--- David Costa <geeks@dotgeek.org> wrote:
> >
> >     Here is an updated query. The URL had slipped my mind as one I
> > build the URLs from knows practices on GBorg and the body is
> actually
> > the full story. You'll note as well in the query below that I added
> in
> > for getting the submitter of the news item.
> >
> > SELECT headline AS title,
> >
> > 'http://gborg.postgresql.org/project/'||project_name||'/news/
> > newsfull.php?news_id='||news_id
> > AS link, -- the fully built url to the news item
> >        body,   -- the full news text you may want to abbreviate
> here
> >        member_name AS author, -- member name on gborg of author
> >        submit_date   -- date not datetime :(
> >   FROM project_news, project, member
> >  WHERE (project_news.project_id=project.project_id)
> >    AND (project_news.member_id=member.member_id)
> >    AND (project_news.active=true)
> >    AND (project_news.on_homepage=true)
> >  ORDER BY submit_date DESC
> >  LIMIT 10;
> >
>
> Okay. I will need a sample db table table if you want me to test it.
>
> Else I don't physically have where to run the query :D
>
> Or perhaps I do the script, leave it on my webspace and let you/Marc
> or
> Dave to try this out. That would work for me, I don't really need any
>
> further access. Without the db I can
> still do the script ready to run but I cannot test if the query
> returns
> what we would expect or not.
>
> Thanks again for your support,
> cheers
> David Costa
>
> >
> >
> > Chris Ryan
> >
> >
> > __________________________________
> > Do you Yahoo!?
> > Yahoo! Mail SpamGuard - Read only the mail you want.
> > http://antispam.yahoo.com/tools
>
>
> ---------------------------(end of
> broadcast)---------------------------
> TIP 4: Don't 'kill -9' the postmaster


__________________________________
Do you Yahoo!?
Yahoo! Mail SpamGuard - Read only the mail you want.
http://antispam.yahoo.com/tools

Re: Feeds Integration

From
"Dave Page"
Date:

> -----Original Message-----
> From: Josh Berkus [mailto:josh@agliodbs.com]
> Sent: 19 February 2004 17:55
> To: David Costa; PostgreSQL WWW Mailing List
> Subject: Re: [pgsql-www] Feeds Integration
>
> David,
>
> > I plan to move forward with a gborg and events feed. This as a nice
> > addition of the existing one (beta version on dotgeek.org).
>
> If it makes any difference, we are currently discussing the
> possibility of a
> gradual migration from GBorg to GForge.   More discussion to
> come on -hackers
> and this list later.

I thought we had agreed not to do that in the end?

Regards, Dave.

Re: Feeds Integration

From
David Costa
Date:
On Feb 19, 2004, at 9:43 PM, Chris Ryan wrote:

>     If you provide a script I can work through any specific issues
> during implementation.
>

Okay I will email you directly re: implementation :D

> Chris Ryan
>
> --- David Costa <geeks@dotgeek.org> wrote:
>>>
>>>     Here is an updated query. The URL had slipped my mind as one I
>>> build the URLs from knows practices on GBorg and the body is
>> actually
>>> the full story. You'll note as well in the query below that I added
>> in
>>> for getting the submitter of the news item.
>>>
>>> SELECT headline AS title,
>>>
>>> 'http://gborg.postgresql.org/project/'||project_name||'/news/
>>> newsfull.php?news_id='||news_id
>>> AS link, -- the fully built url to the news item
>>>        body,   -- the full news text you may want to abbreviate
>> here
>>>        member_name AS author, -- member name on gborg of author
>>>        submit_date   -- date not datetime :(
>>>   FROM project_news, project, member
>>>  WHERE (project_news.project_id=project.project_id)
>>>    AND (project_news.member_id=member.member_id)
>>>    AND (project_news.active=true)
>>>    AND (project_news.on_homepage=true)
>>>  ORDER BY submit_date DESC
>>>  LIMIT 10;
>>>
>>
>> Okay. I will need a sample db table table if you want me to test it.
>>
>> Else I don't physically have where to run the query :D
>>
>> Or perhaps I do the script, leave it on my webspace and let you/Marc
>> or
>> Dave to try this out. That would work for me, I don't really need any
>>
>> further access. Without the db I can
>> still do the script ready to run but I cannot test if the query
>> returns
>> what we would expect or not.
>>
>> Thanks again for your support,
>> cheers
>> David Costa
>>
>>>
>>>
>>> Chris Ryan
>>>
>>>
>>> __________________________________
>>> Do you Yahoo!?
>>> Yahoo! Mail SpamGuard - Read only the mail you want.
>>> http://antispam.yahoo.com/tools
>>
>>
>> ---------------------------(end of
>> broadcast)---------------------------
>> TIP 4: Don't 'kill -9' the postmaster
>
>
> __________________________________
> Do you Yahoo!?
> Yahoo! Mail SpamGuard - Read only the mail you want.
> http://antispam.yahoo.com/tools


Re: Feeds Integration

From
David Costa
Date:
Sorry Chris,
something missing on the query.
You need a title too, like pgin.tcl-2.0.0 released
title, link, description, date.

Now the link is there, description will be the body, date whatever we
have but we need the title too. Bottom line,
I need something AS title too.

In preparation of our tests (I will send the scripts to you) you need
to do this:

pear install XML_RPC
and then pear list to check if pear DB is there too (just in case).

Let me know when you are done ;)

Cheers
David

On Feb 19, 2004, at 7:49 PM, Chris Ryan wrote:

>
>>
>> Umh, so what about the link ? is it part of the body ? if that is the
>>
>> case it might be a problem, can solve that, just not the fast way to
>> produce the xml from db data.
>>
>
>     Here is an updated query. The URL had slipped my mind as one I
> build the URLs from knows practices on GBorg and the body is actually
> the full story. You'll note as well in the query below that I added in
> for getting the submitter of the news item.
>
> SELECT headline AS title,
>
> 'http://gborg.postgresql.org/project/'||project_name||'/news/
> newsfull.php?news_id='||news_id
> AS link, -- the fully built url to the news item
>        body,   -- the full news text you may want to abbreviate here
>        member_name AS author, -- member name on gborg of author
>        submit_date   -- date not datetime :(
>   FROM project_news, project, member
>  WHERE (project_news.project_id=project.project_id)
>    AND (project_news.member_id=member.member_id)
>    AND (project_news.active=true)
>    AND (project_news.on_homepage=true)
>  ORDER BY submit_date DESC
>  LIMIT 10;
>
>
>
> Chris Ryan
>
>
> __________________________________
> Do you Yahoo!?
> Yahoo! Mail SpamGuard - Read only the mail you want.
> http://antispam.yahoo.com/tools


Re: Feeds Integration

From
Chris Ryan
Date:
--- David Costa <geeks@dotgeek.org> wrote:
> Sorry Chris,
> something missing on the query.
> You need a title too, like pgin.tcl-2.0.0 released
> title, link, description, date.
>

    I am confused. The first line of the query I sent you, as quoted
below, has a title in it.

> >
> > SELECT headline AS title,
> >

    Everything else you mentioned is completed.

Chris Ryan


__________________________________
Do you Yahoo!?
Yahoo! Mail SpamGuard - Read only the mail you want.
http://antispam.yahoo.com/tools

Re: Feeds Integration

From
Chris Ryan
Date:
--- David Costa <geeks@dotgeek.org> wrote:
> Hello!
 -- snip --
> Then just run the file and if it works let me know.
 -- snip --


    It worked great. You can find the output that was generated at
http://gborg.postgresql.org/news.rss. I don't have any RSS tools to
view this with so someone else may want to look at this and verify it's
generating correctly. Other than that it looks good to me.

    Once a few people have looked at it and we all like the way it's
working I can setup the cron to generate the file on a regular basis.

    Good Job Dave.

Chris Ryan


__________________________________
Do you Yahoo!?
Yahoo! Mail SpamGuard - Read only the mail you want.
http://antispam.yahoo.com/tools

Re: Feeds Integration

From
Devrim GUNDUZ
Date:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


Hi,

On Fri, 20 Feb 2004, Chris Ryan wrote:

>
>     It worked great. You can find the output that was generated at
> http://gborg.postgresql.org/news.rss. I don't have any RSS tools to
> view this with so someone else may want to look at this and verify it's
> generating correctly. Other than that it looks good to me.

I've tested it with Evolution now. It looks really perfect.

Thanks guys.

Regards,
- --
Devrim GUNDUZ
devrim@gunduz.org                devrim.gunduz@linux.org.tr
            http://www.TDMSoft.com
            http://www.gunduz.org
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.1 (GNU/Linux)

iD8DBQFANi/ktl86P3SPfQ4RAtAiAJ9V4l/8ugow1tYLV1DeGIkihdRDQQCaA3AE
okK64IyRlisYvH863sRQpEU=
=00s7
-----END PGP SIGNATURE-----


Re: Feeds Integration

From
David Costa
Date:
On Feb 20, 2004, at 4:48 PM, Chris Ryan wrote:
>
>
>     It worked great. You can find the output that was generated at
> http://gborg.postgresql.org/news.rss. I don't have any RSS tools to
> view this with so someone else may want to look at this and verify it's
> generating correctly. Other than that it looks good to me.
>
>     Once a few people have looked at it and we all like the way it's
> working I can setup the cron to generate the file on a regular basis.
>
Okay a live parsed feed is at http://php.gurugeek.org/parser.php
as you can see there are some little problems
The date is not produced by the feed <date>submit_date</date> (see
source on http://gborg.postgresql.org/news.rss)
The author is not grabbed by this specific parser but is something we
can solve.

This parser is somehow strict, I have another one if you want me to try
with that one, I can have a page up soon or I can email you the source
of a "non that strict"
parser ? ;)


>     Good Job Dave.
>
> Chris Ryan
>
>
> __________________________________
> Do you Yahoo!?
> Yahoo! Mail SpamGuard - Read only the mail you want.
> http://antispam.yahoo.com/tools


Re: Feeds Integration

From
David Costa
Date:
On Feb 20, 2004, at 5:03 PM, Devrim GUNDUZ wrote:
>
> On Fri, 20 Feb 2004, Chris Ryan wrote:
>
>>
>>     It worked great. You can find the output that was generated at
>> http://gborg.postgresql.org/news.rss. I don't have any RSS tools to
>> view this with so someone else may want to look at this and verify
>> it's
>> generating correctly. Other than that it looks good to me.
>
> I've tested it with Evolution now. It looks really perfect.

Hi Devrim :D
umh, does it looks like this http://php.gurugeek.org/parser.php or you
can also see the author ?
thanks again for your feedback :D

David Costa


>
> Thanks guys.
>
> Regards,
> - --
> Devrim GUNDUZ
> devrim@gunduz.org                devrim.gunduz@linux.org.tr
>             http://www.TDMSoft.com
>             http://www.gunduz.org
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.2.1 (GNU/Linux)
>
> iD8DBQFANi/ktl86P3SPfQ4RAtAiAJ9V4l/8ugow1tYLV1DeGIkihdRDQQCaA3AE
> okK64IyRlisYvH863sRQpEU=
> =00s7
> -----END PGP SIGNATURE-----
>
>
> ---------------------------(end of
> broadcast)---------------------------
> TIP 5: Have you checked our extensive FAQ?
>
>                http://www.postgresql.org/docs/faqs/FAQ.html


Re: Feeds Integration

From
Devrim GUNDUZ
Date:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


Hi,

On Fri, 20 Feb 2004, David Costa wrote:

> umh, does it looks like this http://php.gurugeek.org/parser.php or you
> can also see the author ?

Here is a screenshot from Evolution:

http://www.gunduz.org/gborg-rss.png

Regards,
- --
Devrim GUNDUZ
devrim@gunduz.org                devrim.gunduz@linux.org.tr
            http://www.TDMSoft.com
            http://www.gunduz.org
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.1 (GNU/Linux)

iD8DBQFANjMMtl86P3SPfQ4RAhJAAKCv0OYaos0Pibt5qsxT0VxPcoTWlwCeOtZn
2sZFxkS/9z5ji3Icjx4AyyY=
=lAwe
-----END PGP SIGNATURE-----


Re: Feeds Integration

From
Chris Ryan
Date:
    I've corrected the date and posted the updated news.rss.

Chris Ryan

--- David Costa <geeks@dotgeek.org> wrote:
>
> On Feb 20, 2004, at 4:48 PM, Chris Ryan wrote:
> >
> >
> >     It worked great. You can find the output that was generated at
> > http://gborg.postgresql.org/news.rss. I don't have any RSS tools to
> > view this with so someone else may want to look at this and verify
> it's
> > generating correctly. Other than that it looks good to me.
> >
> >     Once a few people have looked at it and we all like the way
> it's
> > working I can setup the cron to generate the file on a regular
> basis.
> >
> Okay a live parsed feed is at http://php.gurugeek.org/parser.php
> as you can see there are some little problems
> The date is not produced by the feed <date>submit_date</date> (see
> source on http://gborg.postgresql.org/news.rss)
> The author is not grabbed by this specific parser but is something we
>
> can solve.
>
> This parser is somehow strict, I have another one if you want me to
> try
> with that one, I can have a page up soon or I can email you the
> source
> of a "non that strict"
> parser ? ;)
>
>
> >     Good Job Dave.
> >
> > Chris Ryan
> >
> >
> > __________________________________
> > Do you Yahoo!?
> > Yahoo! Mail SpamGuard - Read only the mail you want.
> > http://antispam.yahoo.com/tools
>


__________________________________
Do you Yahoo!?
Yahoo! Mail SpamGuard - Read only the mail you want.
http://antispam.yahoo.com/tools

Re: Feeds Integration

From
David Costa
Date:
On Feb 20, 2004, at 5:20 PM, Chris Ryan wrote:

>
>     I've corrected the date and posted the updated news.rss.
>
> Chris Ryan

Hello Chris,
thanks for your prompt fix.

looks fine to me. Now there is a caveat ;)

Rss 1.0 which I used on this script allows only title, link description
therefore some parsers might arbitrarily ignore any other tags or
complain.
Rss 2.0 has author and data capability but is sort of silly because
pretends a formation like author@domain.suffix which for spam purposes
is rarely used.

Let's see if someone else has a feedback  I will test it with some
other parsers too just in case.
So far so good.
thanks to Devrim for trying this out.

Regards
David Costa


>
> --- David Costa <geeks@dotgeek.org> wrote:
>>
>> On Feb 20, 2004, at 4:48 PM, Chris Ryan wrote:
>>>
>>>
>>>     It worked great. You can find the output that was generated at
>>> http://gborg.postgresql.org/news.rss. I don't have any RSS tools to
>>> view this with so someone else may want to look at this and verify
>> it's
>>> generating correctly. Other than that it looks good to me.
>>>
>>>     Once a few people have looked at it and we all like the way
>> it's
>>> working I can setup the cron to generate the file on a regular
>> basis.
>>>
>> Okay a live parsed feed is at http://php.gurugeek.org/parser.php
>> as you can see there are some little problems
>> The date is not produced by the feed <date>submit_date</date> (see
>> source on http://gborg.postgresql.org/news.rss)
>> The author is not grabbed by this specific parser but is something we
>>
>> can solve.
>>
>> This parser is somehow strict, I have another one if you want me to
>> try
>> with that one, I can have a page up soon or I can email you the
>> source
>> of a "non that strict"
>> parser ? ;)
>>
>>
>>>     Good Job Dave.
>>>
>>> Chris Ryan
>>>
>>>
>>> __________________________________
>>> Do you Yahoo!?
>>> Yahoo! Mail SpamGuard - Read only the mail you want.
>>> http://antispam.yahoo.com/tools
>>
>
>
> __________________________________
> Do you Yahoo!?
> Yahoo! Mail SpamGuard - Read only the mail you want.
> http://antispam.yahoo.com/tools


Re: Feeds Integration

From
Josh Berkus
Date:
Dave,

> I thought we had agreed not to do that in the end?

Had we?   When?

My memory ... and e-mailbox ... was that the discussion had been tabled
because of the lack of an administrator for GForge, and the amount of effort
required to migrate off GBorg.

However, a number of things have come up in the last few months to make the
use of a better collaboration tool more compelling -- enough so that I'm
willing to put some work behind it.   Also, the GForge community is willing
to lend us a significant amount of help, something I don't think anyone
looked into.

Maybe there were other objections voiced, but I can't find them in the
archives.

--
-Josh Berkus
 Aglio Database Solutions
 San Francisco


Re: Feeds Integration

From
"Dave Page"
Date:

> -----Original Message-----
> From: Josh Berkus [mailto:josh@agliodbs.com]
> Sent: 20 February 2004 17:22
> To: Dave Page; David Costa; PostgreSQL WWW Mailing List
> Subject: Re: [pgsql-www] Feeds Integration
>
> Dave,
>
> > I thought we had agreed not to do that in the end?
>
> Had we?   When?
>
> My memory ... and e-mailbox ... was that the discussion had
> been tabled because of the lack of an administrator for
> GForge, and the amount of effort required to migrate off GBorg.

Well I don't remember the administrator thing, but yes, my recollection
is that we had shelved the idea due to the difficulty in migrating
people from one platform to the other.

> However, a number of things have come up in the last few
> months to make the use of a better collaboration tool more
> compelling -- enough so that I'm
> willing to put some work behind it.

What's come up recently? I don't remember seeing anything.

Still, perhaps it would be worth asking the project owners what they
would like to do? As admin for a few myself I would vote against a move.
At least one of them would require significant work on my part to
migrate.

Regards, Dave.

Re: GForge WAS: Feeds Integration

From
Josh Berkus
Date:
Dave,

> What's come up recently? I don't remember seeing anything.

It wasn't on public lists, mostly.   Let's just say that a few people are
*very* dissatisfied with GBorg and might like to try something else.   Also,
we've been discussing having a bug tracking utility for the main project,
particularly for the 7.5 release.

> Still, perhaps it would be worth asking the project owners what they
> would like to do? As admin for a few myself I would vote against a move.
> At least one of them would require significant work on my part to
> migrate.

Yeah, that's why I said "gradually".   What we do first is ask for volunteers,
and put *new* projects on GForge.

HOWEVER, this is all hypothetical.    I need to poll this list and Hackers
first and get a vote from people, as well as having an organized proposal --
which is going to wait until we have a blank GForge up and running on Hub.org
first.    So let's postpone the rest of the discussion until that happens,
hey?

--
-Josh Berkus
 Aglio Database Solutions
 San Francisco


Re: Feeds Integration

From
David Costa
Date:
Chris,
can you please put up a beta/alpha for the main news feeds
and events?
all you need to change is the db query and the name of the php objects
used in the loop.

For my news alpha I am using a regex on the postgresql homepage and is
not really a good idea©

Cheers
David

On Feb 20, 2004, at 4:48 PM, Chris Ryan wrote:

>
> --- David Costa <geeks@dotgeek.org> wrote:
>> Hello!
>  -- snip --
>> Then just run the file and if it works let me know.
>  -- snip --
>
>
>     It worked great. You can find the output that was generated at
> http://gborg.postgresql.org/news.rss. I don't have any RSS tools to
> view this with so someone else may want to look at this and verify it's
> generating correctly. Other than that it looks good to me.
>
>     Once a few people have looked at it and we all like the way it's
> working I can setup the cron to generate the file on a regular basis.
>
>     Good Job Dave.
>
> Chris Ryan
>
>
> __________________________________
> Do you Yahoo!?
> Yahoo! Mail SpamGuard - Read only the mail you want.
> http://antispam.yahoo.com/tools


Re: Feeds Integration

From
Chris Ryan
Date:
David,

    It's been a long day and I'm somewhat confused with what you want
me to do. Could you clarify? Thanks.

Chris Ryan

--- David Costa <geeks@dotgeek.org> wrote:
> Chris,
> can you please put up a beta/alpha for the main news feeds
> and events?
> all you need to change is the db query and the name of the php
> objects
> used in the loop.
>
> For my news alpha I am using a regex on the postgresql homepage and
> is
> not really a good idea�
>
> Cheers
> David
>
> On Feb 20, 2004, at 4:48 PM, Chris Ryan wrote:
>
> >
> > --- David Costa <geeks@dotgeek.org> wrote:
> >> Hello!
> >  -- snip --
> >> Then just run the file and if it works let me know.
> >  -- snip --
> >
> >
> >     It worked great. You can find the output that was generated at
> > http://gborg.postgresql.org/news.rss. I don't have any RSS tools to
> > view this with so someone else may want to look at this and verify
> it's
> > generating correctly. Other than that it looks good to me.
> >
> >     Once a few people have looked at it and we all like the way
> it's
> > working I can setup the cron to generate the file on a regular
> basis.
> >
> >     Good Job Dave.
> >
> > Chris Ryan
> >
> >
> > __________________________________
> > Do you Yahoo!?
> > Yahoo! Mail SpamGuard - Read only the mail you want.
> > http://antispam.yahoo.com/tools
>


__________________________________
Do you Yahoo!?
Get better spam protection with Yahoo! Mail.
http://antispam.yahoo.com/tools

Re: Feeds Integration

From
Chris Ryan
Date:
Dave P., Marc,

    I took what David gave me for the rss feed on gborg and made some
quick changes in the sql to fit with the events and news tables from
the main sites database. I gleaned the information from the pgweb cvs
so it should be good to go but may need some tweaking since I didn't
test the sql against the db.

    Find attached a file that has the two seperate scripts I modified
and a third script that needs to be placed appropriately. David had
sent me the instructions the first time but I seem to have deleted them
so he should be able to provide the needed instructions on setup. In
short it was placing the 3rd file in <PEAR>/XML/. and making sure
certain pear packages were installed XML_RPC and XML_Util.

Chris Ryan



--- David Costa <geeks@dotgeek.org> wrote:
> Chris,
> can you please put up a beta/alpha for the main news feeds
> and events?
> all you need to change is the db query and the name of the php
> objects
> used in the loop.
>
> For my news alpha I am using a regex on the postgresql homepage and
> is
> not really a good idea�
>
> Cheers
> David
>
> On Feb 20, 2004, at 4:48 PM, Chris Ryan wrote:
>
> >
> > --- David Costa <geeks@dotgeek.org> wrote:
> >> Hello!
> >  -- snip --
> >> Then just run the file and if it works let me know.
> >  -- snip --
> >
> >
> >     It worked great. You can find the output that was generated at
> > http://gborg.postgresql.org/news.rss. I don't have any RSS tools to
> > view this with so someone else may want to look at this and verify
> it's
> > generating correctly. Other than that it looks good to me.
> >
> >     Once a few people have looked at it and we all like the way
> it's
> > working I can setup the cron to generate the file on a regular
> basis.
> >
> >     Good Job Dave.
> >
> > Chris Ryan
> >
> >
> > __________________________________
> > Do you Yahoo!?
> > Yahoo! Mail SpamGuard - Read only the mail you want.
> > http://antispam.yahoo.com/tools
>


__________________________________
Do you Yahoo!?
Get better spam protection with Yahoo! Mail.
http://antispam.yahoo.com/tools

Re: Feeds Integration

From
Robert Treat
Date:
Is it just me or did no one else get the attachment?

Robert Treat

On Thu, 2004-02-26 at 13:28, Chris Ryan wrote:
> Dave P., Marc,
>
>     I took what David gave me for the rss feed on gborg and made some
> quick changes in the sql to fit with the events and news tables from
> the main sites database. I gleaned the information from the pgweb cvs
> so it should be good to go but may need some tweaking since I didn't
> test the sql against the db.
>
>     Find attached a file that has the two seperate scripts I modified
> and a third script that needs to be placed appropriately. David had
> sent me the instructions the first time but I seem to have deleted them
> so he should be able to provide the needed instructions on setup. In
> short it was placing the 3rd file in <PEAR>/XML/. and making sure
> certain pear packages were installed XML_RPC and XML_Util.
>
> Chris Ryan
>
>
>
> --- David Costa <geeks@dotgeek.org> wrote:
> > Chris,
> > can you please put up a beta/alpha for the main news feeds
> > and events?
> > all you need to change is the db query and the name of the php
> > objects
> > used in the loop.
> >
> > For my news alpha I am using a regex on the postgresql homepage and
> > is
> > not really a good idea©
> >
> > Cheers
> > David
> >
> > On Feb 20, 2004, at 4:48 PM, Chris Ryan wrote:
> >
> > >
> > > --- David Costa <geeks@dotgeek.org> wrote:
> > >> Hello!
> > >  -- snip --
> > >> Then just run the file and if it works let me know.
> > >  -- snip --
> > >
> > >
> > >     It worked great. You can find the output that was generated at
> > > http://gborg.postgresql.org/news.rss. I don't have any RSS tools to
> > > view this with so someone else may want to look at this and verify
> > it's
> > > generating correctly. Other than that it looks good to me.
> > >
> > >     Once a few people have looked at it and we all like the way
> > it's
> > > working I can setup the cron to generate the file on a regular
> > basis.
> > >
> > >     Good Job Dave.
> > >
> > > Chris Ryan
> > >
> > >
> > > __________________________________
> > > Do you Yahoo!?
> > > Yahoo! Mail SpamGuard - Read only the mail you want.
> > > http://antispam.yahoo.com/tools
> >
>
>
> __________________________________
> Do you Yahoo!?
> Get better spam protection with Yahoo! Mail.
> http://antispam.yahoo.com/tools
>
> ---------------------------(end of broadcast)---------------------------
> TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org

--
Build A Brighter Lamp :: Linux Apache {middleware} PostgreSQL


Re: Feeds Integration

From
Chris Ryan
Date:
In retrospect it was probably me. Attached this time... i swear... i
hope :)

Chris Ryan

--- Robert Treat <xzilla@users.sourceforge.net> wrote:
> Is it just me or did no one else get the attachment?
>
> Robert Treat
>
> On Thu, 2004-02-26 at 13:28, Chris Ryan wrote:
> > Dave P., Marc,
> >
> >     I took what David gave me for the rss feed on gborg and made
> some
> > quick changes in the sql to fit with the events and news tables
> from
> > the main sites database. I gleaned the information from the pgweb
> cvs
> > so it should be good to go but may need some tweaking since I
> didn't
> > test the sql against the db.
> >
> >     Find attached a file that has the two seperate scripts I
> modified
> > and a third script that needs to be placed appropriately. David had
> > sent me the instructions the first time but I seem to have deleted
> them
> > so he should be able to provide the needed instructions on setup.
> In
> > short it was placing the 3rd file in <PEAR>/XML/. and making sure
> > certain pear packages were installed XML_RPC and XML_Util.
> >
> > Chris Ryan
> >
> >
> >
> > --- David Costa <geeks@dotgeek.org> wrote:
> > > Chris,
> > > can you please put up a beta/alpha for the main news feeds
> > > and events?
> > > all you need to change is the db query and the name of the php
> > > objects
> > > used in the loop.
> > >
> > > For my news alpha I am using a regex on the postgresql homepage
> and
> > > is
> > > not really a good idea�
> > >
> > > Cheers
> > > David
> > >
> > > On Feb 20, 2004, at 4:48 PM, Chris Ryan wrote:
> > >
> > > >
> > > > --- David Costa <geeks@dotgeek.org> wrote:
> > > >> Hello!
> > > >  -- snip --
> > > >> Then just run the file and if it works let me know.
> > > >  -- snip --
> > > >
> > > >
> > > >     It worked great. You can find the output that was generated
> at
> > > > http://gborg.postgresql.org/news.rss. I don't have any RSS
> tools to
> > > > view this with so someone else may want to look at this and
> verify
> > > it's
> > > > generating correctly. Other than that it looks good to me.
> > > >
> > > >     Once a few people have looked at it and we all like the way
> > > it's
> > > > working I can setup the cron to generate the file on a regular
> > > basis.
> > > >
> > > >     Good Job Dave.
> > > >
> > > > Chris Ryan
> > > >
> > > >
> > > > __________________________________
> > > > Do you Yahoo!?
> > > > Yahoo! Mail SpamGuard - Read only the mail you want.
> > > > http://antispam.yahoo.com/tools
> > >
> >
> >
> > __________________________________
> > Do you Yahoo!?
> > Get better spam protection with Yahoo! Mail.
> > http://antispam.yahoo.com/tools
> >
> > ---------------------------(end of
> broadcast)---------------------------
> > TIP 1: subscribe and unsubscribe commands go to
> majordomo@postgresql.org
>
> --
> Build A Brighter Lamp :: Linux Apache {middleware} PostgreSQL
>
>
> ---------------------------(end of
> broadcast)---------------------------
> TIP 5: Have you checked our extensive FAQ?
>
>                http://www.postgresql.org/docs/faqs/FAQ.html

__________________________________
Do you Yahoo!?
Get better spam protection with Yahoo! Mail.
http://antispam.yahoo.com/tools

Attachment