Thread: Re: About docbot

Re: About docbot

From
"Joshua D. Drake"
Date:
Hello,

What do we think about the below guys?

Andreas 'ads' Scherbaum wrote:
>
> Hello Joshua,
>
> we talked today about a docbot subdomain.
> The current situation is, that pg_docbot (more precise his instance
> pg_docbot_ads) is on 10 PostgreSQL channels. Now we would like to
> implement a web interface for the bot to show some information and
> to have a search form which would give back results from the same
> database the bot is using.
>
> Picking up your idea from earlier today i would like to ask you, if
> it is possible to get a subdomain like docbot.postgresql.org pointing
> to the server the bot is running on.
>
> Thank you for your help.
>
>
> Kind regards
>


--

    === The PostgreSQL Company: Command Prompt, Inc. ===
Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
    Providing the most comprehensive  PostgreSQL solutions since 1997
              http://www.commandprompt.com/



Re: About docbot

From
"Gavin M. Roy"
Date:
Sounds iffy to me.   Lending the hostname makes this an official (or
officially endorsed) thing.  Would it be branded and such the same as
the main website?  Would core www- team people have access to it such
as Dave, Magnus, Robert etc?  How is content controlled and would we
have any ability to make sure the image and content agrees with how
the project presents itself?  I pm'ed the bot and it didn't respond
to me so I'm not sure exactly the context of what it does, but if
it's like rtfm_please, I don't know what it offers that the
documentation section of the main site doesn't offer.

I don't want to rain on anyones parade, just offering my 2 cents.

Gavin

On Sep 21, 2006, at 5:31 PM, Joshua D. Drake wrote:

> Hello,
>
> What do we think about the below guys?
>
> Andreas 'ads' Scherbaum wrote:
>> Hello Joshua,
>> we talked today about a docbot subdomain.
>> The current situation is, that pg_docbot (more precise his instance
>> pg_docbot_ads) is on 10 PostgreSQL channels. Now we would like to
>> implement a web interface for the bot to show some information and
>> to have a search form which would give back results from the same
>> database the bot is using.
>> Picking up your idea from earlier today i would like to ask you, if
>> it is possible to get a subdomain like docbot.postgresql.org pointing
>> to the server the bot is running on.
>> Thank you for your help.
>> Kind regards
>
>
> --
>
>    === The PostgreSQL Company: Command Prompt, Inc. ===
> Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
>    Providing the most comprehensive  PostgreSQL solutions since 1997
>              http://www.commandprompt.com/
>
>
>
> ---------------------------(end of
> broadcast)---------------------------
> TIP 6: explain analyze is your friend


Re: About docbot

From
David Fetter
Date:
On Thu, Sep 21, 2006 at 05:41:58PM -0700, Gavin M. Roy wrote:

> Sounds iffy to me.   Lending the hostname makes this an official (or
> officially endorsed) thing.  Would it be branded and such the same
> as  the main website?

Not necessarily.  The current (non-working) site on pgfoundry looks
like this:

    http://docbot.projects.postgresql.org/

Just to be clear, no one has suggested that this include write
operations.  The known ways to write to that the keyword search are:

1.  Be an identified user on freenode and in the docbot's list of
authorized users.

2.  Directly execute SQL on its database.

I'd recommend against adding more write methods.

> Would core www- team people have access to it such as Dave, Magnus,
> Robert etc?

If they really want it.  I have commit bits on -www, and already have
write access as above.

> How is content controlled and would we have any ability to make sure
> the image and content agrees with how the project presents itself?

So far (3 years, give or take) there have been just two controversial
URLs: one for fsm which pointed to venganza.org, which I removed at
Jan Wieck's request on grounds of its political nature, and one for
google which contains an unromantic Saxon-derived word denoting
lovemaking, which is still there as far as I know.

> I pm'ed the bot and it didn't respond to me

pg_docbot takes commands in pm phrased precisely as you would phrase
them in channel.

> so I'm not sure exactly the context of what it does, but if it's
> like rtfm_please, I don't know what it offers that the documentation
> section of the main site doesn't offer.

It offers keyword searches that people have found useful.  People
frequently paste docbot responses into the -general mailing list.

> I don't want to rain on anyones parade, just offering my 2 cents.

Thanks for helping clarify the situation :)

Cheers,
D
>
> Gavin
>
> On Sep 21, 2006, at 5:31 PM, Joshua D. Drake wrote:
>
> >Hello,
> >
> >What do we think about the below guys?
> >
> >Andreas 'ads' Scherbaum wrote:
> >>Hello Joshua,
> >>we talked today about a docbot subdomain.
> >>The current situation is, that pg_docbot (more precise his instance
> >>pg_docbot_ads) is on 10 PostgreSQL channels. Now we would like to
> >>implement a web interface for the bot to show some information and
> >>to have a search form which would give back results from the same
> >>database the bot is using.
> >>Picking up your idea from earlier today i would like to ask you, if
> >>it is possible to get a subdomain like docbot.postgresql.org pointing
> >>to the server the bot is running on.
> >>Thank you for your help.
> >>Kind regards
> >
> >
> >--
> >
> >   === The PostgreSQL Company: Command Prompt, Inc. ===
> >Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
> >   Providing the most comprehensive  PostgreSQL solutions since 1997
> >             http://www.commandprompt.com/
> >
> >
> >
> >---------------------------(end of
> >broadcast)---------------------------
> >TIP 6: explain analyze is your friend

--
David Fetter <david@fetter.org> http://fetter.org/
phone: +1 415 235 3778        AIM: dfetter666
                              Skype: davidfetter

Remember to vote!

Re: About docbot

From
"Magnus Hagander"
Date:
> > Sounds iffy to me.   Lending the hostname makes this an official
> (or
> > officially endorsed) thing.  Would it be branded and such the
> same as
> > the main website?

Also, we have been working hard to *decrease* the number of distinct
websites in the PostgreSQL domain. So please let's try to avoid adding
another one if we can.

Now, *assuming* this is a service that we want on the main site (I'm not
taking position on that yet, but it does seem pretty nifty), wouldn't
the logical place be to have it on http://search.postgresql.org, along
with the standard search?

Maybe even to the point of delivering docbot search results at the top
of the results, over the general search ones, based on the fact that
it's common keyword searching.


Where does it actually *live* today? Meaning where is the database
located, where does the IRC bot run, etc?


> > How is content controlled and would we have any ability to make
> sure
> > the image and content agrees with how the project presents
> itself?
>
> So far (3 years, give or take) there have been just two
> controversial
> URLs: one for fsm which pointed to venganza.org, which I removed at
> Jan Wieck's request on grounds of its political nature, and one for
> google which contains an unromantic Saxon-derived word denoting
> lovemaking, which is still there as far as I know.

Given that it's not open-access-write, I don't see how this would be any
more different than other content we have - we have even less control
over what goes into http://archives.postgresql.org for example, and we
can always do post-case cleanups.


//Magnus


Re: About docbot

From
David Fetter
Date:
On Fri, Sep 22, 2006 at 01:08:20PM +0200, Magnus Hagander wrote:
> > > Sounds iffy to me.   Lending the hostname makes this an official
> > > (or officially endorsed) thing.  Would it be branded and such
> > > the same as the main website?
>
> Also, we have been working hard to *decrease* the number of distinct
> websites in the PostgreSQL domain. So please let's try to avoid
> adding another one if we can.
>
> Now, *assuming* this is a service that we want on the main site (I'm
> not taking position on that yet, but it does seem pretty nifty),
> wouldn't the logical place be to have it on
> http://search.postgresql.org, along with the standard search?

That sounds like a plan :)

> Maybe even to the point of delivering docbot search results at the
> top of the results, over the general search ones, based on the fact
> that it's common keyword searching.

Integrating it would be nice, too. :)

> Where does it actually *live* today? Meaning where is the database
> located, where does the IRC bot run, etc?

Daniel (Primer) Ceregatti hosts the database on sh.nu, and Andreas
(ads) Scherbaum hosts the bot code on base.wars-nicht.de.  Both could
change if needed.

> > > How is content controlled and would we have any ability to make
> > > sure the image and content agrees with how the project presents
> > > itself?
> >
> > So far (3 years, give or take) there have been just two
> > controversial URLs: one for fsm which pointed to venganza.org,
> > which I removed at Jan Wieck's request on grounds of its political
> > nature, and one for google which contains an unromantic
> > Saxon-derived word denoting lovemaking, which is still there as
> > far as I know.
>
> Given that it's not open-access-write, I don't see how this would be
> any more different than other content we have - we have even less
> control over what goes into http://archives.postgresql.org for
> example, and we can always do post-case cleanups.
>
>
> //Magnus

--
David Fetter <david@fetter.org> http://fetter.org/
phone: +1 415 235 3778        AIM: dfetter666
                              Skype: davidfetter

Remember to vote!

Re: About docbot

From
"Joshua D. Drake"
Date:
Magnus Hagander wrote:
>>> Sounds iffy to me.   Lending the hostname makes this an official
>> (or
>>> officially endorsed) thing.  Would it be branded and such the
>> same as
>>> the main website?
>
> Also, we have been working hard to *decrease* the number of distinct
> websites in the PostgreSQL domain. So please let's try to avoid adding
> another one if we can.
>
> Now, *assuming* this is a service that we want on the main site (I'm not
> taking position on that yet, but it does seem pretty nifty), wouldn't
> the logical place be to have it on http://search.postgresql.org, along
> with the standard search?

Oh that is interesting... we could certainly do that.

Joshua D. Drake



--

    === The PostgreSQL Company: Command Prompt, Inc. ===
Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
    Providing the most comprehensive  PostgreSQL solutions since 1997
              http://www.commandprompt.com/



Re: About docbot

From
"Magnus Hagander"
Date:
> > Where does it actually *live* today? Meaning where is the database
> > located, where does the IRC bot run, etc?
>
> Daniel (Primer) Ceregatti hosts the database on sh.nu, and Andreas
> (ads) Scherbaum hosts the bot code on base.wars-nicht.de.
> Both could change if needed.

Ok. Methinks that if we want to stick it on our search website, the
database needs to be moved to that machine. We could of course just set
up a Slony replica of it, I don't suppose it gets a lot of write
traffic?


I'd really like to hear the input from some of the others on the web
team as well :-) I think it sounds like a good idea in principle, but
there are others... ,)


//Magnus

Re: About docbot

From
Andreas 'ads' Scherbaum
Date:
On Wed, 27 Sep 2006, Magnus Hagander wrote:

>>> Where does it actually *live* today? Meaning where is the database
>>> located, where does the IRC bot run, etc?
>>
>> Daniel (Primer) Ceregatti hosts the database on sh.nu, and Andreas
>> (ads) Scherbaum hosts the bot code on base.wars-nicht.de.
>> Both could change if needed.
>
> Ok. Methinks that if we want to stick it on our search website, the
> database needs to be moved to that machine. We could of course just set
> up a Slony replica of it, I don't suppose it gets a lot of write
> traffic?

This could be the test setup for Slony, David Fetter is always
talking about ;-)
And no, write traffic is marginal. Just if someone changes a dataset.


> I'd really like to hear the input from some of the others on the web
> team as well :-) I think it sounds like a good idea in principle, but
> there are others... ,)

Good point, i like the idea.


Kind regards

--
                 Andreas 'ads' Scherbaum
<Shadda> Explaining the concept of referential integrity to a mysql user is
          like explaining condoms to a catholic

Re: About docbot

From
David Fetter
Date:
On Wed, Sep 27, 2006 at 09:47:26AM +0200, Magnus Hagander wrote:
> > > Where does it actually *live* today? Meaning where is the
> > > database located, where does the IRC bot run, etc?
> >
> > Daniel (Primer) Ceregatti hosts the database on sh.nu, and Andreas
> > (ads) Scherbaum hosts the bot code on base.wars-nicht.de.  Both
> > could change if needed.
>
> Ok. Methinks that if we want to stick it on our search website, the
> database needs to be moved to that machine. We could of course just
> set up a Slony replica of it, I don't suppose it gets a lot of write
> traffic?

It gets so little write traffic that it would make a great testbed for
a multi-master replication system :)

Cheers,
D
--
David Fetter <david@fetter.org> http://fetter.org/
phone: +1 415 235 3778        AIM: dfetter666
                              Skype: davidfetter

Remember to vote!

Re: About docbot

From
Robert Treat
Date:
On Wednesday 27 September 2006 03:47, Magnus Hagander wrote:
> > > Where does it actually *live* today? Meaning where is the database
> > > located, where does the IRC bot run, etc?
> >
> > Daniel (Primer) Ceregatti hosts the database on sh.nu, and Andreas
> > (ads) Scherbaum hosts the bot code on base.wars-nicht.de.
> > Both could change if needed.
>
> Ok. Methinks that if we want to stick it on our search website, the
> database needs to be moved to that machine. We could of course just set
> up a Slony replica of it, I don't suppose it gets a lot of write
> traffic?
>
>
> I'd really like to hear the input from some of the others on the web
> team as well :-) I think it sounds like a good idea in principle, but
> there are others... ,)
>
http://archives.postgresql.org/pgsql-www/2006-08/msg00019.php

--
Robert Treat
Build A Brighter LAMP :: Linux Apache {middleware} PostgreSQL

Re: About docbot

From
Andreas 'ads' Scherbaum
Date:
On Wed, 27 Sep 2006 09:47:26 +0200
"Magnus Hagander" <mha@sollentuna.net> wrote:

Hello everyone,

> > > Where does it actually *live* today? Meaning where is the database
> > > located, where does the IRC bot run, etc?
> >
> > Daniel (Primer) Ceregatti hosts the database on sh.nu, and Andreas
> > (ads) Scherbaum hosts the bot code on base.wars-nicht.de.
> > Both could change if needed.
>
> Ok. Methinks that if we want to stick it on our search website, the
> database needs to be moved to that machine. We could of course just set
> up a Slony replica of it, I don't suppose it gets a lot of write
> traffic?
>
>
> I'd really like to hear the input from some of the others on the web
> team as well :-) I think it sounds like a good idea in principle, but
> there are others... ,)

ok, what about this topic?
The consens sounded to me like using slony to replicate the bot db
to the website and display a prominent result set on top of the search
site.

Any intentions to move forward?


Kind regards

--
                Andreas 'ads' Scherbaum
Failure is not an option. It comes bundled with your Microsoft product.
 (Ferenc Mantfeld)

Re: About docbot

From
"Dave Page"
Date:

> -----Original Message-----
> From: pgsql-www-owner@postgresql.org
> [mailto:pgsql-www-owner@postgresql.org] On Behalf Of Andreas
> 'ads' Scherbaum
> Sent: 09 October 2006 00:44
> To: Magnus Hagander
> Cc: david@fetter.org; gmr@ehpg.net; jd@commandprompt.com;
> ads@pgug.de; pgsql-www@postgresql.org
> Subject: Re: [pgsql-www] About docbot
>
> > I'd really like to hear the input from some of the others on the web
> > team as well :-) I think it sounds like a good idea in
> principle, but
> > there are others... ,)
>
> ok, what about this topic?
> The consens sounded to me like using slony to replicate the bot db
> to the website and display a prominent result set on top of the search
> site.
>
> Any intentions to move forward?

Yes, I think so - but it's not going to happen overnight as the search
engine needs to be rewritten first. This is progressing very well, but
isn't there just yet.

Regards, Dave.

Re: About docbot

From
Robert Treat
Date:
On Monday 09 October 2006 03:28, Dave Page wrote:
> > -----Original Message-----
> > From: pgsql-www-owner@postgresql.org
> > [mailto:pgsql-www-owner@postgresql.org] On Behalf Of Andreas
> > 'ads' Scherbaum
> > Sent: 09 October 2006 00:44
> > To: Magnus Hagander
> > Cc: david@fetter.org; gmr@ehpg.net; jd@commandprompt.com;
> > ads@pgug.de; pgsql-www@postgresql.org
> > Subject: Re: [pgsql-www] About docbot
> >
> > > I'd really like to hear the input from some of the others on the web
> > > team as well :-) I think it sounds like a good idea in
> >
> > principle, but
> >
> > > there are others... ,)
> >
> > ok, what about this topic?
> > The consens sounded to me like using slony to replicate the bot db
> > to the website and display a prominent result set on top of the search
> > site.
> >
> > Any intentions to move forward?
>
> Yes, I think so - but it's not going to happen overnight as the search
> engine needs to be rewritten first. This is progressing very well, but
> isn't there just yet.
>

Dave, whats your opinion on moving the database completly onto the
postgresql.org server and doing away with the slony replication bit (which
seems like overkill imho)  We could then grant access to bots that need it or
provide a full fledged web api to people who want to interface with it. The
one thing I am wondering is that this would in theory be a higher load than
the current website gives, since all requests would run through the db.

--
Robert Treat
Build A Brighter LAMP :: Linux Apache {middleware} PostgreSQL

Re: About docbot

From
"Joshua D. Drake"
Date:
>>
>
> Dave, whats your opinion on moving the database completly onto the
> postgresql.org server and doing away with the slony replication bit (which
> seems like overkill imho)  We could then grant access to bots that need it or
> provide a full fledged web api to people who want to interface with it. The
> one thing I am wondering is that this would in theory be a higher load than
> the current website gives, since all requests would run through the db.

Actually not to worried about this one. I can always beef up the machine.

Sincerely,

Joshua D. Drake





--

   === The PostgreSQL Company: Command Prompt, Inc. ===
Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
   Providing the most comprehensive  PostgreSQL solutions since 1997
             http://www.commandprompt.com/



Re: About docbot

From
"Dave Page"
Date:

> -----Original Message-----
> From: Robert Treat [mailto:xzilla@users.sourceforge.net]
> Sent: 10 October 2006 03:17
> To: pgsql-www@postgresql.org
> Cc: Dave Page; Andreas 'ads' Scherbaum; Magnus Hagander;
> david@fetter.org; gmr@ehpg.net; jd@commandprompt.com; ads@pgug.de
> Subject: Re: [pgsql-www] About docbot
>
>
> Dave, whats your opinion on moving the database completly onto the
> postgresql.org server and doing away with the slony
> replication bit (which
> seems like overkill imho)  We could then grant access to bots
> that need it or
> provide a full fledged web api to people who want to
> interface with it. The
> one thing I am wondering is that this would in theory be a
> higher load than
> the current website gives, since all requests would run
> through the db.

That does sound like a better idea to me... though it should go on the
search server, not borg  because it'll generally be used with the search
engine. I assume the load is likely to be far less than the GIN/Tsearch
engine that Magnus is currently developing?

Regards Dave

Re: About docbot

From
Andreas 'ads' Scherbaum
Date:
On Mon, 9 Oct 2006 01:43:54 +0200
Andreas 'ads' Scherbaum <adsmail@wars-nicht.de> wrote:

Hello all,

> On Wed, 27 Sep 2006 09:47:26 +0200
> "Magnus Hagander" <mha@sollentuna.net> wrote:
>
> > > > Where does it actually *live* today? Meaning where is the database
> > > > located, where does the IRC bot run, etc?
> > >
> > > Daniel (Primer) Ceregatti hosts the database on sh.nu, and Andreas
> > > (ads) Scherbaum hosts the bot code on base.wars-nicht.de.
> > > Both could change if needed.
> >
> > Ok. Methinks that if we want to stick it on our search website, the
> > database needs to be moved to that machine. We could of course just set
> > up a Slony replica of it, I don't suppose it gets a lot of write
> > traffic?
> >
> >
> > I'd really like to hear the input from some of the others on the web
> > team as well :-) I think it sounds like a good idea in principle, but
> > there are others... ,)
>
> ok, what about this topic?
> The consens sounded to me like using slony to replicate the bot db
> to the website and display a prominent result set on top of the search
> site.
>
> Any intentions to move forward?

We just had the discussion on IRC and i was told to remind -www about
this question ;-) Is there anything we can use or setup right now?


Kind regards

--
                Andreas 'ads' Scherbaum
Failure is not an option. It comes bundled with your Microsoft product.
 (Ferenc Mantfeld)

Re: About docbot

From
"Joshua D. Drake"
Date:
>>> I'd really like to hear the input from some of the others on the web
>>> team as well :-) I think it sounds like a good idea in principle, but
>>> there are others... ,)
>> ok, what about this topic?
>> The consens sounded to me like using slony to replicate the bot db
>> to the website and display a prominent result set on top of the search
>> site.
>>
>> Any intentions to move forward?
>
> We just had the discussion on IRC and i was told to remind -www about
> this question ;-) Is there anything we can use or setup right now?

I thought Robert Treat was working on this?

Joshua D. Drake

>
>
> Kind regards
>


--

      === The PostgreSQL Company: Command Prompt, Inc. ===
Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
Providing the most comprehensive  PostgreSQL solutions since 1997
             http://www.commandprompt.com/

Donate to the PostgreSQL Project: http://www.postgresql.org/about/donate
PostgreSQL Replication: http://www.commandprompt.com/products/