Thread: Re: Mailing list archives (was Re: [HACKERS] mailing list archiver chewing patches)

On Sat, May 1, 2010 at 20:16, Matteo Beccati <php@beccati.com> wrote:
> Hi everyone,
>
> (moving the old -hackers thread to pgsql-www as it's more relevant)
>
> I'm sorry but since I last posted an update on -hackers, I haven't had time
> to keep working on the proof of concept of the new mailing list archive.
>
> For those not involved in the previous thread it is a small app built on top
> of archiveopterix (AOX), that has full thread support and can display the
> archives by using some fancy JS but also being search engine and non-JS
> friendly.
>
> The logic is entirely on the database (will apart AOX itself) and the UI was
> built using PHP and symfony, thus it will need to be ported to python/django
> at some point.
>
> I've been approached by Alvaro and we were finally able to discuss about the
> project. I think we've been able to make some progress understating how we
> can integrate the new archive with majordomo. He was kind enough to
> volunteer for reviewing the current code, and I will shortly provide all the
> information required for him to begin.
>
> Now, my biggest concern is... will someone step in for porting the app to
> the new website framework?

Yes. I can definitely do this, if nobody else does first.

Unfortunately it's blocked behind some other work (both website and
infrastructure - we need something to put it on..), but I think once
the rest of the framework is done, and as you say the logic is in AOX,
the porting part is not likely to take much time.

It would be good if it's already in the web *layout* framework before
that happens though, because that's the part that would take a really
long time for me. Meaning using the same HTML and CSS framework. And
that will be 100% the same regardless of which execution framework is
used.

-- Magnus HaganderMe: http://www.hagander.net/Work: http://www.redpill-linpro.com/


On Sat, May 1, 2010 at 11:19 AM, Magnus Hagander <magnus@hagander.net> wrote:

> It would be good if it's already in the web *layout* framework before
> that happens though, because that's the part that would take a really
> long time for me. Meaning using the same HTML and CSS framework. And
> that will be 100% the same regardless of which execution framework is
> used.

I can assist with this task.

Matteo - can you point me to relevant threads or code to download to
generate the output? Or just some example output?

-selena

-- 
http://chesnok.com/daily - me
http://endpoint.com - work


Re: Re: Mailing list archives

From
Dimitri Fontaine
Date:
Selena Deckelmann <selenamarie@gmail.com> writes:
> Matteo - can you point me to relevant threads or code to download to
> generate the output? Or just some example output?
 http://archives.beccati.org/ http://archives.beccati.org/pgsql-hackers/message/266795

For a random specific mail example.

Regards,
-- 
dim

Not yet subscribed to the www mailing list.


Re: Re: Mailing list archives

From
Magnus Hagander
Date:
On Mon, May 3, 2010 at 18:32, Dimitri Fontaine <dfontaine@hi-media.com> wrote:
> Selena Deckelmann <selenamarie@gmail.com> writes:
>> Matteo - can you point me to relevant threads or code to download to
>> generate the output? Or just some example output?
>
>  http://archives.beccati.org/
>  http://archives.beccati.org/pgsql-hackers/message/266795
>
> For a random specific mail example.

Whoa. Clearly I have to withdraw my previous comment. I missed the
version that *was* integrated with the website looks. There are still
some things to add though (for example, no link back to the thread
index from that details page), but it's further along than I thought.
My apologies.


-- Magnus HaganderMe: http://www.hagander.net/Work: http://www.redpill-linpro.com/


Re: Re: Mailing list archives

From
Matteo Beccati
Date:
On 03/05/2010 18:35, Magnus Hagander wrote:
> On Mon, May 3, 2010 at 18:32, Dimitri Fontaine<dfontaine@hi-media.com>  wrote:
>> Selena Deckelmann<selenamarie@gmail.com>  writes:
>>> Matteo - can you point me to relevant threads or code to download to
>>> generate the output? Or just some example output?
>>
>>   http://archives.beccati.org/
>>   http://archives.beccati.org/pgsql-hackers/message/266795
>>
>> For a random specific mail example.
>
> Whoa. Clearly I have to withdraw my previous comment. I missed the
> version that *was* integrated with the website looks. There are still
> some things to add though (for example, no link back to the thread
> index from that details page), but it's further along than I thought.
> My apologies.

No worries!

The link is there (at the bottom), but it currently points to the non-JS 
threaded view. The whole HTML/JS still needs some love of course.

And BTW, retrieval by message ID works too:

http://archives.beccati.org/message-id/87aasljpog.fsf@hi-media-techno.com

to get a recent random message from Dimitri to -hackers.


Cheers
-- 
Matteo Beccati

Development & Consulting - http://www.beccati.com/


On 03/05/2010 18:07, Selena Deckelmann wrote:
> On Sat, May 1, 2010 at 11:19 AM, Magnus Hagander<magnus@hagander.net>  wrote:
>
>> It would be good if it's already in the web *layout* framework before
>> that happens though, because that's the part that would take a really
>> long time for me. Meaning using the same HTML and CSS framework. And
>> that will be 100% the same regardless of which execution framework is
>> used.
>
> I can assist with this task.
>
> Matteo - can you point me to relevant threads or code to download to
> generate the output? Or just some example output?

I think I did reply with some info some time ago. Any news on this?

I don't mean to pressure or something, just trying to understand if I 
can help in any way :)


Cheers
-- 
Matteo Beccati

Development & Consulting - http://www.beccati.com/


On Sun, May 23, 2010 at 18:33, Matteo Beccati <php@beccati.com> wrote:
> On 03/05/2010 18:07, Selena Deckelmann wrote:
>>
>> On Sat, May 1, 2010 at 11:19 AM, Magnus Hagander<magnus@hagander.net>
>>  wrote:
>>
>>> It would be good if it's already in the web *layout* framework before
>>> that happens though, because that's the part that would take a really
>>> long time for me. Meaning using the same HTML and CSS framework. And
>>> that will be 100% the same regardless of which execution framework is
>>> used.
>>
>> I can assist with this task.
>>
>> Matteo - can you point me to relevant threads or code to download to
>> generate the output? Or just some example output?
>
> I think I did reply with some info some time ago. Any news on this?

I *think* this one was directed at Selena and not me, correct? Selena - ping?

If it was at me, apologies for not getting back sooner, and can you
please outline exactly what you mean? ;) In "my book" it's still
backlogged behind the new website infrastructure stuff, which has been
delayed far beyond the point of embarassment, but certainly not
abandoned...

-- Magnus HaganderMe: http://www.hagander.net/Work: http://www.redpill-linpro.com/


Hi Magnus,

>>> Matteo - can you point me to relevant threads or code to download to
>>> generate the output? Or just some example output?
>>
>> I think I did reply with some info some time ago. Any news on this?
>
> I *think* this one was directed at Selena and not me, correct? Selena - ping?
>
> If it was at me, apologies for not getting back sooner, and can you
> please outline exactly what you mean? ;) In "my book" it's still
> backlogged behind the new website infrastructure stuff, which has been
> delayed far beyond the point of embarassment, but certainly not
> abandoned...

Yes, this was mainly for Selena, just to touch base and see if there has 
been any progress or if she needed further help from me. Sorry about the 
misunderstanding.


Cheers
-- 
Matteo Beccati

Development & Consulting - http://www.beccati.com/


Re: Re: Mailing list archives

From
David Fetter
Date:
On Mon, May 03, 2010 at 06:55:39PM +0200, Matteo Beccati wrote:
> On 03/05/2010 18:35, Magnus Hagander wrote:
> >On Mon, May 3, 2010 at 18:32, Dimitri Fontaine<dfontaine@hi-media.com>  wrote:
> >>Selena Deckelmann<selenamarie@gmail.com>  writes:
> >>>Matteo - can you point me to relevant threads or code to download to
> >>>generate the output? Or just some example output?
> >>
> >>  http://archives.beccati.org/

This looks super great!

What do we need in order to get this up and running on the official
site?

Cheers,
David.
-- 
David Fetter <david@fetter.org> http://fetter.org/
Phone: +1 415 235 3778  AIM: dfetter666  Yahoo!: dfetter
Skype: davidfetter      XMPP: david.fetter@gmail.com
iCal: webcal://www.tripit.com/feed/ical/people/david74/tripit.ics

Remember to vote!
Consider donating to Postgres: http://www.postgresql.org/about/donate


Re: Re: Mailing list archives

From
Alvaro Herrera
Date:
Excerpts from David Fetter's message of dom nov 21 17:06:23 -0300 2010:
> On Mon, May 03, 2010 at 06:55:39PM +0200, Matteo Beccati wrote:

> > >>  http://archives.beccati.org/
> 
> This looks super great!

Yeah

> What do we need in order to get this up and running on the official
> site?

At this point I think it should be reworked for the new site
infrastructure, i.e. ported to Django.  We could air it soon after the
new pgweb is up and running.

Also there was a technical problem with an email that was working
correctly (no text displayed).  Matteo was going to look into that
AFAIK.

-- 
Álvaro Herrera <alvherre@commandprompt.com>
The PostgreSQL Company - Command Prompt, Inc.
PostgreSQL Replication, Consulting, Custom Development, 24x7 support


Re: Re: Mailing list archives

From
Matteo Beccati
Date:
Hi,

On 22/11/2010 01:39, Alvaro Herrera wrote:
> Excerpts from David Fetter's message of dom nov 21 17:06:23 -0300 2010:
>> On Mon, May 03, 2010 at 06:55:39PM +0200, Matteo Beccati wrote:
> 
>>>>>  http://archives.beccati.org/
>>
>> This looks super great!
> 
> Yeah

Thanks guys. I appreciate your support!

>> What do we need in order to get this up and running on the official
>> site?
> 
> At this point I think it should be reworked for the new site
> infrastructure, i.e. ported to Django.  We could air it soon after the
> new pgweb is up and running.
> 
> Also there was a technical problem with an email that was working
> correctly (no text displayed).  Matteo was going to look into that
> AFAIK.

I've looked into it and the issue is that I'm displaying only part "1",
whereas that email had a multipart/alternative format with parts "1.1"
and "1.2". When we get closer to getting the code to production, we can
think about fixing it. For now I've saved a reference to the issue in my
own bug tracker -- I will email credentials separately.


Cheers
-- 
Matteo Beccati

Development & Consulting - http://www.beccati.com/


Re: Re: Mailing list archives

From
Rob Wultsch
Date:
On Sun, Nov 21, 2010 at 1:06 PM, David Fetter <david@fetter.org> wrote:
> On Mon, May 03, 2010 at 06:55:39PM +0200, Matteo Beccati wrote:
>> On 03/05/2010 18:35, Magnus Hagander wrote:
>> >On Mon, May 3, 2010 at 18:32, Dimitri Fontaine<dfontaine@hi-media.com>  wrote:
>> >>Selena Deckelmann<selenamarie@gmail.com>  writes:
>> >>>Matteo - can you point me to relevant threads or code to download to
>> >>>generate the output? Or just some example output?
>> >>
>> >>  http://archives.beccati.org/
>
> This looks super great!
>

And unlike the current version, is not broken for IE 8.
--
Rob Wultsch
wultsch@gmail.com


Re: Re: Mailing list archives

From
Robert Haas
Date:
On Sun, Nov 21, 2010 at 11:48 PM, Matteo Beccati <php@beccati.com> wrote:
> I've looked into it and the issue is that I'm displaying only part "1",
> whereas that email had a multipart/alternative format with parts "1.1"
> and "1.2". When we get closer to getting the code to production, we can
> think about fixing it.

When will we get closer to getting the code to production?

-- 
Robert Haas
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company


Re: Re: Mailing list archives

From
Matteo Beccati
Date:
On 24/11/2010 14:33, Robert Haas wrote:
> On Sun, Nov 21, 2010 at 11:48 PM, Matteo Beccati <php@beccati.com> wrote:
>> I've looked into it and the issue is that I'm displaying only part "1",
>> whereas that email had a multipart/alternative format with parts "1.1"
>> and "1.2". When we get closer to getting the code to production, we can
>> think about fixing it.
> 
> When will we get closer to getting the code to production?

What you see is a proof of concept, based on archiveopterix plus a bunch
of custom tables and triggers with a php/symfony frontend on top.

The web frontend will need to be ported to django. That of course won't
happen before the new django based website is ready. No idea about when
that will happen though. I'll be happy to dedicate some time for bug
fixing and improvements once we get closer to it.


Cheers
-- 
Matteo Beccati

Development & Consulting - http://www.beccati.com/