Thread: Counting clicks, Download page?
Folks, Is there any way we can log the number of times people request an FTP mirror from the download mirrors page? While it wouldn't be an accurate count of downloads, it would give us better numbers than we have now. Thoughts? -- --Josh Josh Berkus Aglio Database Solutions San Francisco
Maybe a good way is to create a simple perl script that counts out of some standard logfile formats and provides the numbers in a file that would be accessable but hidden in the ftp file structure... maybe .stats or something... then we could easily make a ftp script to retrive the information for a stats page. If we agree that it's something that we'll ask/require our mirrors to use on a crontab, I'll be happy to code something that works against proftp and apache, with abstraction for the regex to split out the data. Gavin Josh Berkus wrote: >Folks, > >Is there any way we can log the number of times people request an FTP mirror >from the download mirrors page? While it wouldn't be an accurate count of >downloads, it would give us better numbers than we have now. > >Thoughts? > > >
Gavin, > If we agree that it's something that > we'll ask/require our mirrors to use on a crontab, We can ask, but only a few will cooperate. Our biggest mirrors are university sites who won't run anything -- at least, that's what I've been told. -- --Josh Josh Berkus Aglio Database Solutions San Francisco
we could do something similar to what justin had done with techdocs, and 'wrapper' the redirect to the ftp site in a php/perl script that logs the click thru to the mirror ... same could be done with the www mirrors also ... the 'link' would just have to point back to scripts.postgresql.org ... On Sun, 21 Nov 2004, Josh Berkus wrote: > Folks, > > Is there any way we can log the number of times people request an FTP mirror > from the download mirrors page? While it wouldn't be an accurate count of > downloads, it would give us better numbers than we have now. > > Thoughts? > > -- > --Josh > > Josh Berkus > Aglio Database Solutions > San Francisco > > ---------------------------(end of broadcast)--------------------------- > TIP 4: Don't 'kill -9' the postmaster > ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664
Josh Berkus wrote: >Folks, > >Is there any way we can log the number of times people request an FTP mirror >from the download mirrors page? While it wouldn't be an accurate count of >downloads, it would give us better numbers than we have now. > > Why don't we do it the way PHP does it. They have a link goes to itself with some get parameters and then referrs to the real download site. This would allow us to easily keep track of the specific clicks. J >Thoughts? > > > -- Command Prompt, Inc., home of Mammoth PostgreSQL - S/ODBC and S/JDBC Postgresql support, programming shared hosting and dedicated hosting. +1-503-667-4564 - jd@commandprompt.com - http://www.commandprompt.com PostgreSQL Replicator -- production quality replication for PostgreSQL
Attachment
Nope, not as it stands. Virtually everything is static HTML now for speed and mirror-ability. If you want to log ftp mirrorselections, then it'll need to go back to being a php script on one server, giving us a single point of failure onperhaps the second most important part of the site (next to the front page). /D -----Original Message----- From: pgsql-www-owner@postgresql.org on behalf of Josh Berkus Sent: Mon 11/22/2004 12:11 AM To: pgsql-www@postgresql.org Subject: [pgsql-www] Counting clicks, Download page? Folks, Is there any way we can log the number of times people request an FTP mirror from the download mirrors page? While it wouldn't be an accurate count of downloads, it would give us better numbers than we have now. Thoughts? -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---------------------------(end of broadcast)--------------------------- TIP 4: Don't 'kill -9' the postmaster
-----Original Message----- From: pgsql-www-owner@postgresql.org on behalf of Josh Berkus Sent: Mon 11/22/2004 12:32 AM To: Gavin M. Roy Cc: pgsql-www@postgresql.org Subject: Re: [pgsql-www] Counting clicks, Download page? Gavin, > If we agree that it's something that > we'll ask/require our mirrors to use on a crontab, > We can ask, but only a few will cooperate. Our biggest mirrors are university > sites who won't run anything -- at least, that's what I've been told. Yes, thats what I've found in the past. Only the smaller mirrors will help out - mainly because they're run by fans of theproject. The bigger ones mirror tens or even hundreds of sites, and simply don't start mucking about with stats for us. Regards, Dave
Hi, Dave Page wrote: > Nope, not as it stands. Virtually everything is static HTML now for speed and mirror-ability. If you want to log ftp mirrorselections, then it'll need to go back to being a php script on one server, giving us a single point of failure onperhaps the second most important part of the site (next to the front page). In fact the mirror selection page now *should* be a dynamic page on one server only (and that's the main reason I am so concerned about that server's performance). In any other case you'll *not* be able to use ip2country. But current implementation of mirror selection will not give any useful stats: it will only show how many people went to an FTP mirror, not whether they actually downloaded something.
It could be done without touching pages, just configure mod_rewrite
properly. I think it's not difficult for mirrors add several lines
to httpd.conf
Oleg
On Mon, 22 Nov 2004, Dave Page wrote:
> Nope, not as it stands. Virtually everything is static HTML now for speed and mirror-ability. If you want to log ftp
mirrorselections, then it'll need to go back to being a php script on one server, giving us a single point of failure
onperhaps the second most important part of the site (next to the front page).
>
> /D
>
>
> -----Original Message-----
> From: pgsql-www-owner@postgresql.org on behalf of Josh Berkus
> Sent: Mon 11/22/2004 12:11 AM
> To: pgsql-www@postgresql.org
> Subject: [pgsql-www] Counting clicks, Download page?
>
> Folks,
>
> Is there any way we can log the number of times people request an FTP mirror
> from the download mirrors page? While it wouldn't be an accurate count of
> downloads, it would give us better numbers than we have now.
>
> Thoughts?
>
>
Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, sci.researcher, hostmaster of AstroNet,
Sternberg Astronomical Institute, Moscow University (Russia)
Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/
phone: +007(095)939-16-83, +007(095)939-23-83
On Mon, 22 Nov 2004, Dave Page wrote: > Nope, not as it stands. Virtually everything is static HTML now for > speed and mirror-ability. If you want to log ftp mirror selections, then > it'll need to go back to being a php script on one server, giving us a > single point of failure on perhaps the second most important part of the > site (next to the front page). I thought that all mirrors had a requirement to have php enabled? could we do an email->database gateway, where the mirror would email in stats that a script on the server side could then parse and dump into the database? the other option would be a php script that checked if scripts.postgresql.org was reachable, and if so, did a GET request to do the dump before redirecting to the mirror itself ... assuming a fairly short timeout on the check ... > > /D > > > -----Original Message----- > From: pgsql-www-owner@postgresql.org on behalf of Josh Berkus > Sent: Mon 11/22/2004 12:11 AM > To: pgsql-www@postgresql.org > Subject: [pgsql-www] Counting clicks, Download page? > > Folks, > > Is there any way we can log the number of times people request an FTP mirror > from the download mirrors page? While it wouldn't be an accurate count of > downloads, it would give us better numbers than we have now. > > Thoughts? > > -- > --Josh > > Josh Berkus > Aglio Database Solutions > San Francisco > > ---------------------------(end of broadcast)--------------------------- > TIP 4: Don't 'kill -9' the postmaster > > > ---------------------------(end of broadcast)--------------------------- > TIP 3: if posting/reading through Usenet, please send an appropriate > subscribe-nomail command to majordomo@postgresql.org so that your > message can get through to the mailing list cleanly > ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664
Alexey, > But current implementation of mirror selection will not give any useful > stats: it will only show how many people went to an FTP mirror, not > whether they actually downloaded something. Yeah, but that's more information than we have now. -- Josh Berkus Aglio Database Solutions San Francisco
> -----Original Message----- > From: Alexey Borzov [mailto:borz_off@cs.msu.su] > Sent: 22 November 2004 11:00 > To: Dave Page > Cc: josh@agliodbs.com; pgsql-www@postgresql.org > Subject: Re: [pgsql-www] Counting clicks, Download page? > > Hi, > > Dave Page wrote: > > Nope, not as it stands. Virtually everything is static HTML > now for speed and mirror-ability. If you want to log ftp > mirror selections, then it'll need to go back to being a php > script on one server, giving us a single point of failure on > perhaps the second most important part of the site (next to > the front page). > > In fact the mirror selection page now *should* be a dynamic > page on one server only (and that's the main reason I am so > concerned about that server's performance). Don't worry about that - it's in hand. > In any other case > you'll *not* be able to use ip2country. As I vaguely seem to recall stating at the time it was implemented. It's only a minor convenience thing (seeing as most ppl know their own country), and puts both load on the server, and creates a single point of failure. > But current implementation of mirror selection will not give > any useful > stats: it will only show how many people went to an FTP > mirror, not whether they actually downloaded something. Agreed. Regards, Dave.
> -----Original Message----- > From: Marc G. Fournier [mailto:scrappy@postgresql.org] > Sent: 22 November 2004 16:25 > To: Dave Page > Cc: josh@agliodbs.com; pgsql-www@postgresql.org > Subject: Re: [pgsql-www] Counting clicks, Download page? > > I thought that all mirrors had a requirement to have php > enabled? No, not for years. And many now don't. Regards, Dave.