Neil Conway <neilc@samurai.com> writes:
> your handwaving has yet to convince me :)
Zing ;-)
I'm too tired to think about this more tonight, but it seems like
the basic point is that we can't just construct a list of pointers
into (a copy of) the original input string. A certain amount of
data copying is going to have to occur; or else we change the
token matching code to not assume null-termination.
regards, tom lane