On Mon, Nov 21, 2022 at 3:43 PM John Naylor
<john.naylor@enterprisedb.com> wrote:
>
> On Fri, Nov 18, 2022 at 8:20 PM Masahiko Sawada <sawada.mshk@gmail.com> wrote:
> >
> > On Thu, Nov 17, 2022 at 12:24 AM Masahiko Sawada <sawada.mshk@gmail.com> wrote:
> > >
> > > On Wed, Nov 16, 2022 at 4:39 PM John Naylor
> > > <john.naylor@enterprisedb.com> wrote:
>
> > > > That means my idea for the pointer struct might have some problems, at least as currently implemented. Maybe in
thecourse of separating out and polishing that piece, an inefficiency will fall out. Or, it might be another reason to
templatelocal and shared separately. Not sure yet. I also haven't tried to adjust this test for the shared memory case.
>
> Digging a bit deeper, I see a flaw in my benchmark: Even though the total distribution of node kinds is decently
even,the pattern that the benchmark sees is not terribly random:
>
> 3,343,352 branch-misses:u # 0.85% of all branches
> 393,204,959 branches:u
>
> Recall a previous benchmark [1] where the leaf node was about half node16 and half node32. Randomizing the leaf node
betweenthe two caused branch misses to go from 1% to 2%, causing a noticeable slowdown. Maybe in this new benchmark,
eachlevel has a skewed distribution of nodes, giving a smart branch predictor something to work with. We will need a
wayto efficiently generate keys that lead to a relatively unpredictable distribution of node kinds, as seen by a
searcher.Especially in the leaves (or just above the leaves), since those are less likely to be cached.
>
> > > I'll also run the test on my environment and do the investigation tomorrow.
> > >
> >
> > FYI I've not tested the patch you shared today but here are the
> > benchmark results I did with the v9 patch in my environment (I used
> > the second filter). I splitted 0004 patch into two patches: a patch
> > for pure refactoring patch to introduce rt_node_ptr and a patch to do
> > pointer tagging.
>
> Would you be able to share the refactoring patch? And a fix for the failing tests? I'm thinking I want to try the
templatingapproach fairly soon.
>
Sure. I've attached the v10 patches. 0004 is the pure refactoring
patch and 0005 patch introduces the pointer tagging.
Regards,
--
Masahiko Sawada
Amazon Web Services: https://aws.amazon.com
