I experimented a bit and it looks like ccache doesn't yet quite work in CI, but only because the ccache needs to be larger. Looks like we need about ~400MB.
A fully cached build is ~2min
Then I should increase CCACHE_MAXSIZE, right? Made it 500MB for MinGW.