Actually another possibility would be to remove the REFRESH keyword completely and just have [ WITH (...) ] and have the refresh option there, ie simplified version of what you have suggested (without the ugliness of specifying refresh twice to disable).
It will cause confusion. It seems that WITH sets ALTER SUBSCRIPTION properties. Indeed, they are REFRESH properties. I think we shouldn't exclude REFRESH keyword. Syntax leaves no doubt that WITH are REFRESH properties.