Since the final state of your table will be "logged" relying on the above optimization is the correct path, if you enable "logged" at the end, even with wal_level=minimal, you do not benefit from the optimization and thus your data ends up being written to WAL.
Otherwise, it is overall time that matters, it's no use boasting the COPY is fast if you end up spending hours waiting for ALTER TABLE at the end.
