Looks recent commits to alert css broke the fading out animation layout.
Steps to re-produce (tested on Chrome & FF):
1) Open query tool
2) Execute 'select 1;'
3) Alert will displays properly but now take a closer look when alert fades out from screen, icon goes on top of alert message and layout becomes kind of square shape.