This page isn't relevant to the discussion at hand as it doesn't have anything to do with large objects. Whether it should would be a different complaint.
When deleting a row that references (contains) a large object, I think that most users expect the DBMS to take care of the, now unreferenced, BLOB.
On what grounds? To me this looks just like any other foreign key situation and removing FK rows does not impact the PK. What would lead one to think large objects behave differently?