No, apparently that's what happens. In your activity it tells you your comment has been deleted but it is still there in comments and/or conversation I forget which, maybe both, on your PC/Tablet/whatever but not on anyone else's: weird I grant you.