It's a good idea to do it in public if the person you're breaking up with is "volatile". They're much less likely to throw a violent tantrum in public than if you were at home alone. 

Also, if they do start throwing/breaking stuff a) It's not your stuff and b) there's plenty of witnesses/CCTV