Ran into a problem building a treehouse where the hitbox of the tree trunk was far bigger than the visible tree trunk. Thus, I was unable to get to a ghost floor I had placed to either build or delete it, leaving an annoyingly permanent HUD indicator.
Granted, the tree trunk hitbox is just a straight bug, but regardless I see no reason why the ability to delete ghost items isn't the same range as placing them.