Community Tip - You can Bookmark boards, posts or articles that you'd like to access again easily! X
You can select dimensions and remove them from the layer(s) you don't want them on.
Since they were effectively manually added, as opposed to being there by configurable rule, it requires manual removal.
I think there is no 'remove unwanted objects from layer' setting.
You can create and save a Search query to use with a mapkey to make the process a little less onerous.