Community Tip - Did you get an answer that solved your problem? Please mark it as an Accepted Solution so others with the same problem can find the answer easily. X
You can select dimensions and remove them from the layer(s) you don't want them on.
Since they were effectively manually added, as opposed to being there by configurable rule, it requires manual removal.
I think there is no 'remove unwanted objects from layer' setting.
You can create and save a Search query to use with a mapkey to make the process a little less onerous.