ok. I would like to make a feature request for that, because often times someone might engineer the data in python or something, but want evaluation metrics/decision matrix on the un-engineered data. For example, if I upsampled something that was easy to predict, then running evaluation metrics on that upsampled data (instead of untouched data) would make the metrics look artificially high, and the decision matrix would be artificially good, etc.
