This is a perpetual problem. Scaling is a one-way thing that affects the whole model and has no "undo". For models I've had to scale I've taken to making a note of it as comments in the Relations.
Alternative documentation hacks I've used are to make a drawing annotation feature and put a blurb of text in there about the scale, name the feature something meaningful like "SCALING-INFO", and hide it, so it's still in the model tree but not splattered over the model geometry.
I could also maybe have a parameter like "scaleModel" and store the scale factor there for posterity.
None of these is "automatic" in that they all rely on me typing in the correct numbers and keeping them updated as necessary in a manual fashion, but it's better than nothing.