Skip to main content
JA_107083511-Visitor
1-Visitor
Jun 6, 2023 5:52 PM UTC
Question

How do I get evaluation metrics on a separate dataset?

In Thingworx 9, I know that training a model will result in an automatically generated confusion matrix but is there a way to run another dataset through a model that is already trained, and get a confusion matrix on just the new dataset?

 

 

 

 

8 replies

nsampat17-Peridot
17-Peridot
Jun 6, 2023 6:17 PM UTC

@JA_10708351 ,

 

Are you able to elaborate on your use case here?

You can retrain a model based on updated datasets: https://support.ptc.com/help/thingworx/analytics/r9/en/#page/analytics/analytics_builder/retrain_model.html

 

You can append an existing dataset by uploading additional data: https://support.ptc.com/help/thingworx/analytics/r9/en/#page/analytics/analytics_builder/upload_additional_data.html

 

Generate Confidence Models for an Existing Predictive without retraining the Model: https://support.ptc.com/help/thingworx/analytics/r9/en/#page/analytics/twxa_funtionality/generate_confidence_for_existing_model.html

 

Though the most direct way to train a new model with a new dataset is to upload it and train on that dataset itself.

 

Regards,

 

Neel

 

Translate
JA_107083511-VisitorAuthor
1-Visitor
Jun 6, 2023 8:13 PM UTC

Basically, is there a way to train a model on dataset A, but get the confusion matrix of the model predicting on a different dataset B?

Translate
nsampat17-Peridot
17-Peridot
Jun 6, 2023 8:29 PM UTC

@JA_10708351 ,

 

Essentially, the Confusion Matrix is created at time of model creation.

 

It is dependent on the data supplied at time of creation, and currently there is no process to guarantee the same confusion matrix for a different dataset/model

 

The Retraining of the model using Additional Data (info linked in my original comment) would be the closest to your use case.

 

Regards,

 

Neel

Translate
Terms & ConditionsAccessibility statement