Skip to main content
J
JA_107083511-Visitor
1-Visitor
June 6, 2023
Question

How do I get evaluation metrics on a separate dataset?

  • June 6, 2023
  • 1 reply
  • 2808 views

In Thingworx 9, I know that training a model will result in an automatically generated confusion matrix but is there a way to run another dataset through a model that is already trained, and get a confusion matrix on just the new dataset?

 

 

 

 

1 reply

N
nsampat17-Peridot
17-Peridot
June 6, 2023

@JA_10708351 ,

 

Are you able to elaborate on your use case here?

You can retrain a model based on updated datasets: https://support.ptc.com/help/thingworx/analytics/r9/en/#page/analytics/analytics_builder/retrain_model.html

 

You can append an existing dataset by uploading additional data: https://support.ptc.com/help/thingworx/analytics/r9/en/#page/analytics/analytics_builder/upload_additional_data.html

 

Generate Confidence Models for an Existing Predictive without retraining the Model: https://support.ptc.com/help/thingworx/analytics/r9/en/#page/analytics/twxa_funtionality/generate_confidence_for_existing_model.html

 

Though the most direct way to train a new model with a new dataset is to upload it and train on that dataset itself.

 

Regards,

 

Neel

 

J
JA_107083511-VisitorAuthor
1-Visitor
June 6, 2023

Basically, is there a way to train a model on dataset A, but get the confusion matrix of the model predicting on a different dataset B?

N
nsampat17-Peridot
17-Peridot
June 6, 2023

@JA_10708351 ,

 

Essentially, the Confusion Matrix is created at time of model creation.

 

It is dependent on the data supplied at time of creation, and currently there is no process to guarantee the same confusion matrix for a different dataset/model

 

The Retraining of the model using Additional Data (info linked in my original comment) would be the closest to your use case.

 

Regards,

 

Neel

Terms & ConditionsCookie settingsAccessibility statement