Skip to main content
1-Visitor
January 18, 2018
Question

ROC and Confustion Matrix failed with wrong values

  • January 18, 2018
  • 2 replies
  • 11567 views

Hi,

I'm working with Analytics 8.1 and get strange results with my data. To find the problem I try the "Analytics Builder Quickstart" tutorial with the vibrations data. Everything works find until the step "Generate and Enhance Model". The Model will be build but all ROC values and the Confusion Matrix are wrong.

The other stuff Profiles and Signales are ok.

2 replies

19-Tanzanite
January 18, 2018

Hi David

Could you please clarify at what step of "Generate and Enhance Model you get this result.

Is it at the first model creation or after some of the revise steps ?

Also could you please attach the screenshot of:

- Help > About from Composer

- Settings > Verify Configuration from Builder

- Model Details in Builder form the view page of the model as seen in your screenshot

- Model Configuration  in Builder form the view page of the model as seen in your screenshot

We can then test here with the same version to check if we see the same thing.

Regards

Christophe

drichter1-VisitorAuthor
1-Visitor
January 19, 2018

Hi Christophe,

this result comes by creating the model, but also by enhance the model.

Help > About from Composer (Version: 8.1.1-b108)

Settings > Verify Configuration from Builder (Version: 8.1.040000)

Model Details

Model Configuration

So I hope this is helpful.

19-Tanzanite
January 19, 2018

Hi David

Thank you for this.

Regardign the Model Details screenshot, the one you posted is not theone I wanted. The one you posted is the Model Job details, but I am after the model details. you can find it by:

- selecting the model in the model list page

- select View

- select the Model Details button

Also could you please, send screenshots of your extensions : in Composer Import/Export > Manage

Thank you

Kind rgeards

Christophe

17-Peridot
February 6, 2018

Christophe Morfin

I've just installed TW Foundation + TW Analytics and got the same result as before.

19-Tanzanite
February 6, 2018

Hi Dmitry

Just to clarify, when you say you installed Foundation and Analytics, do you mean release 8.2 of both software ?

If yes did you install release 8.2 of the Analytics extension too ?

Could you maybe post a new screenshot of the result in 8.2 ?

Also could you clarify what deployment you used: native or docker and is it on Windows or Linux (in case there are some changes compare to your previous tests) ?

Note that 8.2 has a native Windows installer which can be of interest. You do need to be aware of article CS279183 though if you are using a non English OS.

Thanks

Christophe

17-Peridot
February 6, 2018

Hi Christophe Morfin

Sorry for the unclear message. Yes, I installed / upgraded both TW Foundation 8.2 and TW Analytics 8.2

I keep using the RedHat 7.4 machine (data format is still set to English / UK since I changed it back then during the initial attempts to pinpoint the cause of the issue).

I used native deployment.

I didn't observe the issue described in the article you mentioned and article claims that it's Windows-only issue.

Please see some screenshots in the attachment