cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 

Thingworx Analytics: Send Data From Dataconnect To Analytics Server

SOLVED
Level 4

Thingworx Analytics: Send Data From Dataconnect To Analytics Server

Hello,

I have just started with thingworx analytics 52.0 and DataConnect 52.0. I have some issues in sending data from dataconnect to analytics server.

I have followed these steps:

1] Set up Analytics Server

2] Import Analytics extension

3] Set up Dataconnect

4] Configure Platform Subsystem with dataconnect params

5] Configure MachineLearningAll thing with Analytics server params

6] Create a Data Analysis definition in TW and execute it

7] The zip file with property data and payload.json are being created in thingworx repository

8] Sending the zip(payload.json+csv) file to analytics server?


Step 8 is where I am facing problems. How to upload the created zip file to the analytics server? Do I have to use the service SubmitUploadDataset?

If so, then I am not able to test the service in Composer. When I Edit the UploadData field and try to add a row it tells me "Must have a datashape defined to add rows".

Am I approaching it the wrong way? Do I need to write a custom service to send the data?

I am having problems with understanding how exactly data from dataconnect is transfered to analytics server. I would appreciate any help on understanding this better and solving the issue.

Thanks & Regards,

Madhumita

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Thingworx Analytics: Send Data From Dataconnect To Analytics Server

Hi Madhumita

I think you missed one step during the installation of DataConnect - see the DataConnect User's guide, chapter "Integrate ThingWorx and DataConnect"

you need to create a symbolic link between /repository and /ThingworxStorage/repository: ln -s /ThingworxStorage/repository /repository .

Hope this helps

Kind regards

Christophe

22 REPLIES 22

Re: Thingworx Analytics: Send Data From Dataconnect To Analytics Server

Hi Madhumita

When all is configured ok, the step 8 is done automatically.

The flow is:

1) DAD collect logged data from ThingWorx

2) DAD send the data (as skinny csv file + payload.json) to DataConnect

3) DataConnect transform the data and create one single resulting csv file

4) DataConnect create a dataset inside ThingWorx Analytics Server with the resulting csv file loaded as data. The dataset created has got the same name as the DAD.

If you do not have a dataset created in ThingWorx Analytics, then you probably have a problem in the configuration or in the way data is collected by the DAD.

You should start by reviewing the DataConnect log files under /opt/dataconnect/logs.

Note that I am in the process of writing a blog on this specific topic. I am hoping to have it published by next week.

If you can wait, I think it would be a good reading to understand how things work.

If you need further help I would probably recommend to open a case to Technical Support, because that is a topic that may need more data to progress.

Kind regards

Christophe

Re: Thingworx Analytics: Send Data From Dataconnect To Analytics Server

Hi Christophe,

Thanks for the help.I will be opening a case for the same.Also looking forward to the blog.

Thanks & Regards,

Madhumita

Re: Thingworx Analytics: Send Data From Dataconnect To Analytics Server

Hi Madhumita

Just to let you know, I have published the blog at :

How to use DataConnect when sending property values from the ThingWorx platform to ThingWorx Analyti...

I hope you'll find it of interest

Kind regards

Christophe

Re: Thingworx Analytics: Send Data From Dataconnect To Analytics Server

Hi Christophe,

I went through the blog. It was really helpful. I followed your configuration steps and was able to establish connection between DataConnect and Analytics Server.

However I am still facing an issue with data transfer from dataconnect to Analytics server. I checked the logs and I found that the error is "File Not Found".

The transformer job is not able to find the zip file in system repository. But the file is present there.I haven't been able to resolve this issue.

I would appreciate any help regarding the same. I have attached the dataconnect logs for reference.

Now I am using Thingworx Analytics and DataConnect 52.2.

Thanks & Regards,

Madhumita

Re: Thingworx Analytics: Send Data From Dataconnect To Analytics Server

Hi Madhumita

I think you missed one step during the installation of DataConnect - see the DataConnect User's guide, chapter "Integrate ThingWorx and DataConnect"

you need to create a symbolic link between /repository and /ThingworxStorage/repository: ln -s /ThingworxStorage/repository /repository .

Hope this helps

Kind regards

Christophe

Re: Thingworx Analytics: Send Data From Dataconnect To Analytics Server

Hi Christophe,

Thanks for the quick reply.The symlink wasn't present in the required directory. I had created it in some other directory. Now, its working okay.

Thanks & Regards,

Madhumita

Re: Thingworx Analytics: Send Data From Dataconnect To Analytics Server

Hi Madhumita

Great I am happy that it works for you.

If you don't mind it would be good if you could mark the answer as correct answer as this will help others in the Community to find what could be wrong.

Thank you

Kind regards

Christophe

Re: Thingworx Analytics: Send Data From Dataconnect To Analytics Server

Hi

Luigi Dell'Aversano

Re: Thingworx Analytics: Send Data From Dataconnect To Analytics Server

Hi Luigi

The link to be created is

ln -s /ThingworxStorage/repository /repository

if you have DataConnect and ThingWorx on the same CentOS box.

The above ln command has absolute path so it does not matter where you execute it from, the link will be created under /.

It might also be helpful if you can provide the DataConnect logs from /opt/dataconnect/logs as your issue might be different.


Hope this helps.

Kind regards

Christophe