Skip to main content
S
SaranKarthick1-Visitor
1-Visitor
July 4, 2019
Solved

Scheduled Purging and Archiving of Data

  • July 4, 2019
  • 5 replies
  • 2705 views

Hi Developers,

 

I have a use case where i have to purge sensor data for a certain time period as well as have to take backup of the same data before its purged.

 

I have gone through the community and support portal and got an idea on the following activities which will be automated through a Scheduler at the end of each day. 
How to programmatically take backup of Data

Best Practices on purging

 

One challenge i see here is that the service have to purge the data only after it gets a confirmation that the same have been taken backup. 

 

So when i run the API for taking backup of data i get a message stating as given below. But it doesn't really give the actual status of the backup activity (like the deployment status available for the SCM module of the TWX Utilities). I have to manually check it up in the logs.

 

Data Export submitted for processing. Please check the log for completion status of Task-<some number>

 

I want to know if there is a better way to know about the actual status of the task or I can consider that the data export will be successful if I get the above response from the invoked export API.

 

Thanks and Regards,

Saran

Best answer by CarlesColl

You don't need to build any custom extension, just Javascript Server Side Scripting feature on ThingWorx, to query the log you have:

 

Logs["ApplicationLog"].QueryLogEntries({
	maxItems: undefined /* NUMBER */,
	searchExpression: undefined /* STRING */,
	fromLogLevel: undefined /* STRING */,
	instance: undefined /* STRING */,
	endDate: undefined /* DATETIME */,
	origin: undefined /* STRING */,
	thread: undefined /* STRING */,
	ascendingSearch: undefined /* BOOLEAN */,
	oldestFirst: undefined /* BOOLEAN */,
	toLogLevel: undefined /* STRING */,
	user: undefined /* USERNAME */,
	sortFieldName: undefined /* STRING */,
	startDate: undefined /* DATETIME */
});

5 replies

C
CarlesColl1-Visitor
1-Visitor
July 5, 2019

Not nice, but you can keep quering for a while for the message on the log on an automated way, log it's accessible trough scripting.

S
SaranKarthick1-VisitorAuthor
1-Visitor
July 5, 2019

Hi @CarlesColl,

 

Thanks for the suggestion. I was also seeing if I can do that with any existing extensions or services but it seems i may need to create a custom extension with the file reading capability and also to fetch the files from the logs folder.

 

Do let me know if there is any extension available for my use case.

Regards,

Saran

Saran

C
CarlesColl1-VisitorAnswer
1-Visitor
July 5, 2019

You don't need to build any custom extension, just Javascript Server Side Scripting feature on ThingWorx, to query the log you have:

 

Logs["ApplicationLog"].QueryLogEntries({
	maxItems: undefined /* NUMBER */,
	searchExpression: undefined /* STRING */,
	fromLogLevel: undefined /* STRING */,
	instance: undefined /* STRING */,
	endDate: undefined /* DATETIME */,
	origin: undefined /* STRING */,
	thread: undefined /* STRING */,
	ascendingSearch: undefined /* BOOLEAN */,
	oldestFirst: undefined /* BOOLEAN */,
	toLogLevel: undefined /* STRING */,
	user: undefined /* USERNAME */,
	sortFieldName: undefined /* STRING */,
	startDate: undefined /* DATETIME */
});
Terms & ConditionsAccessibility statement