Data archival of ThingWorx Stream data based on a Scheduler

[BK_10290693]

I have 1000's of Streams and want to archive the old data in database using a scheduler in PostgresSQL. Can anyone please help me with a detailed steps, how to proceed to it?

[VladimirN]

Similar discussion - "Best practice to store data in Stream": https://community.ptc.com/t5/ThingWorx-Developers/Best-practice-to-store-data-in-Stream/td-p/839910 

[nmutter]

I can only provide you this link:

• https://support.ptc.com/help/thingworx/platform/r9.5/en/index.html#page/ThingWorx/Help/ModelandDataBestPractices/purgingdata.html
  • which also references this article https://www.ptc.com/en/support/article/CS271772

There is unfortunately no straight forward mechanism. When impelemnting a purge solution make sure to purge in batches so that the thingworx ScriptTimeout does not kick in and kill your service.

You could also implement something in the database directly if you want to take the risk (might break in the next twx version when e.g. the schema changes).

[vnamboodheri]

Hello @BK_10290693, 

It looks like you have some responses from some community members. If any of these replies answered your question please mark the appropriate reply as the Accepted Solution. 

Of course, if you have more to share on your issue, please let the Community know so other community members can continue to help you.

Thanks,
Vivek N.
Community Moderation Team.