For Integrity what is the recommended Tool for doing Load/Stress Testing

[mpawar]

We want to start load and stress testing for Integrity

We are currently using Integrity 10.6 version.

So what is the recommended Tool for performing Load/Stress test on Integrity Server

What are the existing tools used by customers for performance testing of Integrity?

Is anybody using Load Runner/Silk performer for performance testing of Integrity?

[KaelLizak]

Hello Mukesh,

If you would like to discuss this, please contact PTC Integrity Support if you wish to have a discussion regarding this topic, as discussed in CS150435.

Regards,

Kael

[khoppe]

Hello,

we use something self-developed:

Within a script we do this steps:

- Write Timestamp

- Create Sandbox of a Project's Build Revision

- Delete Sandbox (incl. local Directory)

This will be done 5 times in one sessions with a delay of some minutes between each run.

Afterwards we check the timestamps and calculate the needed time.

This session we run at different time of a day to check as well during high loading in the network as well as during times where nothing happens on the network.

Thus we don't use a tool, but it works for us.

After the first round of tracking we checked possible further influence factores like:

- backup activities on server

- general load on the network

- load of authentication systems liek LDAP directory

- ...

Hope that gave an idea of our approach.

Good luck for your work

[mpawar]

Thanks a lot Klaus for your useful inputs.

Also would these scripts can be used for carrying out concurrent user load/stress testing scenarios for more number of users (say 100, 200 ......).

Do you know anyone use standard performance tools such as Load Runner, Silk performer for carrying out performance tests for integrity.

Any insights regarding these points would be highly appreciable.

[KaelLizak]

Hello Mukesh,

If you found Klaus' or Matthias' answers useful, could you mark it as correct by pressing the Correct Answer button at the bottom of his post? If you found it useful but not complete, you can instead mark it as helpful by going to the Actions menu at the bottom of his post and select Mark as Helpful. You can only mark one of them as correct.

Other organizations have used Load Runner in the past to perform testing from the CLI. Unfortunately, due to the way Integrity was implemented, Load Runner will not work from the Web UI.

In general, most organizations which have created load testing use scripts to run CLI commands or use the API to call commands that way to simulate user interaction. The tricky part, of course, is to accurately simulate the real user load against your server.

Regards,

Kael

[mrump]

We use the same idea as Klaus, but let a Jenkins Server do the actual scheduling and measurements.

Just a Default Jenkins installation and the Windows Batch or powershell plugin to utilize the Integity CLI.

The benefit, apart from the ease of use is, that the Jenkins server itself takes care of

- scheduling

- time measurement

- trend analysis

- visualization

....

Another Tool we use is the "Dynatrace" server (aka "PTC System Monitor" ) provided by PTC. This is a really nice and powerful tool to monitor, track and debug/maintain your already running server.

It places some adapters (called agents) in your running server or client instance that constantly trace whats going on. This data is store in extra DB and can be used e.g. fro post mortem analysis of an exception. You can dig deep into the guts of Integrity and find the performance bottlenecks in your setup.

Ask your local Support Teams for Details.

HTH Matthias

[KaelLizak]

Thanks for sharing that, Matthias!

Would anyone else like to share how they do load or stress testing of Integrity at their organization? I know we have administrators from a few companies that have done some extensive testing with Integrity, and I think it would be great if we could foster more conversations along those lines, with people sharing their ideas and approaches to some of these more involved topics.

Regards,
Kael

[CeciliaSabate]

I am planning to use the Integrity 10.5 parsers to load the system; specifically, the excel parsers. I am also looking into WORD parsers for data re-import. I plan to set up ten test PCs and fire off the data load using the parsers.

I aleady have the baseline from the server diagnostics and the PSM tool. Then I just need to get new stats for comparison.

Comments- will above work?

[mpawar]

  Thanks all for providing useful insights regarding this Topic.

Further it would be helpful if you can elaborate the way you perform Load/Stress performance Testing for Integrity.

• Which scripting language do you use to write scripts for Load/Stress performance Testing for Integrity
• Do you call CLI commands within the scripts  to perform user actions in Integrity
• Could this be done for large load to simulate say more than 300 users performing actions on integrity

[KaelLizak]

Hello Mukesh,

Scott Milton recently posted a document on performance testing Integrity, located here.

I hope you find that helpful.

Regards,

Kael

[mpawar]

Thanks a lot Kael for pointing to the required Integrity performance testing document.

This is the document  that we were looking for to get some direction for performance Testing of Integrity.

Once again thanks for sharing it.