Skip to main content
M
22-Sapphire I
MikeLockwood22-Sapphire I
22-Sapphire I
January 20, 2016
Question

Using PTC's standard Creo/Windchill performance test

  • January 20, 2016
  • 7 replies
  • 9714 views

Hello all,

Windchill is currently only used for CAD data management at Edwards (Windchill 10.2 M020, Creo 3.0 M060).

Windchill is on state of the art servers and user workstations are high end, but Windchill is very slow for some users some of the time.  In general, the network is very capable and fast.  No specific reason identified yet.

I've been asked to put measurement tools in place and methodically see what can be done.  We now have:

- PTC System Monitor installed and monitoring production

- PTC standard world car dataset in production

- A few key users lined up to do performance testing in order to trend / compare

I spent most of today on the available tools to automate the performance testing - with pretty good success.  Getting good support on this from EDC.  Able now to create / register workspace, import data, upload, checkin, checkout, export, etc., with log files recording the times.

http://support.ptc.com/WCMS/files/92341/en/WindchillSingleUserPerformanceTester.pdf

So, question - has anyone else used these tools to automate Creo user actions with Windchill using this approach?  I'd like very much to compare notes.  Happy to share what I've got with anyone interested.

It seems like the ultimate for this would be to automate the test, record the results using PSM, then analyze a PSM session exported for the single testing user.

    7 replies

    M
    22-Sapphire I
    MikeLockwood22-Sapphire IAuthor
    22-Sapphire I
    February 9, 2016

    Hey, I've got the automated test working perfectly now.  Zip file stored in Windchill along with Word doc with instructions.  Each user simply downloads and extracts the zip file, sets a command window on that folder and runs a batch file.  Results in a .txt file that I drop into a spreadsheet to summarize and compare to other tests.  It runs as a Windchill test user (Performance_Tester) and temporarily sets the .wf location, etc env variables, so doesn't mess up existing workspaces.  Happy to share w/anyone interested.

    Haven't yet solved our performance problems with WC but have a way to measure very easily.

    T
    23-Emerald IV
    TomU23-Emerald IV
    23-Emerald IV
    February 9, 2016

    I would love to give this a try.  Thanks!

    G
    GaryMansell12-Amethyst
    12-Amethyst
    February 22, 2016

    Hi Mike,

    Do you have any info you can share on using this tool, or a few pointers to using it perhaps?

    Does the PTC World Car dataset need to exist in the target Windchill System before running the test and if so is there are specific product context and folder location that it needs to go in, or can it be anywhere searchable?

    Or, does the PTC World Car dataset need to be available on the local machine (perhaps in this location: C:\PerfBenchmark\SPT\Datasets\Dataset_002)?

    Does a specific user account need to be used to connect to the Windchill System, or can any account be used?

    Rgds

    Gary

    M
    22-Sapphire I
    MikeLockwood22-Sapphire IAuthor
    22-Sapphire I
    February 22, 2016

    So... Was not easy digging this info out of PTC's standard documentation but after fooling with it I got it to work well.  Answering questions specifically:

    1. Yes, the data set (can be any data set) has to exist in the Windchill system as I've set it up. PTC provides a sequence in which it is uploaded and checked in as new data to the system, but I didn't see any way to do that repeatedly except to delete it after each run.  Seems to me that having it already in the system is more practical.  We chose to create a Library just for this purpose and named it "Performance_Test_Library."  The Team for this Library has just the Manage and Member Roles, and a single user (Performance_Tester) is mapped to the member Role.

    2. The data set is in Windchill.  The test creates a workspace and downloads to the local machine.  It also includes both exporting from the workspace to the local machine, clearing the workspace and the importing back in (using the /Export folder).

    3. The test requires having the username and password in plain text.  Because of this I created a Windchill test user Performance_Tester and all executions of the test are by this user.  Note: Environment variables are managed in the launch .bat file so that user workspace caches are not affected - very important.

    I hope that the folks in PTC's EDC comment on this thread and update / clarify the documentation for all.

    J
    James621-Visitor
    1-Visitor
    February 25, 2016

    Hi,

    Does this work with Creo parametric 2.0? Seems like the libSPT.jar file is only for Creo 3.0.

    error_jlink_creo2.PNG

    M
    22-Sapphire I
    MikeLockwood22-Sapphire IAuthor
    22-Sapphire I
    February 25, 2016

    There are some minor changes needed to run this for Creo 1 or 2.  Can see that in the downloads from PTC for these files and the related documentation

    J
    James621-Visitor
    1-Visitor
    February 25, 2016

    Thanks for the reply. I just realized i might not have jlink installed. Will have to check.

    Looks like the link to download the jar file for Creo.2.0 can be found here:

    https://support.ptc.com/appserver/cs/view/solution.jsp?n=CS56377&art_lang=en&posno=2&q=single%20user%20performance%20tes…

    Just needs some minor setting

    https://support.ptc.com/appserver/cs/view/solution.jsp?n=CS142419&art_lang=en&posno=1&q=single%20user%20performance%20te…

    And there is also a newer version of the guide you posted above in the original post:

    http://support.ptc.com/WCMS/files/166481/en/WindchillSingleUserPerformanceTester-R10.2.pdf

    Can't wait to see this work!

    T
    23-Emerald IV
    TomU23-Emerald IV
    23-Emerald IV
    February 25, 2016

    I just noticed article CS140230 from PTC today on analyzing Windchill performance with PTC System Monitor.  Might be really helpful to use this approach with the automated test you've built.

    J
    James621-Visitor
    1-Visitor
    February 26, 2016

    Turns out i had to use shortname as the path for proe inside jlink_SPT.bat:

    PROE_DIR=C:\Applic\Creo2~1.0\COMMON~1\M090

    It now fails on first operation:

    error_jlink_creo2-2.PNG

    J
    James621-Visitor
    1-Visitor
    February 26, 2016

    Any idea why is it updating only the top level assembly? I've tried to set <Object>Entire Workspace</Object> in the check in file but no go.

    spt_success_top_level.PNG


    M
    22-Sapphire I
    MikeLockwood22-Sapphire IAuthor
    22-Sapphire I
    February 26, 2016

    I could only get it to check out top level also, so we're living w/that.

    D
    DanielO1-Visitor
    1-Visitor
    February 13, 2017

    Excellent work Mike.

    I will review the solution and see if we can implement something similar here.

    BR

    D
    DanielReid12-Amethyst
    12-Amethyst
    February 17, 2017

    We are considering purchasing Fishbowl's LinkTuner, and still might as it does good monitoring and presentation of results for a pretty good price.  However, this could be a good supplement and we might be able to adapt it to more specific things we want to test (not covered in LinkTuner without customization).  I'll have to take a look at what you've done.  Thanks for sharing!

    Terms & ConditionsCookie settingsAccessibility statement