I'm trying to create a Thingworx HA cluster with three nodes.
These nodes connect to a pgpool cluster with a VIP IP. This connection works fine from the three nodes.
Thinworx start perfectly in no cluster mode. If I start up each node separately, I can access to Twinworx fine.
But, if I activate the HA mode, the first node join fine, but the others one fails.
I think that zookeeper is configured ok, so I see one leader and two followers.
Attached is my Zookeeper config and my Thingworx config.
I see these errors in the three nodes in /ThingworxStorage/logs/
2022-10-23 17:23:31.768+0200 [L: INFO] [O: c.t.s.SecurityManagerBootstrapper] [I: ] [U: ] [S: ] [P: ] [T: localhost-startStop-1] initializing KeyStore provider
2022-10-23 17:23:31.821+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] ========================================
2022-10-23 17:23:31.821+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] ThingWorx Version Information
2022-10-23 17:23:31.821+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] ========================================
2022-10-23 17:23:31.821+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] majorVersion = 8
2022-10-23 17:23:31.821+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] minorVersion = 5
2022-10-23 17:23:31.821+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] revision = 4
2022-10-23 17:23:31.821+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] build = b222
2022-10-23 17:23:31.821+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] schemaVersion = 1053
2022-10-23 17:23:31.821+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] ========================================
2022-10-23 17:23:31.821+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] ========================================
2022-10-23 17:23:31.821+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] ThingWorx System Environment Settings
2022-10-23 17:23:31.821+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] ========================================
2022-10-23 17:23:31.821+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] OS: Linux
2022-10-23 17:23:31.823+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] OS arch: amd64
2022-10-23 17:23:31.823+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] OS version: 4.18.0-193.el8.x86_64
2022-10-23 17:23:31.823+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] Total Processors: 8
2022-10-23 17:23:31.823+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] Default encoding: UTF-8
2022-10-23 17:23:31.823+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] JAVA vendor: Oracle Corporation
2022-10-23 17:23:31.823+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] JAVA version: 11.0.11
2022-10-23 17:23:31.823+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] JAVA install location: /usr/lib/jvm/jdk-11.0.11
2022-10-23 17:23:31.823+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] JVM Max Memory: 3970 (MB)
2022-10-23 17:23:31.823+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] ========================================
2022-10-23 17:23:31.823+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] WebApp starting...
2022-10-23 17:23:32.085+0200 [L: INFO] [O: c.t.s.ThingWorxServer] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] Server Mode is HA (active-passive)
2022-10-23 17:23:32.089+0200 [L: INFO] [O: c.t.s.h.HALeadershipCoordinator] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] Generated CoordinatorID [10.98.171.40.-14245093].
2022-10-23 17:23:32.089+0200 [L: INFO] [O: c.t.s.h.HALeadershipCoordinator] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] Initializing CuratorFramework client.
2022-10-23 17:23:32.151+0200 [L: INFO] [O: c.t.s.h.HALeadershipCoordinator] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] Connected to ZooKeeper hosts.
2022-10-23 17:23:32.152+0200 [L: INFO] [O: c.t.s.h.HALeadershipCoordinator] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] Initializing LeaderSelector on Coordinator ZNode [/HALeadershipCoordinator].
2022-10-23 17:23:32.170+0200 [L: INFO] [O: c.t.s.h.HALeadershipCoordinator] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] LeaderSelector initialized.
2022-10-23 17:23:32.170+0200 [L: INFO] [O: c.t.s.h.HALeadershipCoordinator] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] Starting LeadershipCoordinator.
2022-10-23 17:23:32.227+0200 [L: INFO] [O: c.t.s.ThingWorxServer] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] HA mode started.
2022-10-23 17:23:32.228+0200 [L: INFO] [O: c.t.s.ThingWorxBootstrapper] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] Datastore database...INITIALIZED
2022-10-23 17:23:32.307+0200 [L: ERROR] [O: E.c.q.l.c.Logger] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] Could not load session timeout from database, using default: null
2022-10-23 17:23:32.321+0200 [L: ERROR] [O: E.c.q.l.c.Logger] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] SCIMProvider initialization failure. Thingworx Server is not running
2022-10-23 17:23:32.243+0200 [L: INFO] [O: S.c.t.s.a.s.SSOContext] [I: ] [U: ] [S: ] [P: ] [T: localhost-startStop-1] SSOContext created...
2022-10-23 17:23:32.307+0200 [L: ERROR] [O: S.c.t.s.a.AuthenticationFilter] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] Could not load session timeout from database, using default: null
2022-10-23 17:23:32.321+0200 [L: INFO] [O: S.c.t.s.s.SCIMProvider] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] Initializing SCIMProvider servlet...
2022-10-23 17:23:32.322+0200 [L: ERROR] [O: S.c.t.s.s.SCIMProvider] [I: ] [U: SuperUser] [S: ] [P: ] [T: localhost-startStop-1] SCIMProvider initialization failure. Thingworx Server is not running
