cloud:AKS HCI 

pega version image :8.8.1

we deployed one pod in AKS HCI and its works fine and facing issue when we create more than one pod .The issue is the application becomes unresponsive and i could see the error  from pega rules logs :

SEVERE [http-nio-8080-exec-9] com.pega.pegarules.internal.bootstrap.PRBootstrap. Problem during method invocation (doPostInner)         com.pega.pegarules.pub.PRRuntimeException: FUACache-FailAssembly        [this:is:not:a:classname]       produced no java source:

2023-02-28 17:13:57,692 [http-nio-8080-exec-9] [  STANDARD] [                    ] [                    ] (ernal.cache.AssemblerFunctions) ERROR    - com.pega.pegarules.pub.generator.FirstUseAssemblerException: FUAInstance-AssembleFailed        null From: (H5Y562I36T808LROAQ44D4KAGIK8CVOWIA) 2023-02-28 17:13:57,692 [http-nio-8080-exec-9] [  STANDARD] [                    ] [                    ] (pcentric.RACacheAppCentricImpl) ERROR    - Failed assembly of [this:is:not:a:classname] produced no java source 2023-02-28 17:13:57,693 [http-nio-8080-exec-9] [  STANDARD] [                    ] [                    ] (      internal.mgmt.Executable) ERROR    - Exception: java.lang.NullPointerException: null

Cluster logs:

The pods are unable to communicate each other :

2023-02-28 01:11:05,069 [web-6b696fd744-p4x27] [                    ] [                    ] (azelcast.core.LifecycleService) INFO     - [ Proprietary information hidden]:5701 [67798a082be3bae124f89b4bfd3f4d3f] [3.12.10] [ Proprietary information hidden]:5701 is STARTED 2023-02-28 01:11:05,106 [web-6b696fd744-p4x27] [                    ] [                    ] (ion.impl.PartitionStateManager) INFO     - [ Proprietary information hidden]:5701 [67798a082be3bae124f89b4bfd3f4d3f] [3.12.10] Initializing cluster partition table arrangement... 2023-02-28 01:14:44,829 [http-nio-8080-exec-2] [              shared] [        ILM:04.02.01] (he.impl.EnterpriseCacheService) INFO  prmt-pega-cloud-web.prxxxx-aks-poc-tm.xxxxxxxxxxxaks-s1.XXXXXXXxx.net| Proprietary information hidden HYAFYN1G39DV4D2SQ3FGR1EKWCGANYBSYA RUxxxxxx - [ Proprietary information hidden]:5701 [67798a082be3bae124f89b4bfd3f4d3f] [3.12.10] Added cache config: CacheConfig{name='INTERNAL_cachename', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null} 2023-02-28 01:14:44,847 [http-nio-8080-exec-2] [              shared] [        ILM:04.02.01] (he.impl.EnterpriseCacheService) INFO  prmt-pega-cloud-web.prxxxx-aks-poc-tm.xxxxxxxxxxxaks-s1.XXXXXXXxx.net| Proprietary information hidden HYAFYN1G39DV4D2SQ3FGR1EKWCGANYBSYA RUxxxxxx - [ Proprietary information hidden]:5701 [67798a082be3bae124f89b4bfd3f4d3f] [3.12.10] Added cache config: CacheConfig{name='StaticContentAGCache', managerPrefix='/hz/', inMemoryFormat=BINARY, backupCount=1, hotRestart=HotRestartConfig{enabled=false, fsync=false}, wanReplicationRef=null} 2023-02-28 13:35:41,564 [f4d3f.IO.thread-in-0] [                    ] [                    ] (       nio.tcp.TcpIpConnection) INFO     - [ Proprietary information hidden]:5701 [67798a082be3bae124f89b4bfd3f4d3f] [3.12.10] Connection[id=1, / Proprietary information hidden:5701->/ Proprietary information hidden:53915, qualifier=null, endpoint=null, alive=false, type=NONE] closed. Reason: Connection closed by the other side pegauser@prmt-pega-cloud-web-XXXXXXXXXx:/usr/local/tomcat/logs/prmt-pega-cloud-web-XXXXXXXXXx$