"Failed to perform cache operation (cache is stopped)..." occurs in SAS® OnDemand Decision Engine


When you redeploy SAS OnDemand Decision Engine, the Apache Ignite cache stops before post-score actions complete on in-progress transactions. Transactions whose post-score actions have not completed are stored in files in the "failed" directory.

The following messages are written to the console.log:

2025-11-07T16:24:14,603 [Walk  7] WARN  POST_SCORE_ACTION_FAILED cmx_tran_id=0032899750418547 smh_acct_type="CS" smh_activity_type="MC" smh_rtn_code="12" smh_reason_code="ERRR"  failure_reason="java.lang.IllegalStateException: class org.apache.ignite.internal.processors.cache.CacheStoppedException: Failed to perform cache operation (cache is stopped): datastructures_ATOMIC_REPLICATED_0@default-ds-group"

2025-11-07T16:24:14,604 [Walk  7] INFO  SendToFileAction '/sas/config/Lev1/Applications/SASFraudManagement/6.2/SAMS/engine /Server1/failed/post-ard-failed-txns.20251107T0424.14,603Z' opened for write

Workaround

You can configure SAS OnDemandDecision Engine to reprocess the failed messages that are written to the "failed" directory when the redeploy completes.