GET form-variables API returning unpredictable results

[hellohatim]

Hi Everyone,

I need help with a really weird issue we are facing in our project.

We are getting unpredictable results on the get form-variables API on the CIB7 platform.
Our setup uses Oracle 19 as the database for CIB7 metadata with 3 node cluster setup.

We observe that the requests sometimes return 200 OK with form variable values, and at times return 400 Bad Request, suggesting that the task id is not valid

We already ruled out the scenarios below

1. Is the request reaching the correct CIB7 engine? We ensured we investigated the network trace and ensured all requests are reaching the correct server
2. We do not see any compatibility issues in the library versions
3. We do not see any serialization issue or data corruption on ACT_GE_BYTEARRAY table
4. No Issues with the database
5. No other observed issues with the Camunda 7 engine nodes

Any help here will be appreciated

Thanks,
Hatim