I followed the README zero-Firebase reproduction path using:
ACP_BASE_URL=https://api.agenticcontrolplane.com
ACP_TENANT_SLUG=
ACP_API_KEY=<key created with the "AgentGovBench testing (24h, impersonation)" preset>
Command:
agentgovbench run --runner acp_api --out results/acp-api.json
The result was 27/48 instead of the expected 46/48.
The runner reports errors such as:
workspacePolicy PUT 403: {"error":"human-auth-required", ...}
and:
userPolicies PUT ... 403: {"error":"human-auth-required", ...}
The API key has bench.impersonate and admin.audit.read scopes.
Is there an additional step required to allow the public api.agenticcontrolplane.com
deployment to configure AgentGovBench policy fixtures without Firebase?
The README currently indicates that acp_api should reproduce 46/48 with zero Firebase.
I followed the README zero-Firebase reproduction path using:
ACP_BASE_URL=https://api.agenticcontrolplane.com
ACP_TENANT_SLUG=
ACP_API_KEY=<key created with the "AgentGovBench testing (24h, impersonation)" preset>
Command:
agentgovbench run --runner acp_api --out results/acp-api.json
The result was 27/48 instead of the expected 46/48.
The runner reports errors such as:
workspacePolicy PUT 403: {"error":"human-auth-required", ...}
and:
userPolicies PUT ... 403: {"error":"human-auth-required", ...}
The API key has bench.impersonate and admin.audit.read scopes.
Is there an additional step required to allow the public api.agenticcontrolplane.com
deployment to configure AgentGovBench policy fixtures without Firebase?
The README currently indicates that acp_api should reproduce 46/48 with zero Firebase.