| --- |
| doc_id: computer-use-evidence-classes |
| title: "Computer Use Evidence Classes" |
| language: en |
| source_language: en |
| implementation_status: current |
| document_status: current |
| translation_status: source-only |
| last_verified: 2026-09-11 |
| owners: |
| - maka-backend |
| --- |
| <!-- |
| Licensed to the Apache Software Foundation (ASF) under one |
| or more contributor license agreements. See the NOTICE file |
| distributed with this work for additional information |
| regarding copyright ownership. The ASF licenses this file |
| to you under the Apache License, Version 2.0 (the |
| "License"); you may not use this file except in compliance |
| with the License. You may obtain a copy of the License at |
| |
| http://www.apache.org/licenses/LICENSE-2.0 |
| |
| Unless required by applicable law or agreed to in writing, |
| software distributed under the License is distributed on an |
| "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY |
| KIND, either express or implied. See the License for the |
| specific language governing permissions and limitations |
| under the License. |
| --> |
| |
| # Computer Use Evidence Classes |
| |
| Computer Use reports use one of four evidence classes. The class is part of |
| the qualification boundary and is not descriptive copy. |
| |
| ## real-runtime |
| |
| A live provider used the production Runtime, Computer Use tool, owned fixture, |
| and executor path. Provider qualification additionally requires: |
| |
| - `complete/end_turn`; |
| - enforced or explicitly reported policy provenance; |
| - exact provider, model, producer, and live transport identity; |
| - successful or scenario-expected actions within pre-dispatch budgets; |
| - fixture process-instance PID/window ownership for every targeted action, |
| including both old and replacement instances in restart scenarios; |
| - observation lineage for every observation-bound action; |
| - the scenario's exact action sequence when one is declared; |
| - AX or semantic dispatch evidence for mutations; |
| - passing expected-state and forbidden-effect assertions. |
| |
| Missing evidence is invalid or inconclusive. It is never inferred from fixture |
| state alone. |
| |
| ## fault-injection |
| |
| The live provider and production Runtime ran, but the named failure was |
| injected by a wrapper rather than observed from the real host boundary. |
| `intervention-recovery` currently belongs here because the wrapper injects |
| `user_intervened` before the backend and HID-age guard run. |
| |
| Fault-injection reports are useful regression evidence but cannot satisfy a |
| `real-runtime` provider qualification cell. |
| |
| ## hermetic-protocol |
| |
| A local protocol server verified provider URL, authentication, model ID, |
| streaming tool calls, tool-result reinjection, error flags, and final semantic |
| state. No live provider credential or network model execution is claimed. |
| |
| ## static-contract |
| |
| Source, schema, or deterministic harness checks only. The superseded direct |
| real-machine qualification runner was removed. The five-round process-restart |
| runner remains as a non-qualifying soak after its qualification checks moved |
| into the canonical Runtime-backed harness. |
| |
| ### Lab fixture setup |
| |
| The `real-ax` and `restart-soak` commands require a local checkout of the |
| [Codex Computer Use Lab](https://github.com/hqhq1025/codex-computer-use-lab). |
| Clone it outside this repository and export its absolute repository root: |
| |
| ```bash |
| git clone https://github.com/hqhq1025/codex-computer-use-lab.git ../codex-computer-use-lab |
| export MAKA_CU_AX_MODEL_LAB_ROOT="$(cd ../codex-computer-use-lab && pwd)" |
| ``` |
| |
| The path must contain `test-app/launch.sh`. The launchers invoke that script, |
| which builds the fixture when its application bundle is absent. |
| |
| With the variable exported, run the canonical operator commands: |
| |
| ```bash |
| npm run computer-use -- real-ax |
| npm run computer-use -- real-ax --scenario restart-recovery |
| npm run computer-use -- real-model |
| ``` |
| |
| The non-qualifying five-round restart soak uses the same fixture checkout: |
| |
| ```bash |
| npm run computer-use -- restart-soak |
| ``` |