▦
Auditor PBC request planner
ComplianceTurn an auditor’s "provided by client" (PBC) request into a concrete gather plan — what artifact, from which system, owned by whom.
The routing recipe
Job typeComplex reasoningPolicyBalanced
routes to
NVIDIA Nemotron 3 Ultra 550B-A55B nvidia
nvidia:nvidia/nemotron-3-ultra-550b-a55b
90.8
match score
96.5
task fit
100
cost
59.5
speed
Why this model from benchmarks & capabilities
- "Complex reasoning" leans hardest on reasoning; NVIDIA Nemotron 3 Ultra 550B-A55B scores 100/100 there — top-1 of 40 chat models.
- Strength on this class of work shows up on GPQA Diamond, MMLU-Pro, BIG-Bench Hard, where NVIDIA models are competitive.
- Cost: runs on NVIDIA free credits / self-hostable NIM — effectively $0 marginal. Speed: ~70 tok/s (estimated).
- Chosen over NVIDIA Nemotron 3 Super 120B-A12B for higher task-fit (96.5 vs 90.7) & more context.
| Capability the job needs | Weight | NVIDIA Nemotron 3 Ultra 550B-A55B | Catalog rank |
|---|---|---|---|
| reasoning | 1.00 | #1 of 40 | |
| math | 0.60 | #3 of 40 | |
| knowledge | 0.50 | #4 of 40 |
Relevant benchmarksGPQA Diamond MMLU-Pro BIG-Bench Hard LiveBench (reasoning)
EconomicsCost: runs on NVIDIA free credits / self-hostable NIM — effectively $0 marginal.
Speed: ~70 tok/s (estimated). vs runner-upChosen over NVIDIA Nemotron 3 Super 120B-A12B for higher task-fit (96.5 vs 90.7) & more context. (NVIDIA Nemotron 3 Super 120B-A12B, score 89.5)
Speed: ~70 tok/s (estimated). vs runner-upChosen over NVIDIA Nemotron 3 Super 120B-A12B for higher task-fit (96.5 vs 90.7) & more context. (NVIDIA Nemotron 3 Super 120B-A12B, score 89.5)
Example result
Sample input ▾
PBC: (1) evidence of quarterly user access reviews for production; (2) listing of all production changes in the period with approval evidence; (3) evidence the IR plan was tested.
1. Access reviews → exported review records from Okta/your IGA tool, all 4 quarters. Owner: Security. Gotcha: show reviewer + date + outcome, not just a screenshot.
2. Change listing → full deploy log from GitHub/CD with linked PRs + approvals for the WHOLE period. Owner: Eng. Gotcha: population must reconcile to the deploy count; no gaps.
3. IR test → tabletop notes or incident retro with date + participants. Owner: Security. Gotcha: a plan document alone is not "tested".
Test it on your own data