Delegation Risk Calculator
Delegation Risk Calculator
Section titled “Delegation Risk Calculator”Interactive tool for calculating Delegation Risk for your AI system components.
How to Use
Section titled “How to Use”- Add failure modes for each component
- Estimate probability and damage for each
- Calculator computes individual and total Delegation Risk
- Compare against your budget
Failure ModeP(failure)Damage ($)Risk
Results
| Failure Mode | Probability | Damage | Risk |
|---|---|---|---|
| Total Delegation Risk | $0 | ||
| Budget | $2,000 | ||
| Status | Within Budget | ||
Understanding the Results
Section titled “Understanding the Results”Delegation Risk Formula
Section titled “Delegation Risk Formula”For each failure mode:
Delegation Risk = P(failure) × DamageTotal system Delegation Risk is the sum across all failure modes.
Probability Guidelines
Section titled “Probability Guidelines”| Probability | Meaning | Example |
|---|---|---|
| 0.1 (10%) | Common without mitigation | Unvalidated user input |
| 0.01 (1%) | Occasional, seen in testing | Edge case handling |
| 0.001 (0.1%) | Rare but plausible | Unusual input combinations |
| 0.0001 (0.01%) | Very rare, needs adversary | Targeted attack |
What If Over Budget?
Section titled “What If Over Budget?”If your total Delegation Risk exceeds budget:
- Reduce probability: Add verification, redundancy, testing
- Reduce damage: Limit permissions, add rollback capability
- Split components: Decompose into smaller, lower-risk pieces
- Add human gates: Require approval for high-risk actions
Example Calculation
Section titled “Example Calculation”Scenario: Customer support bot
| Failure Mode | P(failure) | Damage | Delegation Risk |
|---|---|---|---|
| Gives wrong answer | 0.05 | $500 | $25 |
| Leaks customer data | 0.001 | $50,000 | $50 |
| Generates harmful content | 0.01 | $10,000 | $100 |
| Infinite loop/crash | 0.02 | $1,000 | $20 |
Total Delegation Risk: $195/month
With a $500/month budget, this system is well within tolerance.
Next Steps
Section titled “Next Steps”- Risk Inheritance Calculator — Compute effective trust through networks
- Quick Start — Apply Delegation Risk calculation to your system
- Decision Guide — Choose implementations based on Delegation Risk