1. What is model risk on a trading desk?
Working definition:
Model risk = risk of wrong decisions or wrong numbers because the model, inputs, or usage are wrong.
Sources:
- Wrong structure
- Using Black–Scholes for instruments with early exercise, strong path-dependence, or jumps/spikes.
- Wrong parameters
- Mis-calibrated vol surfaces, stale correlations, wrong mean-reversion speeds.
- Wrong implementation
- Coding bugs, sign errors, interpolation mistakes.
- Wrong use
- Using a short-rate model beyond its calibrated tenor, ignoring use-limits.
For a senior quant dev, the key is: you don’t “trust the model”; you control it.
2. Core controls around pricing models
2.1 Documentation and assumptions
Each model should have:
- Clear product scope: what it does / does not cover.
- Assumptions:
- Dynamics (GBM vs OU vs jump),
- Market regime (liquid, arbitrage-free, etc.),
- Exercise style (European only, no path-dependence).
- Known limitations:
- “Breaks down for deep OTM options with very long maturity.”
- “Not calibrated to stress regimes.”
This is what you say in an interview:
“We explicitly document assumptions and use-limits; that’s part of model control.”
2.2 Independent validation
Model validation checks:
- Theoretical soundness:
- Is the model coherent with no-arbitrage and desk use-case?
- Implementation:
- Code review, unit tests, finite-difference checks.
- Calibration quality:
- Fit errors, stability, parameter plausibility.
- Backtesting / benchmarking:
- Compare model prices vs market, model Greeks vs realised P&L.
Validation outcome:
- Approved with limits, or
- Rejected / needs remediation.
Limits could be:
- Product types, tenors, underlying sets,
- Vol/parameter ranges,
- Purpose (e.g. pricing allowed, capital disallowed).
3. Drift monitoring and regression control
Once in production, the real game is drift:
3.1 Golden regression tests
- Fix:
- A set of reference trades,
- A reference market snapshot,
- A specific model configuration.
- Store:
- PV, Greeks, selected diagnostics.
Every code or config change:
- Re-run tests; compare new vs golden values.
- Enforce tolerances:
|new - old| ≤ abs_tol + rel_tol * |old|.
If breach:
- Either:
- There is a bug, or
- A deliberate model change that needs:
- Documentation,
- New golden values.
This is your regression shield.
3.2 Calibration and performance drift
Monitor over time:
- Calibration error distributions:
- Are we drifting from market quotes?
- Parameter paths:
- Vol-of-vol, mean-reversion, correlations.
- Are they stable? Are there jumps that indicate regime change or data issues?
- P&L residuals:
- From P&L explain:
- Risk + new trades + model changes vs actual P&L.
- Persistent residual patterns → model or mapping problems.
- From P&L explain:
You want:
“If the world or our behaviour changes, I see the drift in a dashboard before it hits P&L badly.”
4. Model risk vs trading P&L
Important conceptual point:
- True trading P&L should come from:
- Views, positioning, risk-taking.
- Systematic P&L from model bias is not alpha; it’s model risk P&L.
Examples:
- Using a model that systematically undervalues a structured product you’re long in:
- Booked P&L looks great; market P&L may not.
- Wrongly specified smile:
- Hedging using wrong vega/gamma; residuals show up as unexplained P&L.
Risk function wants to separate:
- Trading performance vs
- Model performance.
5. How to phrase it in an interview
Short, desk-flavoured summary:
“Model risk comes from structure, parameters, implementation, and misuse. We control it with a validation process that documents assumptions, tests implementation with unit and finite-difference checks, and benchmarks against market data. In production, we use golden regression suites and numerical tolerances to detect unintended behaviour changes, and we monitor calibration errors and P&L residuals over time. Persistent residuals are treated as model risk P&L, not trading alpha, and trigger model review.”
That’s usually enough to sound like an adult in the room.