Orchestration Patterns.
Coordinate multiple intelligence layers efficiently with sequential, parallel, and conditional patterns.
Orchestration determines how layers execute: sequentially (one after another), parallel (simultaneously), or conditionally (based on previous results). Each pattern has tradeoffs in latency, cost, and accuracy.
Sequential orchestration enables early termination—if the first layer returns high risk, skip remaining layers. This reduces cost but increases latency for legitimate users who pass all checks.
Parallel orchestration minimizes latency—all layers execute simultaneously. This provides fastest response but maximum cost since all layers run regardless of outcome.
SEQ
Sequential
Layers execute in order. Early termination possible. Higher latency, lower cost for high-risk.
PAR
Parallel
All layers execute simultaneously. Lowest latency, highest cost. Best for latency-critical flows.
COND
Conditional
Layer selection based on context. Optimal cost/latency tradeoff. Requires careful rule design.