Architecture

Open Orchestrator

The model-agnostic router at the heart of AIOP — bring your own models.

What it is

The Open Orchestrator is AIOP's model-agnostic routing layer. It accepts a request, consults policy to determine which AI model should handle it, and dispatches to the appropriate provider — OpenAI, Anthropic, Mistral, self-hosted models, or any other licensed provider. The orchestrator maintains a consistent interface regardless of which model executes the work. Identity verification, policy enforcement, and evidence generation remain identical whether the request goes to a cloud API or an on-premises deployment. You license the models you want, configure routing rules, and the orchestrator handles the rest.

Open Orchestrator · for every external agentLive
External agentsany combination
Custom
in-house
Codex
code agent
Claude Code
code agent
OpenCode
open-source
Open Orchestrator
Identity · Policy · Signing · Routing
identitypolicysigningrouting
Model poolall providers available
Anthropic
OpenAI
Mistral
Gemini
Llama
DeepSeek
Qwen
Cohere
Model choice is governed by policy+ more
Deployment modeper workload
SaaS
Managed by LumeSec
Dedicated
Single-tenant cloud
Sovereign
On-prem · air-gapped

Any external agent · every model · three deployment modes — the contract stays the same.

TipTwo orchestrators — one platform

The Open Orchestrator brings third-party agents into the AIOP contract. The Managed Orchestrator runs LumeSec's own agents and integrations directly — with the full AIOP capability set. Both write into the same audit stream.

Managed Orchestrator · for LumeSec Integrations & AgentsFull Stack
LumeSec agents & approved integrationsfirst-party + Platform SDK
LumeSec AGENT
first-party
Investigate Agent
SOC ops
Compliance Agent
audit prep
SDK Integrations
approved · Platform SDK
Platform SDK

Integrations built with the LumeSec Platform SDK run — once approved — directly on the Managed Orchestrator and inherit the same full AIOP contract as first-party agents.

Managed Orchestrator
Full AIOP capabilities — owned and delivered by LumeSec
Full AIOP capabilities
Correlate · Contain · Attest
Evidence Pack · Audit Stream
Row-Level Compliance
Replay & Determinism
Human-in-the-Loop
Identity & Scopes

For first-party agents and integrations, AIOP delivers its full capability surface — no contract in between, no translation layer.

Why it matters

Model vendor lock-in is a strategic risk that procurement teams often miss. Today's preferred model becomes tomorrow's deprecated service or tomorrow's cost overrun. The Open Orchestrator eliminates this risk by treating models as interchangeable infrastructure, not architectural dependencies. When a new model offers better performance or pricing, you update routing rules — not your entire AI deployment. When a vendor changes terms or exits a jurisdiction, you switch providers without rewriting applications. This flexibility is critical for long-term AI strategy, especially in regulated environments where vendor stability and jurisdiction compliance are non-negotiable.

Where it lives in AIOP

The Open Orchestrator operates at Layer 3 of the 8-layer architecture, between Policy (which defines what's allowed) and Agent Space (which executes the work). It reads the deployment configuration to understand which models are available, consults the policy contract to determine routing rules, and dispatches requests accordingly. The orchestrator integrates with the Correlate primitive to ensure every routed request maintains its signal chain, regardless of which model processes it. This makes model selection transparent to audit: the Evidence Pack shows which model was used, but the compliance guarantees remain consistent.

Business Value

Eliminate vendor lock-in and negotiate from a position of strength.

  • Reduce long-term AI costs through competitive model selection.
  • Respond quickly to vendor price changes, service degradation, or jurisdictional exits.
  • Future-proof your AI investment by decoupling application logic from model providers.
Value for Teams
Procurement teams

Negotiate better contracts knowing they can switch providers.

Architects

Design applications independent of model vendor APIs.

Operations teams

Swap models for performance optimization without code changes.

CIOs

Present multi-vendor strategies to boards without technical risk.