Specialist gateways
agentgateway # Rust gateway for AI and MCP. Local rate limits are held in memory; a remote rate-limit service supplies a different sharing boundary.
Evaluation question & research context Who can author policies and reference credentials across namespaces?
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
Hosted model API. Service key management does not replace review of provider processing and retention terms.
Evaluation question & research context Can keys be scoped and revoked without interrupting all applications?
Also searched as: AIMLAPI, AI ML API.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Hosted model aggregation. Review the service policy alongside the actual selected upstream.
Evaluation question & research context What provider, geography and content-retention terms govern this model?
Also searched as: AI Hub Mix.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
API platforms
Apache APISIX # AI plugins extend the API gateway. Documented streaming timeouts can close a stream without a DONE event.
Evaluation question & research context How does the client detect an incomplete stream and avoid unsafe replay?
Also searched as: APISIX.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Cloud gateways
Apigee / Model Armor # Model Armor is a configured integration. Inspection limits, supported regions and service latency affect coverage.
Evaluation question & research context What is the explicit fail-open or fail-closed policy for inspection errors?
Also searched as: Google Cloud, GCP.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Cloud gateways
AWS Bedrock AgentCore Gateway # AgentCore Gateway now documents inference targets as well as tool integration. Policy-language and target support still have limits.
Evaluation question & research context Which inference and tool targets are in scope for each policy?
Also searched as: AWS, Amazon, Bedrock.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Cloud gateways
Azure API Management # Token-limit counters are independent across specified gateway, region and workspace boundaries. A newer AI gateway preview has separate limitations.
Evaluation question & research context Is your budget global, or is it enforced independently per region?
Also searched as: Microsoft, Azure, APIM.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Specialist gateways
Bifrost # Gateway with MCP and custom-plugin administration. The September advisories distinguish dynamically linked builds from published static Docker images.
Evaluation question & research context Is the management API authenticated and isolated from application callers?
Also searched as: Maxim.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
Specialist gateways
Braintrust AI Proxy # Proxy and observability sit within Braintrust's architecture. Data-plane hosting and logging choices need to be assessed together.
Evaluation question & research context Where are request logs and evaluation datasets stored?
Also searched as: Braintrust proxy.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Cloud gateways
Cloudflare AI Gateway # Account-level AI Gateway permissions can cover all gateways, including stored BYOK credentials. Logging behaviour changed for new customers from 24 September 2026.
Evaluation question & research context How are tenants separated and which logging generation applies to your account?
Also searched as: Cloudflare.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Hosted model aggregator. Published privacy claims need a deployment-specific contractual scope.
Evaluation question & research context Which upstreams receive content and which contractual exceptions apply?
Also searched as: Comet API.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Cloud gateways
Databricks AI Gateway # Unity-oriented gateway services and legacy Mosaic endpoints have different controls. Inference-table payload capture is a separate configuration.
Evaluation question & research context Which service generation and payload-capture settings are enabled?
Also searched as: Unity AI Gateway, Mosaic.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Hosted aggregation across AI services. The data-processing agreement and provider exceptions matter alongside security descriptions.
Evaluation question & research context Does the DPA cover each selected service and subprocessor?
Also searched as: Eden AI.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Specialist gateways
Envoy AI Gateway / Agent Router # Project naming and repository have moved towards Agent Router. Advisories retain the Envoy AI Gateway name and component scope.
Evaluation question & research context Which release and MCP request-processing path are actually deployed?
Also searched as: Envoy, Agent Router.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
API platforms
F5 NGINX Gateway Fabric # AI Guardrails integration is a configured stack feature, not a property of every NGINX proxy. Verify policy acceptance and request-size handling.
Evaluation question & research context Which guardrail integration and enforcement status are active?
Also searched as: NGINX, F5.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Hosted router with routing and privacy descriptions. Confirm the effective configuration rather than infer it from feature names.
Evaluation question & research context What happens to data and cost when a route falls back?
Also searched as: Fast Router.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Related products
GitLab AI Gateway # Application-specific gateway for GitLab Duo, not a general interchangeable model router. Hosted and self-hosted patch responsibilities differ.
Evaluation question & research context Which Duo access and flow-template capabilities are exposed?
Also searched as: GitLab Duo.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
AI policies and masking are edition and flow-order dependent. Payload logging introduces its own memory and retention needs.
Evaluation question & research context Is masking applied before every logger and export in this edition?
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Specialist gateways
Helicone # Observability can capture requests automatically. Retention and self-hosting depend on the selected service and configuration.
Evaluation question & research context Which content fields are logged, for how long, and under whose account?
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Gateway with AI provider and security-guard plugins. Plugin selection and policy order define the effective behaviour.
Evaluation question & research context Which request and response paths are covered by the selected plugins?
Also searched as: Alibaba Higress.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Hosted routers
Hugging Face Inference Providers # Hugging Face's own request handling and metadata retention differ from upstream provider policies. Dedicated Inference Endpoints are a separate service.
Evaluation question & research context Which provider receives the request, and are its retention terms approved?
Also searched as: HF, HuggingFace.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
API platforms
IBM API Connect # AI support and limits vary between SaaS and software versions, including watsonx integrations.
Evaluation question & research context Which AI features and limitations apply to your deployment and release?
Also searched as: IBM, API Connect.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Kubernetes gateway with AI extensions. Envoy-based documentation is versioned; prompt guards and rate limits need configured policies.
Evaluation question & research context What happens if an external guard or rate-limit service is unavailable?
Also searched as: K Gateway.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
API platforms
Kong AI Gateway # Traditional AI Proxy plugins and newer AI Gateway offerings have distinct version and deployment scopes.
Evaluation question & research context How is streaming usage reconciled against provider invoices?
Also searched as: Kong, AI Proxy.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
Specialist gateways
LangDB # AI gateway with observability. Documented ClickHouse TTL deletion runs through asynchronous merges.
Evaluation question & research context What deletion latency applies to logs, backups and exports?
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Policy dated 1 October 2026 distinguishes database storage from response and semantic caches, which default to 15 minutes; no-persistence is a separate choice.
Evaluation question & research context Are response caching and semantic caching disabled for sensitive routes?
Also searched as: Lean Route.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Specialist gateways
LiteLLM # Python proxy and SDK distribution are distinct from the vendor's pinned proxy Docker distribution.
Evaluation question & research context What package or image digest is running, and how are credentials rotated after an incident?
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
Hosted routers
LLM Gateway # Metadata-only logging is described as the default; payload logging is an opt-in setting. Upstream retention remains separate.
Evaluation question & research context Which content logging options and upstream terms are enabled?
Also searched as: LLMGateway, theopenco.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Inference engines
LM Studio # Desktop and headless model runtime with an API server. Authentication is optional; network serving and LM Link alter the access and execution boundary.
Evaluation question & research context Are API-token permissions enforced, which machine executes each model, and what model-loading and eviction behaviour does the application rely on?
Also searched as: LMStudio, LM Studio llmster, llmster, lms.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
Specialist gateways
Lunar.dev # Gateway and traffic-management offering. Production logs and data-plane placement need their own review.
Evaluation question & research context Which data leaves the gateway through logs or management integrations?
Also searched as: Lunar.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Hosted routing gateway. Authentication documentation establishes an API boundary, not every enterprise data-control claim.
Evaluation question & research context What route decision evidence and data-processing terms can be supplied?
Also searched as: With Martian.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Specialist gateways
MLflow AI Gateway # Current gateway documentation distinguishes development credential-encryption defaults from production key management and SQL-backed rotation.
Evaluation question & research context Is a production encryption secret configured and is rotation rehearsed?
Also searched as: MLflow.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Specialist gateways
New API # Project with quota and billing functions. Release-candidate version scope matters in the quota-overflow advisory.
Evaluation question & research context Can credits, reservations and final charges be reconciled under concurrent requests?
Also searched as: QuantumNous, new-api.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
Specialist gateways
nexos.ai # Hosted gateway and AI platform. Procurement needs the service contract, provider list and configured routing policy.
Evaluation question & research context What geography and retention commitments cover every fallback?
Also searched as: Nexos.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Related products
Not Diamond # Routing and model-selection API. It is listed as a related product rather than assumed to implement a full gateway boundary.
Evaluation question & research context Which controls reside in your calling application and which in the routing service?
Also searched as: NotDiamond.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Local model runtime and API, with optional cloud-model features. The local API does not require authentication; cloud API credentials and cloud processing are a separate mode.
Evaluation question & research context Is execution local or cloud, who can reach inference and model-management endpoints, and how do context, parallel requests and model residency fit memory?
Also searched as: Ollama local server, Ollama Cloud.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
Specialist gateways
One API # Separate project from New API. Model mappings and protocol reconstruction can affect unsupported fields.
Evaluation question & research context Which request fields survive translation, including tools and usage options?
Also searched as: songquanpeng.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Specialist gateways
OneVir # OneQuill's own product combines gateway controls and local execution paths. This profile is affiliated and is not an independent security assessment.
Evaluation question & research context Which controls are enabled in your installed version, and which remain the inference backend's responsibility?
Also searched as: OneQuill.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Affiliation: OneQuill develops OneVir. Own implementation evidence and limits .
Provider routing, fallback and endpoint-level privacy controls need to be configured together. ZDR and geography are route properties.
Evaluation question & research context Can every selected endpoint and fallback satisfy the same privacy constraints?
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Specialist gateways
OpenZiti LLM Gateway # Identity-based overlay networking is relevant to gateway access. Platform network features do not establish every application-level safeguard.
Evaluation question & research context How are service identities issued, revoked and separated between tenants?
Also searched as: Ziti.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Security overview updated 5 October 2026: upstream inference is not EEA-restricted by default. Tracing, backups and provider retention have separate rules.
Evaluation question & research context Does the selected route meet geography and retention needs, including backups?
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Specialist gateways
orq.ai # Gateway within an orchestration platform. Vendor security claims and logging retention must be matched to the purchased deployment.
Evaluation question & research context Which attestations and retention settings cover this service and edition?
Also searched as: Orq.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Agent proxy project formerly named Arch. Establish the current component boundaries and supported deployment before comparing controls.
Evaluation question & research context Which tool, model and policy paths pass through Plano?
Also searched as: Arch, Arch Gateway.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Specialist gateways
Portkey / Prisma AIRS AI Gateway # Portkey commercial offerings have moved into Prisma AIRS. The selected advisory applies to the open-source Portkey gateway; it does not establish managed-service exposure.
Evaluation question & research context Which product, build and custom-host policy are you evaluating?
Also searched as: Portkey AI, Prisma AIRS.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
Gateway logging, caching and upstream retention are separate. EU router processing does not establish the upstream inference location.
Evaluation question & research context Does this plan and route prohibit training and retention at every layer?
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
LLM and multimodal serving framework with distributed workers and prefix-cache reuse. The inference API, administrative controls and worker channels have distinct trust boundaries.
Evaluation question & research context Which API and admin keys, worker networks, model-loading features and cache isolation are configured in the installed release?
Also searched as: SGLang Runtime, SGLang serving framework, sgl-project.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
Specialist gateways
TensorZero # Gateway authentication is an explicit operational configuration with PostgreSQL support. Dashboard access is a separate boundary.
Evaluation question & research context Are both the gateway and dashboard authenticated for this deployment?
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Specialist gateways
Tetrate Agent Router # Hosted Agent Router Service and enterprise customer-hosted data plane have different data flows. The management plane is separately hosted.
Evaluation question & research context What crosses between your data plane and the hosted management plane?
Also searched as: Agent Router Service, TARS, Tetrate Enterprise.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Hub AI middlewares include Redis-backed shared token limits. Interrupted streams and response-completed events affect usage measurement.
Evaluation question & research context Does incomplete-stream usage reach the budget ledger?
Also searched as: Traefik.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Specialist gateways
TrueFoundry # Gateway, traces and deployment platform. Residency-aware fallback is a vendor-described configuration, not proof of your route policy.
Evaluation question & research context Can the vendor show that all retries and fallback targets satisfy your residency policy?
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
API platforms
Tyk AI Studio / MCP Gateway # AI Studio, chat and MCP offerings are separate capabilities in the Tyk ecosystem.
Evaluation question & research context Which model-routing and tool-access controls are available in the purchased product?
Also searched as: Tyk AI Studio, Tyk MCP.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Hosted routers
Vercel AI Gateway # Gateway content deletion and provider ZDR arrangements have separate scope and eligibility.
Evaluation question & research context Which providers and plan-specific agreements implement the required ZDR setting?
Also searched as: Vercel.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Inference engine and serving stack. API authentication, internal networks, model loading and GPU scheduling are separate boundaries from a gateway.
Evaluation question & research context Which engine, features, model format and cluster topology are deployed?
Also searched as: vLLM Production Stack.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
API platforms
WSO2 API Manager # AI token policies and backend throttling have different enforcement paths. Local per-node limits differ from distributed Traffic Manager policies.
Evaluation question & research context Which counters are shared across replicas and regions?
Also searched as: WSO2, APIM.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.
Turning off Data Services changes ZenMux logging and related features. It does not independently establish upstream zero retention.
Evaluation question & research context Which data services are disabled and what provider retention remains?
Also searched as: Zen Mux.
Evidence: documented behaviour · Sources reviewed 2026-10-07 . These links establish the cited scope, not an independent audit of every feature.
No case was selected for this profile. This does not establish the presence or absence of vulnerabilities.