Home/Docs/System Architecture
INFRASTRUCTURE MAP

System Architecture

Under the hood of Selixes: deep dive into the proxy pipeline, transaction telemetry, Redis token-locked budget gates, and edge continuity routing.

🔍 Dynamic Proxy Pipeline Overview

Selixes is containerized to deploy directly inside your secure cloud boundary (VPC) or local developer machine. It functions as an HTTP reverse-proxy layer sitting between your client application code and upstream model providers (OpenAI, Anthropic, Gemini).

When your SDK dispatches a prompt, Selixes intercepts the request socket, parses custom budget controls in the headers, checks active session caches, and coordinates connections. The transit latency overhead introduced by this middleware is under 15 milliseconds.

🧬 Execution Flow & Telemetry

Below is the lifecycle of an AI completion request routing through the sovereign gateway proxy:

SourceClient ApplicationPOST /v1/chat/completions
🛡️ Selixes Gateway Proxy< 15ms Overhead
Redis Budget GateAtomic token quota & spend validation
Circuit BreakerReal-time health & latency monitor
Healthy
Outage
Primary CloudOpenAI / Anthropic
Standby FallbackGemini / DeepSeek
Local continuityOllama / Llama 3

💾 Telemetry Storage Primitives (Postgres + Redis)

To enforce session budget limits concurrently across multiple parallel agent worker nodes, Selixes implements a dual-database architecture:

  • Redis Cache Layer: Stores transient session keys, active concurrency counts, and sliding-window rate limit counters. When a request comes in, Redis decrements limits in under 1ms. If limits are breached, it returns HTTP 429 immediately without initiating external connections.
  • Postgres Analytics Ingest: Stores detailed transaction traces, prompt token counts, cost allocations, and failover latency histories. These telemetry traces power the observability dashboards and compile weekly resiliency reports.

🔌 Edge Sandboxing & Ollama Backups

In high-security enterprise environments or during catastrophic cloud failures, external connection calls can fail. To counter this, Selixes contains an integrated **Zero-Cost Continuity Engine**.

If all cloud endpoints timeout or fail authentication, the gateway redirects socket flows to your local edge network. It boots a sandboxed local-model container (standardizing on Llama-3 via Ollama) running on your VPC hardware metal, ensuring absolute operational survival with zero data leaks outside the boundary.

📐 Operational Benchmarks

Benchmark MetricValueImpact / Rationale
Middleware Latency< 15msMinimal transit delay added by header parsing and session token lookups.
Failover Switch Time< 20msAutonomic swap from offline primary provider to standby endpoints.
Redis Query Cost< 1.2msHigh-throughput sliding cost check before admitting prompt tokens.
Memory Footprint180 MBDocker container footprint under idle conditions, optimized for edge nodes.
Supported Throughput12,500 req/secSustained proxy completions per instance with active socket pooling.

Next Up: API Specifications

Review custom headers, payload structures, and response schemas.

View API Reference ->