← Documentation Home

🏠 LLM Ecosystem - Master Documentation

Enterprise AI Agent Platform | OSSA-Compliant | Production-Ready | FedRAMP Moderate

Welcome to the complete documentation for the LLM Ecosystem - a comprehensive, enterprise-grade platform for building, deploying, and managing AI agents at scale.


I want to... Go to... Time
Get started in 5 minutes Getting Started 5 min
Understand the architecture Architecture 15 min
Build my first agent Developer Guides 30 min
Deploy to production Deployment & Operations 2 hrs
View API documentation API Reference -
Ensure compliance Security & Compliance -

πŸ“‹ Platform Overview

The LLM Ecosystem is a unified platform for AI agent development, orchestration, and management. Built on open standards (OSSA, OpenAPI, Kubernetes), it provides everything needed for enterprise-scale AI deployments.

🎯 Core Capabilities

Agent Development - OSSA-Compliant Agents - Build vendor-neutral agents using the OpenAPI for AI Agents - Multi-Language Support - TypeScript, Python, PHP (Drupal) - Four Agent Roles - Governor, Worker, Critic, Observer - 200+ Agent Templates - Pre-built patterns for common use cases

Orchestration & Coordination - Agent Mesh - Backend coordination layer with gRPC - Workflow Engine - Visual workflow design (Langflow-compatible) - BuildKit CLI - Complete agent lifecycle management - Kubernetes Native - Production-ready orchestration

AI Provider Integration - LLM Gateway - Unified routing for Anthropic, OpenAI, Google, Cohere, Ollama - Smart Routing - Cost-optimized, performance-based, quality-based, failover - Apple Intelligence - Foundation Models integration - Vector Databases - Qdrant for semantic search and RAG

Enterprise Features - FedRAMP Moderate - 325 security controls implemented - NIST 800-53 Rev 5 - Complete control catalog - Multi-Tenancy - Isolated namespaces and RBAC - Auto-Scaling - HPA, VPA, Cluster Autoscaler - Complete Observability - Phoenix Arize, OpenTelemetry, Prometheus, Grafana


πŸ—οΈ Architecture at a Glance

graph TB
    subgraph "Frontend Layer"
        Drupal[LLM Platform - Drupal 11 PRIMARY]
        UI[Agent Studio - macOS/iOS/Web]
        Chat[Agent Chat - LibreChat]
        Alt[Alternative Services Dashboard]
    end

    subgraph "API Gateway Layer"
        Router[Agent Router - LLM Gateway]
        API[API Normalizer]
    end

    subgraph "Orchestration Layer"
        Mesh[Agent Mesh - Coordination]
        Workflow[Workflow Engine - Langflow]
        BuildKit[BuildKit - BAR Runtime]
    end

    subgraph "Agent Layer"
        Gov[Governors - Policy & Orchestration]
        Work[Workers - Task Execution]
        Crit[Critics - Quality Assurance]
        Obs[Observers - Monitoring]
    end

    subgraph "AI/ML Layer"
        LLM[LLM Providers - Claude, GPT-4, etc.]
        Vector[Qdrant - Vector DB]
        Apple[Apple Foundation Models]
    end

    subgraph "Data Layer"
        PG[(PostgreSQL)]
        Redis[(Redis)]
        Neo4j[(Neo4j)]
    end

    subgraph "Observability Layer"
        Phoenix[Phoenix Arize - AI Ops]
        Prom[Prometheus - Metrics]
        Jaeger[Jaeger - Tracing]
        Grafana[Grafana - Dashboards]
    end

    UI --> Router
    Chat --> Router
    Alt --> API
    Router --> Mesh
    API --> Mesh
    Mesh --> Workflow
    Mesh --> BuildKit
    Workflow --> Gov
    Workflow --> Work
    BuildKit --> Work
    BuildKit --> Crit
    BuildKit --> Obs
    Work --> LLM
    Work --> Vector
    Work --> Apple
    Gov --> PG
    Work --> Redis
    Mesh --> Neo4j
    Work --> Phoenix
    BuildKit --> Prom
    Mesh --> Jaeger
    Phoenix --> Grafana

πŸ“¦ Platform Components

🌟 LLM Platform - Drupal 11 (PRIMARY PLATFORM)

The LLM Platform is the primary user interface and management system for the entire AI agent ecosystem.

Component Purpose Status
LLM Platform Site Primary web interface & agent management Production
LLM Platform Recipe One-click installation recipe Production
Secure Drupal Recipe FedRAMP-compliant base Production
LLM Platform Manager Theme Enterprise UI theme Production

Key Features: - πŸ€– Agent Management - Create, configure, deploy, and monitor AI agents - πŸ“Š Analytics Dashboard - Real-time agent performance and cost tracking - πŸ” Compliance Center - FedRAMP, NIST 800-53, government compliance - πŸ”Œ MCP Registry - 76+ Model Context Protocol services - πŸ“ Workflow Designer - Visual agent workflow builder - πŸ›οΈ Government RFP Tools - Automated RFP response generation - πŸ“š DITA CCMS - Technical documentation management - 🎨 Charts & Analytics - AI-powered data visualization

Drupal Modules (21)

Module Purpose Status
ai_agentic_workflows Workflow automation & orchestration Production
ai_agents_client Agent client SDK Production
ai_agents_marketplace Agent marketplace & discovery Production
gov_compliance Government compliance tools Production
mcp_registry 76+ MCP services registry Production
alternative_services Service dashboard Production
code_executor Secure code execution Production
dita_ccms DITA documentation system Production
charts_ai_analytics AI-powered analytics Production
+12 more View all modules β†’ -

NPM Packages (15)

Package Purpose Status
@bluefly/agent-brain Vector DB orchestration Production
@bluefly/agent-mesh Backend coordination layer Production
@bluefly/agent-protocol MCP & OSSA protocol Production
@bluefly/agent-router LLM Gateway Production
@bluefly/agent-studio Multi-platform IDE Production
@bluefly/agent-tracer AI Ops intelligence Production
@bluefly/workflow-engine Langflow bridge Production
@bluefly/compliance-engine FedRAMP/NIST Production
+7 more View all packages β†’ -

πŸ—ΊοΈ Documentation Map

πŸŽ“ Learning Path

New to the Platform? 1. Getting Started - Installation and setup 2. Developer Guides - Build agents and workflows 3. Tutorials & Examples - Hands-on guides 4. Troubleshooting - Resolve issues

Ready to Deploy? 1. Architecture - Understand the system 2. Deployment & Operations - Deploy anywhere 3. Security & Compliance - Secure your platform 4. Observability & Analytics - Monitor everything

Building Agents? 1. Standards - Learn best practices 2. Developer Guides - Build agents 3. Testing & Quality - Test everything 4. Migration Guides - Migrate from other frameworks


πŸ“š Core Documentation

🎯 Getting Started Installation, setup, and first steps. Get running in 5 minutes. - Quick start guide - System setup and configuration - Platform overview - API essentials

πŸ“ Standards & Specifications OSSA, OpenAPI, TDD standards, and best practices. - OSSA specification and compliance - OpenAPI standards - Code style guides - Development best practices

πŸ—οΈ Architecture System design, components, and patterns. - System components and design - Integration patterns - Scalability strategies - High-level overview


πŸ’» Development

πŸ”§ Developer Guides Package documentation, Drupal development, agent creation. - NPM packages overview - Drupal module development - Agent creation guide - CLI tools reference

πŸ“‘ API Reference Complete API catalog with 240+ services. - API documentation - Service specifications - Authentication methods - Integration examples

πŸ§ͺ Testing & Quality TDD methodology, quality gates, and automation. - Test-driven development methodology - Code quality standards - Testing strategies - Quality assurance tools


πŸš€ Operations

πŸš€ Deployment & Operations Production deployment, CI/CD, monitoring. - Local development setup - Kubernetes deployment guide - Infrastructure configuration - Production operations

πŸ“Š Observability & Analytics AI Ops, tracing, metrics, monitoring. - Agent monitoring and tracing - Metrics and dashboards - Log aggregation - Performance monitoring

πŸ›‘οΈ Security & Compliance FedRAMP, NIST, encryption, RBAC. - Security architecture - Compliance frameworks - Encryption standards - Access control


πŸ“– Learning & Support

πŸŽ“ Tutorials & Examples Hands-on guides and working examples. - Quick start tutorials - Step-by-step guides - Integration examples - Code samples

πŸ” Migration Guides Framework and version migrations. - Framework migration guides - Version upgrade paths - Platform migrations - Data migration strategies

πŸ› οΈ Troubleshooting Common issues, debugging, error codes. - Common problems and solutions - Component-specific guides - Debugging techniques - Error reference


πŸ“š Reference

πŸ“š Reference CLI commands, configuration, schemas. - Command reference - Configuration guide - Schema documentation - Glossary and terms

πŸ“ Release Notes Platform releases, changelogs, upgrades. - Platform updates - Component releases - Breaking changes - Upgrade information


🎯 By Your Role

Choose your path based on your role:

Developers

Path: Getting Started β†’ Developer Guides β†’ API Reference β†’ Testing

  1. Getting Started - Setup your environment
  2. Developer Guides - Build with the platform
  3. API Reference - Integrate services
  4. Testing & Quality - Test-first development
  5. Tutorials & Examples - Learn from examples

Architects

Path: Architecture β†’ Standards β†’ Deployment β†’ Security

  1. Architecture - Understand the platform
  2. Standards - Learn best practices
  3. Deployment & Operations - Production architecture
  4. Security & Compliance - Security design
  5. Observability & Analytics - Monitoring strategy

DevOps Engineers

Path: Deployment β†’ Observability β†’ Security β†’ Troubleshooting

  1. Deployment & Operations - Deploy infrastructure
  2. Observability & Analytics - Monitor everything
  3. Security & Compliance - Secure operations
  4. Troubleshooting - Resolve issues
  5. Standards - Follow best practices

Compliance Officers

Path: Security & Compliance β†’ Standards β†’ Architecture

  1. Security & Compliance - Compliance framework
  2. Standards - Security standards
  3. Deployment & Operations - Operational compliance
  4. Architecture - System design for compliance
  5. Reference - Configuration and standards

πŸ“Š Platform Statistics


🌐 External Resources


πŸ“ž Getting Help


Last Updated: 2025-11-22
Documentation Version: 1.0.0
Platform Versions: See Release Notes

Built with: OSSA v0.2.4 | Drupal 11 | Kubernetes 1.28+ | Node.js 20+ | PHP 8.3+