We designed and deployed a sovereign AI platform over 20 weeks. Infrastructure deployment (weeks 1-6). GPU cluster: 8× NVIDIA H100 GPUs deployed in the entity's government data centre — providing the compute capacity for the entity's current AI workloads with 60% headroom for growth. The infrastructure: designed for Abu Dhabi data centre conditions — enhanced cooling for GPU thermal management, redundant power (the government data centre already having dual power feeds and UPS), and high-bandwidth internal networking (InfiniBand for GPU-to-GPU communication during fine-tuning, 100Gbps Ethernet for model serving). Platform stack: Kubernetes (K3s for lightweight management) orchestrating model serving — vLLM for LLM inference, Triton Inference Server for non-LLM models (document classification, named entity recognition, sentiment analysis), and MinIO for model artifact storage. Monitoring: Prometheus + Grafana for infrastructure monitoring, custom dashboards for AI workload metrics (inference latency, throughput, GPU utilisation, queue depth).
Security: the platform deployed within the entity's existing security perimeter — network segmentation isolating AI infrastructure, access controls integrated with government identity management, all inference requests logged for audit, and encrypted storage for models and data. Falcon LLM deployment (weeks 4-10). Model deployment: Falcon-40B deployed as the primary LLM — handling citizen chatbot, document summarisation, correspondence drafting, and general language tasks. Falcon-7B: deployed for lightweight tasks — classification, entity extraction, and simple Q&A — providing fast inference for high-volume, lower-complexity workloads. Arabic fine-tuning: Falcon-40B fine-tuned on the entity's Arabic document corpus — 50,000 government documents, 20,000 citizen correspondence samples, and 10,000 Arabic Q&A pairs derived from the entity's existing chatbot logs. Fine-tuning approach: LoRA (Low-Rank Adaptation) preserving the base model's general capabilities while adapting Arabic language quality and government domain knowledge. Fine-tuning results: Arabic citizen chatbot response quality improving from 3.2/5 (cloud model) to 4.
4/5 (fine-tuned Falcon) as rated by Arabic language specialists. Government Arabic formality: the fine-tuned model generating responses in the appropriate formal Arabic register expected in government communication — something the generic cloud model consistently failed to achieve. Multi-model orchestration (weeks 8-14). Model routing: intelligent request routing — citizen chatbot queries routed to Falcon-40B (requiring high-quality Arabic generation), document classification routed to Falcon-7B (requiring fast, simple classification), document OCR routed to a specialised Arabic OCR model, and named entity recognition routed to a fine-tuned NER model for Arabic government entities. The orchestration: ensuring each task used the most efficient model — not every request needing the largest, most expensive model. GPU efficiency: the 8× H100 cluster handling all workloads with 40% average utilisation — the multi-model approach preventing the GPU waste that would occur if every request were served by a single large model. Application migration (weeks 10-18).
Migrating 12 AI-powered applications from cloud APIs to the self-hosted platform — citizen chatbot (Arabic-English bilingual, 15,000+ conversations/day), document summarisation (government documents — meeting minutes, policy papers, reports), correspondence generation (Arabic government correspondence — formal letters, circulars, notifications), document classification (incoming documents categorised by department, urgency, and type), sentiment analysis (citizen feedback analysis — Arabic social media and survey responses), translation (Arabic-English government document translation), data extraction (structured data extraction from unstructured Arabic documents — names, dates, reference numbers, amounts), and 5 department-specific AI applications (custom models for specific departmental workflows). Migration: gradual — each application migrated individually, tested against the cloud version for quality parity, and switched over only after validation. Shadow mode: running self-hosted and cloud in parallel for 2 weeks per application — comparing outputs to verify self-hosted quality matched or exceeded cloud quality. Testing and optimisation (weeks 16-20).
Performance testing: load testing all 12 applications under peak conditions — simulating Ramadan usage patterns (compressed working hours concentrating usage into shorter periods), end-of-month peaks (government deadline-driven usage spikes), and concurrent Arabic + English requests. Performance results: average inference latency 180ms (vs. 320ms for cloud API calls — 44% faster due to eliminating network round-trips), peak latency (P99) 450ms (vs. 1,200ms for cloud — 62% reduction in tail latency), throughput capacity: 50,000 inferences/hour (exceeding current peak of 32,000 with growth headroom). Arabic quality validation: comprehensive Arabic quality assessment — Arabic language professionals evaluating outputs across all 12 applications. Quality results: Arabic quality score 4.3/5 average across all applications (vs. 3.4/5 for cloud models) — the fine-tuned Falcon models producing consistently better Arabic than generic cloud models.