We deployed a self-hosted AI platform over 8 weeks: (1) Infrastructure -- deployed a GPU cluster (4x NVIDIA A100 80GB) in the firm's Dublin data centre, with redundancy and monitoring. The infrastructure was sized for the firm's three use cases with capacity for expansion. Network configuration ensured the AI infrastructure was accessible only from the firm's internal network -- no internet connectivity for the AI serving layer. (2) Model Deployment -- deployed Llama 3 70B as the general-purpose model, optimized for inference using vLLM with continuous batching. The model served all three use cases through a unified API that the firm's applications connected to. For investment research, the model was supplemented with a RAG system indexing the firm's research library.
(3) Client Communication Processing -- built an application that processed incoming client emails and meeting notes: summarizing key points, extracting action items, identifying follow-up requirements, and flagging compliance-sensitive content (complaints, dissatisfaction, requests for advice). Summaries and action items were delivered to portfolio managers through the firm's existing CRM. (4) Investment Research Assistant -- built a RAG-powered research tool that enabled analysts to query the firm's research library (10,000+ documents), ask questions about specific companies or sectors, and receive AI-generated analysis summaries with citations to source research. The tool supplemented (not replaced) analyst judgment, providing rapid synthesis of large document volumes. (5) Compliance Document Review -- built a tool that processed regulatory publications and internal policies: classifying regulatory changes by relevance, identifying affected internal policies, and highlighting sections requiring review. The tool integrated with the compliance team's workflow system.
(6) Governance and Monitoring -- implemented model performance monitoring (response quality sampling, latency tracking, usage metrics), access controls (role-based access to the AI platform), and audit logging (all AI queries and responses logged for compliance review).