We designed and deployed a GPT-powered submission processing system over 10 weeks. Document processing pipeline (weeks 1-4). Document classification: AI classifying incoming submission documents by type — ACORD application, loss run, financial statement, supplemental questionnaire, property schedule, fleet list, and SOV. Classification accuracy: 97.8% across document types. The classification: routing each document to the appropriate extraction pipeline. OCR and extraction: document processing pipeline — PDF text extraction (for digital PDFs), OCR (for scanned documents), and table extraction (for financial statements and loss runs). The pipeline: handling the document quality variations that real-world submissions present — some documents professionally prepared PDFs, others faxed photocopies of handwritten applications. GPT-powered extraction: document-type-specific prompts extracting structured data from unstructured documents.
Extraction examples: ACORD application extraction (insured name, address, SIC code, employee count, revenue, operations description, years in business, requested limits and deductibles — 42 data fields extracted from application forms), loss run extraction (each claim extracted with date, type, status, paid, reserved, and total incurred — then structured into annual summaries showing frequency and severity trends), financial statement extraction (revenue, net income, total assets, current ratio, debt-to-equity — financial metrics relevant to underwriting assessment), property schedule extraction (each location with address, construction type, year built, occupancy, building value, BPP value, and protection class). Data validation: extracted data validated against business rules — SIC code valid, state valid, requested limits within appetite, financial ratios within acceptable ranges. Validation failures: flagged for underwriter attention rather than silently accepted. Submission analysis engine (weeks 3-7).
Risk summary generation: GPT analysing the complete submission package and generating a structured risk summary — a 2-page underwriting brief containing: business description (synthesised from application, financial statements, and supplemental questionnaires — a clear description of what the insured does, how large they are, and what their primary risk exposures are), loss analysis (structured analysis of loss history — frequency trend (increasing, stable, decreasing), severity trend, loss ratio by year, large loss identification, and pattern identification. The analysis: highlighting the loss patterns that experienced underwriters would identify, ensuring consistent analysis across all submissions), risk concerns (GPT-identified risk factors — industry risk level, geographic risk (CAT exposure, crime rates), financial stability assessment, loss trend concerns, and operational risk factors identified from application and supplemental data), appetite assessment (preliminary assessment of whether the submission fits the carrier's underwriting appetite — considering industry, geography, size, and loss history.
The assessment: flagging submissions that clearly fall outside appetite for quick decline, and identifying submissions that clearly fit appetite for fast-track processing), and comparable analysis (comparing the submission against the carrier's book — similar accounts by industry, size, and geography, showing how those accounts have performed. The comparison: giving underwriters context for their pricing and risk selection decisions). Workstation integration (weeks 5-9). Underwriting workstation integration: GPT-extracted data and risk summaries delivered directly into the existing underwriting workstation — underwriters receiving a pre-populated submission screen with all key data extracted, validated, and ready for review. One-click acceptance: underwriters reviewing GPT-extracted data and accepting with one click (confirming accuracy) rather than manually entering 42 data fields. Corrections: when GPT extraction is wrong (2-3% of fields), underwriters correcting the specific field — correction data feeding back into model improvement.
Workflow automation: submission routing automated based on GPT analysis — clearly out-of-appetite submissions routed to decline queue (with GPT-drafted decline letter), clearly in-appetite submissions fast-tracked for quick quote, and complex submissions routed to senior underwriters with full analysis package. Priority scoring: submissions scored by GPT based on estimated desirability — considering loss ratio prediction, account size, and strategic fit. Underwriters: reviewing highest-priority submissions first rather than processing in receipt order. Quality assurance (weeks 7-10). Accuracy validation: GPT extraction accuracy validated against 500 manually processed submissions — field-level accuracy measured for each data element and document type. Overall extraction accuracy: 94.6% across all fields (with specific fields ranging from 88% (handwritten supplemental questionnaires) to 99.2% (ACORD application structured fields)). Risk summary quality: 200 GPT-generated risk summaries reviewed by senior underwriters — rated for accuracy, completeness, and usefulness.
Senior underwriter assessment: 91% of risk summaries rated "accurate and useful" or "accurate with minor additions needed." Continuous improvement: feedback loop — underwriter corrections to GPT-extracted data captured and used for prompt refinement and model fine-tuning. Accuracy improving monthly as the system learns from corrections.