ChallengeA Zurich private bank (CHF 28 billion AUM, 450 employees, serving UHNW clients across Switzerland, Europe, and the Middle East) was undertaking a major digital transformation: migrating from a legacy core banking system to Avaloq, implementing a new digital banking platform (e-banking and mobile banking for clients), upgrading the portfolio management system, and implementing a new CRM for relationship managers. The transformation involved: 4 major system implementations running in parallel, 180+ integrations between systems (core banking ↔ portfolio management ↔ CRM ↔ digital channels ↔ regulatory reporting ↔ payments), 12,000+ existing client accounts to migrate (with complete transaction history, portfolio positions, and document archives), regulatory requirements across multiple jurisdictions (Switzerland, EU cross-border, Middle East booking centre), and a fixed go-live deadline driven by the legacy system's end-of-support. The QA challenge was significant: the bank had a small internal IT team (25 people — stretched across all four projects) with limited testing expertise. Previous testing had been informal — developers testing their own code, business users performing ad hoc acceptance testing, no formal test management or automation. The bank needed: a comprehensive test strategy covering all four projects, test automation for regression testing (manual regression testing of all systems after each change would require weeks), integration testing across all 180+ interfaces, data migration testing for 12,000+ accounts, and regulatory compliance validation (ensuring the new systems met all FINMA, FinSA, and AMLA requirements).
SolutionWe established a QA programme over 16 weeks (with ongoing execution over the 18-month transformation). Test strategy and governance (weeks 1-4): we developed: a master test plan covering all four projects — defining test levels (unit, integration, system, UAT, regression), test types (functional, performance, security, regulatory, migration), responsibilities (ZTABS, internal IT, business users), environments (development, test, staging, pre-production — all on Swiss infrastructure), and entry/exit criteria for each test level. Test data management strategy: creating synthetic test data that: replicated the complexity of real client portfolios (multi-currency, multi-asset-class, multi-custodian), included edge cases (very large portfolios, unusual instrument types, complex fee structures), covered all four languages (German, French, Italian, English client profiles), and complied with nDSG (no real client data in test environments — synthetic data generated from statistical profiles of real data, anonymised and validated by compliance). Test automation framework (weeks 3-8): we implemented: API test automation (using a framework that tested all 180+ integrations): core banking API tests (Avaloq REST APIs — account operations, transaction processing, position queries, client data management), payment processing tests (SIC, SWIFT, SEPA — testing payment initiation, validation, processing, and reconciliation), portfolio management API tests (position transfer, valuation, performance calculation, rebalancing), and CRM integration tests (client data synchronisation, activity logging, document management). UI test automation: e-banking platform (testing in: German, French, Italian, English — across Chrome, Safari, Firefox, Edge — desktop and tablet), mobile banking app (iOS and Android — automated testing of: login flows, portfolio viewing, transaction initiation, QR-bill scanning, document access), and relationship manager CRM (desktop application testing — client profile management, meeting notes, task management, compliance workflows). Performance test suite: transaction throughput testing (simulating peak-day transaction volumes — 15,000+ transactions/hour), concurrent user testing (500 simultaneous e-banking users, 200 mobile app users, 150 internal users), and report generation testing (end-of-day processing, client reporting, regulatory reporting — under production-like data volumes). Data migration testing (weeks 6-14): migration testing was the most critical workstream: we developed automated comparison tools that validated: account data (every field of every account record — account type, currency, opening date, status, restrictions, signatories — compared between legacy and Avaloq), transaction history (every transaction record — date, amount, currency, counterparty, reference — reconciled between systems), portfolio positions (every security holding — ISIN, quantity, cost basis, acquisition date — matched between systems), client documents (every stored document — accessible, correctly linked to client, correctly categorised), and calculated values (portfolio valuations, accrued interest, unrealised gains/losses — independently calculated and compared with system outputs). Migration testing ran in 5 rehearsal cycles — each full migration rehearsal taking a weekend, with automated comparison running Monday, and discrepancy analysis and fix verification through the week. Rehearsal results: Rehearsal 1: 847 discrepancies found (mostly data mapping issues — field interpretation differences between legacy and Avaloq). Rehearsal 2: 124 discrepancies (mapping fixes applied; remaining issues were edge cases — unusual account structures, historical data anomalies). Rehearsal 3: 31 discrepancies (increasingly obscure edge cases — one-off historical transactions, defunct currency conversions). Rehearsal 4: 8 discrepancies (all reviewed and accepted — legacy data quality issues that were intentionally corrected during migration). Rehearsal 5: 0 critical discrepancies (3 minor cosmetic differences accepted by business). Regulatory compliance testing (weeks 8-16): specific test suites for: FinSA suitability (testing the suitability assessment engine across: 200+ client profile scenarios, 50+ product categories, and cross-border scenarios — ensuring the system correctly determined suitability for each client-product combination), AMLA/KYC (testing: client onboarding workflows, sanctions screening (against SECO and international sanctions lists), transaction monitoring rules, and suspicious activity reporting — including false positive rate optimisation), FINMA reporting (testing: regulatory return generation, SST calculation inputs, large exposure calculations, and liquidity reporting — validated against independently calculated expected results), and tax reporting (Swiss withholding tax, EU savings directive, CRS/AEOI — testing correct classification, calculation, and reporting for clients across multiple jurisdictions).
OutcomeThe QA programme ran over 18 months, covering all four project streams. Test execution volume: 14,200 test cases executed across all projects (8,400 automated, 5,800 manual). 2,847 defects identified during testing (before production deployment). Defect severity distribution: critical (12 — all found and fixed before go-live, including: a multi-currency rounding error that would have affected portfolio valuations by up to CHF 0.03 per position per day — small per position but cumulative across 12,000 accounts, and a FinSA suitability rule that incorrectly classified certain structured products as suitable for conservative risk profiles), high (187 — functional defects affecting core business processes), medium (892 — functional issues with workarounds or affecting non-critical processes), and low (1,756 — cosmetic, minor usability, and documentation issues). Automation ROI: the automated regression suite (8,400 tests) ran in 4.5 hours — compared to an estimated 15 person-days for manual execution. Over 18 months with bi-weekly regression cycles (36 cycles): automated testing saved approximately 540 person-days (CHF 675,000 in testing effort). Migration success: final production migration completed over a single weekend with zero critical discrepancies. All 12,000+ client accounts migrated successfully. Portfolio valuations reconciled to within CHF 0.01 of legacy system values. No client-impacting issues during the first week of production operation. Go-live outcomes: zero critical production defects in the first 30 days. 3 high-severity defects identified in production (all in edge cases not covered by test scenarios — subsequently added to the automated regression suite). Client complaints related to the migration: 14 (0.12% of client base) — all minor (login issues, display preferences, mobile app re-registration). FINMA: no regulatory findings related to the migration — the testing documentation (master test plan, test execution results, defect resolution evidence, migration reconciliation reports) satisfied regulatory expectations for change management evidence. Total QA programme investment: CHF 380,000. Estimated value of defects prevented: CHF 2.1 million (based on: prevented regulatory issues, prevented client-impacting errors, prevented financial calculation errors). ROI: 4.5x.