We built a custom integration platform that scaled the company from 18 to 85+ connectors over 7 months. Integration framework architecture (months 1-3). Connector framework: a standardised framework for building and managing integrations — each connector following a consistent architecture with pluggable components for authentication, data retrieval, transformation, and delivery. The framework: new connectors built in 1-2 weeks rather than 6-8 weeks, with consistent quality and behaviour. Framework components: authentication manager (handling OAuth 2.
0, API keys, basic auth, and custom authentication for each connected platform), data adapter (standard interface for retrieving and sending data to each platform — abstracting each platform's API specifics behind a consistent connector interface), transformation engine (configurable data mapping and transformation — field mapping, value translation, formula calculation, and conditional logic applied during data transit), sync engine (orchestrating data synchronisation — full sync, incremental sync, real-time webhook processing, and conflict resolution for bidirectional sync), and error handler (consistent error detection, classification, retry, and escalation across all connectors — transient failures retried automatically, persistent failures queued and surfaced). Connector development velocity: the framework enabling rapid connector development — each new connector requiring only the platform-specific code (API client, authentication flow, data model mapping) while the framework handled cross-cutting concerns (sync orchestration, error handling, monitoring). Development time per connector: reduced from 6-8 weeks to 1-2 weeks.
High-priority connector build (months 2-5). Connector portfolio: 67 new connectors built using the framework — 12 e-commerce platforms, 8 marketplaces, 14 shipping carriers, 8 accounting systems, 7 POS systems, 6 WMS platforms, 5 ERP systems, and 7 additional operational tools. Connector quality: all connectors built to the framework standard — consistent authentication handling, error management, monitoring, and the data sync reliability that the framework enforced. The quality: every connector operating at the quality level of the best original connector. Priority sequencing: connectors prioritised by customer demand data — analysing lost deals, feature requests, and competitive analysis to build the connectors that would recover the most revenue first. Self-service integration management (months 4-6). Customer configuration portal: customers configuring their own integrations through a self-service interface — connecting their e-commerce platforms, marketplaces, and shipping carriers without engineering involvement.
Configuration flow: guided setup — authenticate with the connected platform (OAuth flow), select sync options (which data to sync, in which direction, how frequently), configure field mapping (visual field mapper showing source fields and destination fields with drag-and-drop mapping), and test the connection (automated validation that the integration was working correctly). The portal: customer integration setup reduced from 2-3 weeks to 30-60 minutes of self-service. Field mapping templates: pre-built mapping templates for common configurations — "Shopify standard mapping," "Amazon FBA mapping," "QuickBooks standard chart of accounts mapping" — that covered 80% of customer configurations with one-click setup. Custom mapping: visual mapper for the 20% of customers needing non-standard field mapping. The templates: most customers set up with zero custom configuration. Integration health dashboard: customers seeing their integration status — sync frequency, last sync time, data volume, error count, and resolution status.
The dashboard: customers monitoring their own integration health rather than contacting support. Operational infrastructure (months 5-7). Integration monitoring: centralised monitoring across all connector instances — sync success rates, latency, error patterns, and API health tracked per connector, per customer, and at platform level. Alert thresholds: configured per connector based on expected behaviour — a Shopify connector syncing every 5 minutes alerting differently from a QuickBooks connector syncing daily. The monitoring: integration health managed proactively across 85+ connectors and 4,100 customers. API change management: automated API change detection — monitoring third-party platform changelogs, testing connectors against API updates in sandbox environments, and updating connectors before breaking changes reached production. The management: preventing the reactive "API broke, fix it urgently" cycle that had consumed engineering time. Scale testing: each connector load-tested at 10x current customer volume — ensuring connectors could handle customer growth without performance degradation.
The testing: integration infrastructure that scaled with the business.