SyncStream

Activated Insights ·

Visit project ↗

I helped design and build SyncStream, our next-generation integrations platform, to replace a legacy engine built on an expensive no-code integration tool.

While the original system enabled early integrations, it became difficult to extend, debug, and operate, leading to slow development cycles and limited observability.

We rebuilt the platform using modern Python tooling and AWS services, implementing event-driven pipelines and durable storage in S3 to reliably ingest and process data across multiple products. By moving to a code-driven framework, we improved debuggability, reduced operational costs, and significantly accelerated the development of new integrations.

Within the platform, I had full ownership of our vendor integrations, which processed data through several different mechanisms: webhooks, batch-based replication, and SFTP file transfers.

Nick Kelly