One of the most impactful 0-to-1 projects I led was building a comprehensive data lakehouse from scratch, despite having no prior data engineering experience. I was tasked with creating a centralized data platform to unify analytics across eight different SaaS products.
I began by conducting extensive research into lakehouse architecture, enrolling in a Udemy course on building data lakes with AWS to rapidly acquire the necessary expertise. I transformed this knowledge into actionable insights by drafting a comprehensive design document, which received leadership approval.
Subsequently, I developed a proof of concept utilizing Docker, FastAPI, Airbyte, and AWS services. I collaborated with our principal architect to deploy cloud infrastructure using our already established IaC framework.
To scale the initiative effectively, I spearheaded the development of a Python framework that enabled our team to onboard new data sources in days rather than weeks.
The final outcome—we successfully delivered the complete lakehouse solution months ahead of the original schedule.