Building pipelines that businesses can actually trust.
I design and build data pipelines on Azure and Databricks — from ETL and API ingestion to Unity Catalog migrations and modernising legacy workflows.
I started my career in data consultancy and moved into an in-house data engineering role on my first client deployment, progressing to senior within two years.
I like building things that are easy to maintain and easy to monitor, and I care about what happens after a pipeline goes live — logging, auditing and clear structure.
Most of my work is on Azure and Databricks, with a focus on ingestion, migration and simplifying legacy processes.
Migrated production pipelines to Unity Catalog, the first to be converted in the organisation, moving them from the legacy setup to UC governance.
Built an end-to-end ingestion framework on a newly released third-party API. Hourly jobs resolve download endpoints, ingest data, and log every run to a central audit table — providing full pipeline observability across all downstream consumers.
Wrote the Databricks logic that deduplicates an append-only staging layer using hash columns and writes the result to a silver layer. Silver feeds the gold layer and is shared externally via Delta Sharing. Built and deployed end-to-end with Databricks Asset Bundles.
Designed a YAML-configured notebook that allows tables to be added or removed from audit pipelines without touching code. Built to support post-acquisition data integration — a single config file drives the entire process.
If you have a project or role that you think might be a good fit, feel free to reach out and we can have a conversation.