Senior Data Engineer

I'm recruiting a Senior Data Engineer to join an established organisation continuing a significant modernisation of its data capability.

Over the last couple of years, the business has been moving away from a legacy data estate and establishing a modern Microsoft Fabric/Azure platform.

The next stage is about turning those foundations into a genuinely modern, code-led engineering environment.

This is a hands-on Senior Data Engineer role. They aren't looking for someone who wants to move away from development into pure management.

You'll work across:

Python / PySpark
Microsoft Fabric
Spark and notebook engineering
Lakehouse / Medallion architecture
Delta
SQL
Azure
Git / CI/CD
Automated testing
Data quality and observability
Reusable engineering patterns

They're particularly interested in people coming from Databricks/PySpark environments, so extensive Fabric experience isn't essential.

At Senior level, you'll also have the opportunity to influence architecture, technical design, coding standards, CI/CD, testing and engineering best practice, while supporting other engineers and taking ownership of more complex technical problems.

There's still a significant amount to build, and the longer-term direction extends beyond traditional data engineering into AI, Generative AI and intelligent automation.

It's a good ...