Data Engineering Lead

Data Engineering Lead

Scroll down for a complete overview of what this job will require Are you the right candidate for this opportunity

Newark - Flexible Hybrid Working

Permanent

Package: up to 90'000k

We are recruiting for an experienced Data Engineering Lead, working for one of the UK's leading technology and cloud services providers, as they continue to invest in a modern, scalable Microsoft Fabric data role owns the end-to-end data engineering architecture - from ingestion and lakehouse design to enabling trusted, self-service analytics across the organisation. You will lead a small engineering team, define technical standards, and work closely with senior stakeholders to ensure data underpins strategic and operational decision-making.

Role Purpose

To take ownership of the organisation's data platform architecture and delivery, ensuring reliable, scalable ingestion pipelines, a well-designed data warehouse, and high-quality analytics products. The role combines hands-on technical leadership with people management and cross-business collaboration.

Key Responsibilities

Data Platform & Architecture

• Own the data warehouse schema, lakehouse design, and core data models
• Translate business requirements into pragmatic, scalable data architecture decisions
• Define, implement, and maintain data contracts aligned to business domains
• Establish data quality, observability, and SLA frameworks

Engineering Delivery

• Design and evolve scalable data pipelines (batch and incremental watermark-based ingestion) using:
• Microsoft Fabric Pipelines
• Azure Data Factory
• PySpark / Python Fabric Notebooks
• Implement and maintain a medallion lakehouse architecture using OneLake and Fabric Warehouses
• Ensure Direct Lake-ready semantic models for analytics
• Lead incident management, root cause analysis, and data issue post-mortems

Analytics Enablement

• Enable self-service analytics through governed Power BI datasets
• Support and guide the production of trusted Power BI reporting using data contracts

Leadership & Ways of Working

• Define engineering standards and review pull requests
• Mentor and develop 2-4 data and cloud engineers
• Drive the data and warehouse roadmap alongside the Digital Transformation Director
• Champion CI/CD, secure secret management, and software engineering best practices

Role Objective

• Deliver and continuously refine a Microsoft Fabric data warehouse supporting business-led decision making
• Integrate data from diverse sources including APIs, files, databases, and cloud platforms
• Establish data contracts as a core mechanism for trusted analytics
• Scale Power BI reporting using standardised, high-quality data products
• Provide clear, motivating leadership to direct reports
• Conduct regular 1:1s, performance reviews, and development planning
• Recruit, onboard, and develop a high-performing data engineering team
• Ensure compliance with company policies, legal obligations, and operating procedures

Experience & Technical Skills

• Senior-level experience in data engineering roles
• Experience xwzovoh leading or mentoring data engineers
• Hands-on experience with Microsoft Fabric, including: Workspaces, OneLake, Fabric Warehouses, Fabric Notebooks and Data Pipelines and Direct Lake semantic models
• Strong Python and PySpark development capability
• Solid SQL skills for warehouse development and metadata layers
• Proven ownership of production data systems end-to-end
• Wider Azure data platform experience (e.g. Synapse, Databricks)
• CI/CD pipelines within Azure and Fabric
• Azure Key Vault or similar secret management
• Experience in telecoms or cloud-focused environments
• Strong understanding of dimensional modelling and medallion architecture
• Experience integrating REST APIs, SFTP, and cloud-based data sources
• Ability to communicate technical trade-offs to non-technical stakeholders
• Excellent troubleshooting, prioritisation, and delivery focus

ECS Resource Group are an Equal Opportunity Employer, for more information please click the following link: