Senior Data Engineer

Senior Data Engineer Hybrid: 3 days in office, Warwick Duration: 6-Month Contract Rate: £450/day (Inside IR35) A leading organization is seeking a Senior Data Engineer to join their cloud data platform team on a hybrid basis (3 days in office, Warwick). This is a 6-month contracting role offering competitive daily rates and the opportunity to contribute to a modern, cloud-native data platform. The Role You will be responsible for driving the design and implementation of scalable, high-performing data architectures and pipelines. Working with the Interconnectors Data Platform (ICDP), you will provide both technical leadership and hands-on development, supporting the transition to modern Azure-based ingestion patterns and Medallion Architecture. Key Responsibilities * Lead the design and implementation of scalable data architectures and layered models (Bronze/Silver/Gold). * Develop robust, secure, and observable ingestion and transformation pipelines using Azure-based tools. * Lead the migration from legacy ETL tools to modern cloud pipelines (ADF, Azure Functions, event-driven frameworks). * Build performant SQL transformations and reusable data models. * Implement CI/CD, automated testing, version control, and observability in workflows. * Ensure data quality, validation, reconciliation, and auditability across platform layers. * Collaborate with business and product teams to deliver high-quality analytical outputs. * Mentor junior data engineers and contribute to team capability development. Required Skills & Experience * Strong hands-on experience with Python for production-grade pipelines. * Expert-level SQL, including optimization and data modelling. * Azure Cloud experience (ADF, Functions, Storage, Key Vault). * Deep understanding of data warehousing, dimensional modelling, and scalable architectures. * Proficiency in Git, CI/CD, automated testing, and modern engineering best practices. * Experience with API and SFTP ingestion and resilient pipeline design. * Strong problem-solving, communication, and stakeholder collaboration skills. Desirable * Experience with Medallion/Lakehouse patterns or Databricks-style ecosystems. * Experience in regulated or high-assurance data environments. * Collaboration with modeling teams in engineering-modelling interfaces