Data Engineer - DEFRA

Senior Data Engineer - Azure Central government | Outside IR35 | Remote | 6 months + SR2 is working with a consultancy that is expanding its data engineering capability to support the delivery of a large-scale cloud data platform. They are looking for an experienced Data Engineer to help design and develop modern data solutions capable of handling complex, high-volume datasets. You'll join a multidisciplinary team responsible for developing and evolving a cloud-based data platform. Working across the full data lifecycle, you'll help shape how data is collected, processed, governed and consumed, while contributing to architectural decisions and engineering best practice. A significant proportion of the work involves processing complex location-based datasets, making previous exposure to geospatial or mapping-related data highly beneficial. Requirements: Strong commercial experience delivering data engineering solutions in Azure. Strong hands-on experience working with Azure Databricks Experience working with geospatial, mapping or location intelligence datasets Central UK government experience within recent 5 years Experience developing large-scale distributed data processing workloads. Strong Python and SQL development skills. Experience working with Spark-based technologies. Knowledge of modern cloud data platform patterns and architectures. Experience building and supporting automated data pipelines. Familiarity with CI/CD practices and modern software engineering principles. Strong troubleshooting and performance optimisation skills.Details Outside IR35 £450 a day Remote based 6 month contract Strong likelihood of extension Please apply with a copy of your CV and Emma from SR2 will contact potential applicants regarding next steps