Data Engineer

Data Engineer We're supporting a leading enterprise financial services organisation in the search for an experienced Data Engineer to join a high-performing data team on an initial 6-month contract. Contract Details: * Inside IR35 * Initial 6-month engagement * Sheffield-based, 3 days per week on-site Key Requirements: * Strong hands-on experience with PySpark and Databricks * Deep understanding of Spark performance optimisation, including lazy evaluation, column pruning, groupBy operations, and window functions * Proven ability to troubleshoot and resolve Spark job performance issues * Extensive experience designing, developing, and supporting enterprise-scale data pipelines * Strong technical depth across modern data engineering platforms, tools, and technologies * Experience working within complex, large-scale enterprise environments This is an excellent opportunity to contribute to a major data transformation programme within a leading financial services organisation. Additional information available on successful application