SC Cleared Data Engineer

The Role We are seeking an experienced SC Cleared Data Engineer to design, build, and maintain secure, scalable data platforms and pipelines within a high-security environment.

The full job description covers all associated skills, previous experience, and any qualifications that applicants are expected to have.

The successful candidate will work closely with data architects, analysts, software engineers, and stakeholders to deliver robust data solutions that support operational and strategic objectives.

This role requires active Security Check (SC) clearance.

Key Responsibilities
* Design, develop, and maintain ETL/ELT pipelines for structured and unstructured data sources.
* Build scalable data ingestion and transformation frameworks using cloud-native and on-premise technologies.
* Develop and optimise data models, warehouses, and lakehouse architectures.
* Implement data quality, validation, governance, and security controls.
* Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
* Monitor, troubleshoot, and optimise data workflows and platform performance.
* Support CI/CD practices and infrastructure automation for data platforms.
* Produce technical documentation, architecture diagrams, and operational runbooks.
* Ensure compliance with security policies, governance standards, and best practices within secure environments.
* Participate in agile ceremonies including sprint planning, stand-ups, and retrospectives.

Required Skills & Experience
* Active SC Clearance or eligibility to obtain SC clearance.
* Proven experience as a Data Engineer in enterprise or government environments.
* Proficiency in SQL and Python for data engineering tasks.
* Experience with cloud platforms such as AWS, Azure, or GCP.
* Hands-on experience with data technologies including Apache Spark, Databricks, Kafka, Airflow, Snowflake, and Hadoop ecosystems.
* Experience designing and maintaining data warehouses and data lakes.
* Knowledge of DevOps and CI/CD tooling including Git, Jenkins, Azure DevOps, and Terraform.
* Strong understanding of data governance, security, and compliance.
* Experience working within Agile delivery teams.

Desirable Skills
* Experience in the public sector, defence, or regulated industries.
* Knowledge of data mesh or modern data architecture principles.
* Experience with containerisation technologies such as Docker and Kubernetes.
* Familiarity with machine learning pipelines and MLOps. xwzovoh
* Certifications in cloud platforms or data engineering technologies.