Data Engineer

This is an exciting opportunity for an Data Engineer to join a company who are constanty investing in new products & using technology to increase their market share! They are looking for someone to join their team who is enthusiastic about new ideas which they can’t wait to share with their team & bring to life.

As a Data Engineer, you’ll focus on building and maintaining robust data pipelines within the AWS ecosystem, with a primary focus on the Delta Lakehouse Platform on Databricks.

Responsibilities:

• Data Ingestion: Build and optimize data ingestion pipelines using AWS services such as Lambda, Kinesis, and Glue.

• Data Transformation: Develop, maintain, and optimize transformation pipelines within our Delta Lake on Databricks.

• Data Modelling: Design and implement efficient and reliable data models to store and retrieve data.

• Collaboration: Work closely with data scientists, analysts, and stakeholders to understand data requirements and deliver optimal solutions.

• Data Quality: Ensure the reliability, integrity, and timeliness of data by implementing best practices and quality checks.

• Performance Optimization: Optimize queries and improve performance of data retrieval operations.

• Technology Stewardship: Stay updated with the latest advancements in AWS, Databricks, and the data engineering field in general. Provide recommendations on the adoption of new tools and technologies.

Requirements:

• AWS Services: Proficiency in AWS services like Lambda, Kinesis, and Glue.

• Databricks & Delta Lake: Hands-on experience with Databricks and Delta Lakehouse architectures.

• Programming: Proficient in Python, Scala, and SQL for data engineering tasks.

• ETL Processes: Demonstrated expertise in designing, building, and maintaining ETL processes.

• Data Modelling: Experience in logical and physical data modelling with large datasets.

• Problem Solving: Strong analytical and problem-solving skills, with a focus on troubleshooting data issues.

Preferred Qualifications:

• Certification in AWS and/or Databricks.

• Experience in a similar role in online retail industry.

• Knowledge of best practices in data governance and data security.

Benefits :

• 22 days holiday rising to 25

• Staff discounts & Friends and Family discounts

• Cycle to work scheme and Tech Scheme

• Breakfast and drinks provided

• Charity day per annum supported

• Summer and Christmas Parties

• Street food days

• Access to Perkbox portal

Apply now to find out more!!

Location:
Newcastle upon Tyne Tyne and Wear
Newcastle upon Tyne
NE12 8BX

Salary:
50000 - 60000

Sector: Data

Type:
Permanent

Posted:
10/23/2023