Senior Data Engineer

N Consulting Ltd; London; Hybrid; GBP 65,000 - 85,000; Full time

Job summary

A leading company in the tech sector is looking for a Senior Data Engineer to join their team. The role involves designing and maintaining data pipelines using tools like Databricks and AWS. This position requires extensive experience in data modelling and transformation, as well as strong communication skills. The position offers a hybrid working model depending on client needs, with a contract duration of 6 months.

Qualifications

• Minimum 7 years experience as a Data Engineer or similar role.
• Hands-on experience with ADF, transforming data across layers.
• Excellent communication skills and logical thinking.

Responsibilities

• Design, develop, and maintain data pipelines and data streams.
• Work on ETL processes and ensure data integrity and accuracy.
• Maintain data governance and security policies.

Skills

Databricks

AWS

Python

Pyspark

Data modelling

ETL processes

SQL development

Data integrity

Data governance

Data security policies

Job description

Possibility of remote work: Hybrid (number of WFO days will depend on the client's needs)
Contract duration: 6 months
Location: London

JOB DETAILS

Role Title: Senior Data Engineer

Note: (Please do not submit the same profiles as for 111721-1)

Required Core Skills:

Databricks, AWS, Python, Pyspark, data modelling

Minimum years of experience: 7 years

Job Description:

Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams.
Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark.
Must have hands on experience to PySpark, Python,AWS,data modelling
Must have experience in ETL processes
Must have hands on experience in Databricks development
Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures.
Must have hands on experience in SQL development
Excellent Communication skills & Logical thinking