Senior Data Engineer — AWS Data Pipelines & AI-Driven ETL

N Consulting Limited; Bath; Hybrid; GBP 55,000 - 75,000; Full time

Job summary

N Consulting Limited is looking for a Senior Data Engineer to work in Bath on a hybrid basis. This contract role lasts for 3 months, requiring expertise in AWS Cloud architecture and data services, along with skills in ETL development and Data Pipeline automation.

The ideal candidate will engage with both business and technical stakeholders, ensuring effective communication across varying levels of seniority. Experience with AWS Glue, Lambda, and Python is essential for success in this position.

Qualifications

• In-depth skills on AWS Cloud architecture.
• Clear communication with stakeholders at various seniority levels.
• Knowledge of data modeling techniques, including dimensional models.

Responsibilities

• Design, build, test, and performance tune ETL processes.
• Engage both business and technical stakeholders.

Skills

AWS Glue ETL

Data Pipeline automation

ETL development

AWS Cloud architecture

AWS data services

AWS Lambda

Python

Release management (CI/CD)

Athena SQL

Spark SQL

Tools

AWS Glue Data Quality

AWS Lake Formation

Azure DevOps

AWS CodeCommit

AWS CodePipeline

AWS Step functions

AWS CLI

Power BI

Job description

N Consulting Limited is looking for a Senior Data Engineer to work in Bath on a hybrid basis. This contract role lasts for 3 months, requiring expertise in AWS Cloud architecture and data services, along with skills in ETL development and Data Pipeline automation.

The ideal candidate will engage with both business and technical stakeholders, ensuring effective communication across varying levels of seniority. Experience with AWS Glue, Lambda, and Python is essential for success in this position.