Lead AWS Big Data Engineer

Avance Consulting; England; On-site; GBP 70,000 - 110,000; Full time

Job summary

Avance Consulting in the United Kingdom seeks an experienced AWS Big Data Developer to design and implement data solutions at scale. You will work with AWS Glue, Redshift, Snowflake, and Spark-based pipelines, using PySpark and Python to transform large datasets in an Agile delivery model.

You will collaborate with global stakeholders, translate requirements into robust technical solutions, and stay current with evolving data technologies.

Qualifications

• Minimum 6-8 years of experience as AWS Big Data Developer.
• Proficient in AWS services Glue, CloudFormation, Lake Formation, IAM, Lambda and Redshift.
• Proficient in Python and SQL.
• Experience with PySpark and Spark.
• Familiar with Snowflake, Redshift, Apache Flink and Apache Kafka.

Responsibilities

• Work in an Agile environment and participate in scrum daily standups, sprint planning reviews and retrospectives.
• Understand project requirements and translate them into technical solutions which meets the project quality standards
• Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues.
• Strong problem solving and Good Analytical skills.
• Excellent verbal and written communication skills.
• Experience and desire to work in a Global delivery environment.
• Stay up to date with new technologies and industry trends in Development

Skills

AWS services

Python

SQL

PySpark/Spark

Snowflake

Apache Flink

Apache Kafka

Job description

Avance Consulting in the United Kingdom seeks an experienced AWS Big Data Developer to design and implement data solutions at scale. You will work with AWS Glue, Redshift, Snowflake, and Spark-based pipelines, using PySpark and Python to transform large datasets in an Agile delivery model.

You will collaborate with global stakeholders, translate requirements into robust technical solutions, and stay current with evolving data technologies.