Data Engineer II, Data & AI, Customer Engagement Technology

Amazon; London; On-site; GBP 50,000 - 90,000; Full time

Job summary

An established industry player is seeking a talented Data Engineer to join their innovative Data and AI team. This position involves designing and implementing robust data pipelines and infrastructure that drive data-driven decisions and AI capabilities. You will collaborate with diverse teams to develop comprehensive data solutions, ensuring data security and compliance while optimizing performance. With opportunities to work with cutting-edge technologies in cloud computing and machine learning, this role is perfect for those passionate about solving complex challenges in high-scale environments. If you're eager to make a significant impact on data infrastructure, this is the opportunity for you.

Qualifications

• 3+ years of experience in data engineering with a strong focus on ETL/ELT processes.
• Bachelor’s degree in Computer Science or Engineering is required.

Responsibilities

• Design and implement data pipelines ensuring data quality and governance.
• Collaborate with cross-functional teams to create impactful data products.

Skills

Data Engineering

ETL/ELT Frameworks

Data Governance

AWS Data Services

Machine Learning

Data Quality Assurance

Education

Bachelor’s degree in Computer Science

Degree in Engineering

Tools

AWS Redshift

AWS S3

AWS Glue

AWS EMR

AWS Kinesis

AWS Lambda

AWS RDS

Job description

As a Data Engineer on the Data and AI team, you will design and implement robust data pipelines and infrastructure that power our organization's data-driven decisions and AI capabilities. This role is critical in developing and maintaining our enterprise-scale data processing systems that handle high-volume transactions while ensuring data security, privacy compliance, and optimal performance.

You'll be part of a dynamic team that designs and implements comprehensive data solutions, from real-time processing architectures to secure storage solutions and privacy-compliant data access layers. The role involves close collaboration with cross-functional teams, including software development engineers, product managers, and scientists, to create data products that power critical business capabilities. You'll have the opportunity to work with leading technologies in cloud computing, big data processing, and machine learning infrastructure, while contributing to the development of robust data governance frameworks.

If you're passionate about solving complex technical challenges in high-scale environments, thrive in a collaborative team setting, and want to make a lasting impact on our organization's data infrastructure, this role offers an exciting opportunity to shape the future of our data and AI capabilities.


Key job responsibilities
- Design and implement ETL/ELT frameworks that handle large-scale data operations, while building reusable components for data ingestion, transformation, and orchestration while ensuring data quality and reliability.
- Establish and maintain robust data governance standards by implementing comprehensive security controls, access management frameworks, and privacy-compliant architectures that safeguard sensitive information.
- Drive the implementation of data solutions, both real-time and batch, optimizing them for both analytical workloads and AI/ML applications.
- Lead technical design reviews and provide mentorship on data engineering best practices, identifying opportunities for architectural improvements and guiding the implementation of enhanced solutions.
- Build data quality frameworks with robust monitoring systems and validation processes to ensure data accuracy and reliability throughout the data lifecycle.
- Drive continuous improvement initiatives by evaluating and implementing new technologies and methodologies that enhance data infrastructure capabilities and operational efficiency.

A day in the life
The day often begins with a team stand-up to align priorities, followed by a review of data pipeline monitoring alarms to address any processing issues and ensure data quality standards are maintained across systems. Throughout the day, you'll find yourself immersed in various technical tasks, including developing and optimizing ETL/ELT processes, implementing data governance controls, and reviewing code for data processing systems. You'll work closely with software engineers, scientists, and product managers, participating in technical design discussions and sharing your expertise in data architecture and engineering best practices. Your responsibilities extend to communicating with non-technical stakeholders, explaining data-related projects and their business impact.

You'll also mentor junior engineers and contribute to maintaining comprehensive technical documentation. You'll troubleshoot issues that arise in the data infrastructure, optimize the performance of data pipelines, and ensure data security and compliance with relevant regulations. Staying updated on the latest data engineering technologies and best practices is crucial, as you'll be expected to incorporate new learnings into your work. By the end of a typical day, you'll have advanced key data infrastructure initiatives, solved complex technical challenges, and improved the reliability, efficiency, and security of data systems. Whether it's implementing new data governance controls, optimizing data processing workflows, or enhancing data platforms to support new AI models, your work directly impacts the organization's ability to leverage data for critical business decisions and AI capabilities.

If you are not sure that every qualification on the list above describes you exactly, we'd still love to hear from you! At Amazon, we value people with unique backgrounds, experiences, and skillsets. If you’re passionate about this role and want to make an impact on a global scale, please apply!

About the team
The Data and Artificial Intelligence (AI) team is a new function within Customer Engagement Technology. We own the end-to-end process of defining, building, implementing, and monitoring a comprehensive data strategy. We also develop and apply Generative Artificial Intelligence (GenAI), Machine Learning (ML), Ontology, and Natural Language Processing (NLP) to customer and associate experiences.

BASIC QUALIFICATIONS

- 3+ years of data engineering experience
- Bachelor’s degree in Computer Science, Engineering, or a related technical discipline

PREFERRED QUALIFICATIONS

- Experience with AWS data services (Redshift, S3, Glue, EMR, Kinesis, Lambda, RDS) and understanding of IAM security frameworks
- Proficiency in designing and implementing logical data models that drive physical designs
- Hands-on experience working with large language models, including understanding of data infrastructure requirements for AI model training

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.