Cloud Data Engine Engineer - Open-Source & Performance

Amazon Web Services (AWS)

Redmond (WA)

On-site

USD 168,100 - 227,400

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Amazon Web Services (AWS) Open Data Analytics (ODA) is seeking experienced engineers to advance a cloud data analytics platform, focusing on core engines, datalake integrations, and high-performance query execution. You will work with open-source communities on Iceberg, Spark, and related formats to push features, reliability, and security in serverless environments.

The role emphasizes collaboration across teams and external communities, delivering scalable data lake workloads and hands-on

Qualifications

5+ years of non-internship professional software development experience.
5+ years of programming with at least one software programming language experience.
5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems.

Responsibilities

Develop and optimize core components of query engines and open table formats (Iceberg, Hudi, Delta) to enhance performance and scalability.
Design and implement innovative solutions to improve feature capabilities, stability, and security in table format integrations with query engines.
Collaborate with the open-source community, contributing to discussions and integrating upstream changes.
Ensure data consistency and durability while achieving high performance for large-scale data lake workloads.
Improve the organization’s automation and testing capabilities.
Manage complex deliverables and research projects with deadlines.
Mentor and train other team members on design techniques and coding best practices.
Serve as a point of contact for challenging customer issues related to data lake workloads and query engines.