Senior Software Engineer — Open Data Analytics Engines

Amazon Web Services (AWS)

East Palo Alto (CA)

On-site

USD 180,000 - 240,000

Full time

3 days ago

Be an early applicant

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Amazon Web Services (AWS) is hiring for a software engineer to help enhance the performance and scalability of query engines and integrated table formats within our Open Data Analytics group. You will work on engines driving EMR and Athena, collaborating with open-source communities and internal teams to deliver high-impact data lake solutions.

You will design, implement, test, and mature features that improve security, durability, and efficiency across large-scale analytics workloads, while

Qualifications

5+ years of non-internship professional software development experience
5+ years of programming with at least one software programming language experience
5+ years of leading design

Responsibilities

Develop and optimize core components of query engines and open table formats (Iceberg, Hudi, Delta) to enhance performance, scalability, and reliability.
Design and implement innovative solutions and algorithms to improve feature capabilities, stability, and security in table format integrations with query engines.
Collaborate with the open-source community, contributing to discussions, driving improvements, and integrating upstream changes.
Ensure data consistency and durability while achieving breakthrough performance and scalability for large-scale data lake workloads.
Improve the organizations automation and testing capabilities.
Manage complex deliverables project and research projects with deadlines.
Mentor and train other team members on design techniques and coding best practices.
Be a point of contact for challenging customer issues related to data lake workloads and query engine.