Senior Data Engineer — AWS Analytics Platform

Amazon Inc.; Seattle, Northern (WA, KY); Hybrid; USD 155,000 - 209,000; Full time

Job summary

Amazon Development Center U.S., Inc. is seeking a Senior Data Engineer to own 3-5 data domains and operate hundreds of pipelines, building scalable data contracts and analytical models for AWS leadership.

You will partner with AWS service teams to design ingestion flows, ensure security and cost efficiency, and mentor engineers while driving architectural improvements across data platforms.

Qualifications

• 7+ years of data engineering experience.
• Experience with Python, Java, Scala, or NodeJS.
• Experience mentoring team members.
• Experience building/operating large data pipelines.
• Experience with data warehouses and SQL.
• Bachelor's degree in CS/Engineering/Analytics.
• Experience with Redshift, Spark, Hadoop, EMR.

Responsibilities

• Identify limitations and opportunities in data processing tools, drive improvements and innovation, define data processing guidelines, and ensure best practices in all pipelines.
• Define and own data architecture at the team level - ensuring architecture effectively matches business problems and data challenges with security, scalability, and cost effectiveness.
• Produce exemplary code - solutions that are easily usable by customers, inventive, secure, easily maintainable, appropriately scalable, and extensible.
• Define and own infrastructure architecture at the team level. Anticipate data management and access patterns, evolve the technology stack to remove bottlenecks, and deliver systems that are secure, scalable, and long lasting.
• Solve complex ambiguous problems - for example, designing cross-domain data models that unify billing, usage, and service telemetry data, or combining multiple datasets to solve problems that couldn't be solved before.
• Effectively split project work into parallel tasks that can be performed by themselves and others and reassembled successfully.
• Influence related teams' data architecture and software design. Provide technical assessments for promotions. Actively mentor and develop others.
• Drive data engineering best practices - Data Discovery, Naming Conventions, Operational Excellence, Data Security.
• Proactively fix data architecture deficiencies and propose larger projects which may require the work of other teams.
• Participate in on-call rotation and own operational health of data systems - establish monitoring, alarming, runbooks, and SLA tracking.

Skills

Python

Java

Scala

NodeJS

Mentoring

Data modeling

Leadership

Education

Bachelor's degree in CS/Engineering/Analytics

Tools

Amazon Redshift

Spark

Hadoop

EMR

SQL

Job description

Amazon Development Center U.S., Inc. is seeking a Senior Data Engineer to own 3-5 data domains and operate hundreds of pipelines, building scalable data contracts and analytical models for AWS leadership.

You will partner with AWS service teams to design ingestion flows, ensure security and cost efficiency, and mentor engineers while driving architectural improvements across data platforms.