Senior Data Engineer - Deal Analytics & GenAI Platform

Amazon Web Services (AWS); New York (NY); On-site; USD 170,000 - 230,000; Full time

Job summary

Amazon Web Services, Inc. in New York, NY, is seeking a Sr. Data Engineer to join the Strategic Customer Engagements team to develop a scalable data analytics platform and enable data-driven strategic deals.

You will own end-to-end data engineering solutions, translate business problems into technical data requirements, and collaborate with BIEs, product managers, and stakeholders. You will design scalable data infrastructure, leverage GenAI and AWS services, and build pipelines for GenAI

Qualifications

• 5+ years of data engineering experience.
• Experience with data modeling, warehousing and building ETL pipelines.
• Experience with SQL.
• Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS.
• Experience mentoring team members on best practices.
• Preferred: Hadoop, Hive, Spark, EMR.

Responsibilities

• Build and maintain backend data infrastructure for analytical platforms and applications, ensuring data is clean, fresh, and optimized for downstream consumption.
• Lead architectural improvements that simplify complex data systems and transformations and proactively address deficiencies that create bottlenecks in the data infrastructure.
• Translate business problem statements into technical data requirements, partnering with BIEs and product management and stakeholders to define what data products to build.
• Ensure data quality through monitoring, validation, auditing, and documentation of pipelines and data sources.
• Leverage AWS services and GenAI to build next-generation data solutions that improve efficiency and unlock new analytical capabilities.
• Build data pipelines purpose-built for LLM consumption and create data products and feature stores that serve GenAI applications in near real-time.
• Lead design reviews for your team's data architecture and actively participate in design reviews of related software and data systems.

Skills

Data engineering

Data modeling

ETL pipelines

SQL

Python/Java/Scala/NodeJS

Mentoring

Tools

Hadoop

Hive

Spark

EMR

Job description

Amazon Web Services, Inc. in New York, NY, is seeking a Sr. Data Engineer to join the Strategic Customer Engagements team to develop a scalable data analytics platform and enable data-driven strategic deals.

You will own end-to-end data engineering solutions, translate business problems into technical data requirements, and collaborate with BIEs, product managers, and stakeholders. You will design scalable data infrastructure, leverage GenAI and AWS services, and build pipelines for GenAI