Data Engineer II, ISS Central Science and Analytics

Amazon; India; On-site; INR 1,200,000 - 2,800,000; Full time

Job summary

Amazon is seeking a Data Engineer II to join the ISS Central Science and Analytics team. You will help design and operate scalable data platforms, enabling data science, analytics and ML initiatives across the organization.

You will lead data ingestion, modeling and ETL/ELT processes using AWS tools, collaborate with engineers, and drive best-practice data engineering across the lifecycle of data products.

Qualifications

• 3+ years of data engineering experience.
• 4+ years of SQL experience.
• Experience with data modeling, warehousing and building ETL pipelines.
• Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions.
• Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases).
• Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence.
• Experience with Airflow, Step functions, any other orchestration frameworks.

Responsibilities

• Design, implement and operate large-scale, high-volume, high-performance data structures for analytics and data science.
• Implement data ingestion routines using best practices in data modeling, ETL/ELT processes by leveraging AWS technologies and big data tools.
• Gather business and functional requirements and translate these requirements into robust, scalable, operable solutions with a flexible and adaptable data architecture.
• Collaborate with engineers to help adopt best practices in data system creation, data integrity, test design, analysis, validation, and documentation.
• Identify opportunities in existing data solutions for improvements.

Skills

Data engineering

SQL

Data modeling

ETL pipelines

Orchestration frameworks

Tools

Airflow

AWS Redshift

AWS S3

AWS Glue

AWS EMR

AWS Kinesis

AWS Lambda

IAM

Job description

Data Engineer II, ISS Central Science and Analytics

Come and be part of the International Seller Services (ISS) Central Analytics Data Engineering (DE) team and work on solving cutting edge problems! We are a team of DEs who support Applied Scientists, Data Scientist, and Economists who experiment, research, and turn machine/deep learning and AI research into great products for our customers.

ISS is seeking a smart, highly-motivated, and experienced Data Engineer to join our team. In this role, you'll help us create the right Data and ML infrastructure.

As a Data Engineer, you will provide technical leadership, lead data engineering initiatives and build end-to-end analytical solutions that are highly available, scalable, stable, secure, and cost-effective.

You are passionate about working with huge datasets and have experience with the organization and curation of data for analytics. You have a strategic and long term view on architecting advanced data eco systems.

You are experienced in building efficient and scalable data services and have the ability to integrate data systems with AWS tools and services to support a variety of customer use cases/applications.

Key job responsibilities

• Design, implement and operate large-scale, high-volume, high-performance data structures for analytics and data science.
• Implement data ingestion routines using best practices in data modeling, ETL/ELT processes by leveraging AWS technologies and big data tools.
• Gather business and functional requirements and translate these requirements into robust, scalable, operable solutions with a flexible and adaptable data architecture.
• Collaborate with engineers to help adopt best practices in data system creation, data integrity, test design, analysis, validation, and documentation.
• Identify opportunities in existing data solutions for improvements.

• 3+ years of data engineering experience
• 4+ years of SQL experience
• Experience with data modeling, warehousing and building ETL pipelines
• Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
• Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
• Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
• Experience with Airflow, Step functions, any other orchestration frameworks.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.