Data Engineer, ShipTech Analytics

Amazon Inc.

Hyderabad

On-site

INR 1,200,000 - 2,300,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

ShipTech Analytics is hiring a Data Engineer II to build standardized data solutions powering Amazon's global transportation network. You will develop NRT streaming and batch pipelines, create data tools for self-service analytics, and contribute to AI-powered automation.

You’ll work with AWS cloud services and ensure data quality while collaborating across operations and analytics teams worldwide. You will design scalable data products, mentor teammates, and participate in design reviews, code

Qualifications

  • 3+ years of data engineering experience.
  • Experience with data modeling, warehousing and ETL pipelines.
  • Experience with SQL.
  • Proficiency in at least one scripting language such as Python, Java, Scala, or NodeJS.
  • Experience building/operating scalable data extraction, ingestion and processing systems.
  • Experience with Hadoop, Hive, Spark, EMR or similar.

Responsibilities

  • Design and build scalable near-real-time streaming and batch data pipelines for Amazon's transportation network.
  • Create data products and tools covering ingestion, processing, storage and operational modules.
  • Collaborate with stakeholders to deliver datasets and analytics tools for faster decision-making.
  • Ensure data quality and implement enhancements for operational excellence.
  • Work with cross-functional teams to standardize analytics capabilities and automate AI-powered solutions.
  • Leverage AWS cloud technologies to transform raw data into actionable metrics and insights.

Skills

Data modeling
Warehousing
SQL
Python/Java/Scala/NodeJS
Distributed systems
Big data

Tools

AWS Redshift
AWS S3
AWS Glue
AWS EMR
AWS Kinesis
AWS Firehose
AWS Lambda
IAM

Job description

Description

Join ShipTech Analytics (STA) as a Data Engineer to build the data and analytics backbone powering Amazon's global transportation network. You'll contribute to our vision of building an intelligent, autonomous, and scalable performance management and decision support system across Amazon Transportation.

As a Data Engineer II, you'll work on building standardized data solutions that empower operations teams worldwide. You'll develop both near-real-time (NRT) streaming pipelines and batch processing pipelines that deliver critical insights for decision-making. You'll also build data tools that enable self-service analytics and automate operational tasks, while contributing to innovative AI-powered solutions delivering automated insights across the transportation network.

Key job responsibilities
  • Design and build scalable near-real-time (NRT) streaming and batch data pipelines supporting Amazon's global transportation network.
  • Build data products and data tools that streamline the complete data lifecycle including data ingestion, processing, backfill, storage, vending, and operational support modules.
  • Partner closely with stakeholders across operations and analytics teams to understand requirements, design solutions, and deliver datasets and data tools that enable faster, more informed decision-making
  • Own data quality and implement enhancements for datasets that enable operational excellence and improve customer experience
  • Collaborate with cross-functional teams to standardize analytics capabilities and build AI-powered automation
  • Leverage AWS cloud technologies to transform raw data into actionable metrics
  • Drive continuous improvement through code reviews, design discussions, operational best practices, and security compliance
A day in the life

You work backwards from what stakeholders need, clarifying ambiguities and building data products and tools. Throughout the day, you're writing code for data pipelines and building tools that handle ingestion, processing, storage, and vending alongside software engineers.

Some days you're in design discussions about data infrastructure, pipelines and tools.

Beyond coding, you're documenting datasets, tools and runbooks, participating in code reviews, and mentoring teammates. When oncall, you monitor the pipeline health

What makes the role interesting is the variety - you're partnering with stakeholders, TPMs, SDEs building scalable data pipelines and tools that directly affect how Amazon's transportation network operates.

About the team

ShipTech Analytics serves as the data and analytics backbone for Amazon's global transportation network. The team builds standardized data solutions that streamline analytics and enable faster decision-making for operations teams worldwide. Team members collaborate with cross-functional partners to deliver data products and tools.

The team is modernizing systems, building near-real-time architectures, and building AI-powered automation. Team members have opportunities to mentor others, prototype new ideas , and shape the future of the data analytics. The team values collaboration across geographies with members in multiple locations working together to serve global operations.

Basic Qualifications
  • 3+ years of data engineering experience
  • Experience with data modeling, warehousing and building ETL pipelines
  • Experience with SQL
  • Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
  • Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
  • Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
Preferred Qualifications
  • Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
  • Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
  • Knowledge of batch and streaming data architectures like Kafka, Kinesis, Flink, Storm, Beam

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer II
Data Engineer II

Amazon.com • Hyderabad

On-site
INR 1,500,000 - 3,000,000
Data Engineer II
Data Engineer II

Mployee.me • Hyderabad

On-site
INR 1,200,000 - 2,400,000
Data Engineer, SPT
Data Engineer, SPT

Amazon Inc. • Hyderabad

On-site
INR 1,500,000 - 2,100,000
Data Engineer
Data Engineer

Amazon Inc. • Bengaluru

On-site
INR 1,500,000 - 3,200,000
Data Engineer
Data Engineer

Amazon.com Inc. • Hyderabad

On-site
INR 2,500,000 - 4,200,000
Data Engineer I, DSP Analytics
Data Engineer I, DSP Analytics

Mployee.me • Hyderabad

On-site
INR 1,000,000 - 1,800,000
Data Engineer
Data Engineer

Amazon.com • Hyderabad

On-site
INR 1,200,000 - 2,400,000
Data Engineer III, Data Engineering India
Data Engineer III, Data Engineering India

Amazon Inc. • Bengaluru

On-site
INR 3,000,000 - 4,200,000
Data Engineer, SPT
Data Engineer, SPT

Mployee.me • Bengaluru

On-site
INR 1,800,000 - 2,400,000
Data Engineer I, Business Data Technologies
Data Engineer I, Business Data Technologies

Amazon Inc. • Hyderabad

On-site
INR 900,000 - 1,700,000