Data Engineer - Amazon Flex, Flex Analytics

Amazon Inc.; Hyderabad; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Amazon Flex Analytics is seeking a Data Engineer to help build and scale the global BI platform powering Amazon Flex worldwide. You will architect data pipelines, define metrics, and automate reporting to understand driver behavior and satisfaction.

You will work with AWS-based tooling to publish reliable datasets for analysis and enable self-service insights for business teams across regions.

Qualifications

• 3+ years of data engineering experience.
• 4+ years of SQL experience.
• Experience with data modeling, warehousing and building ETL pipelines.

Responsibilities

• Create and support data pipelines built on AWS technologies including Spark, Cradle, DataCraft, Glue, Kinesis, and Redshift/Spectrum.
• Develop and improve the current data architecture, data quality, monitoring and data availability.
• Collaborate with BI Engineers to continually improve ongoing reporting and analysis processes, simplifying self-service support for customers.
• Design, implement, and support platforms that provide business teams ad-hoc access to large datasets (ex. data visualization tools for non-tech business users).
• Participate in strategic and tactical planning discussions that drive the DE team’s work.

Skills

SQL

Python/Spark

ETL pipelines

Data warehousing

Data governance

Tools

AWS Redshift

AWS Glue

Kinesis

S3

EMR

Job description

Data Engineer - Amazon Flex, Flex Analytics

Interested in the gig economy? Come be a part of it. The Amazon Flex Analytics Team is building the global business intelligence platform that powers Amazon Flex worldwide. We're working hard, having fun, and making history!
We are looking for candidates who want to help shape the future of Flex. Specifically, we are looking for a Data Engineer who is passionate about data architecture and wants help us use data to understand Flex Driver behavior and satisfaction. In this role, you will develop and support the analytic technologies that give our teams flexible and structured access to their data, including implementation of a BI platform, defining metrics and KPIs, and automating reporting and data visualization.
The successful candidate considers themselves an enterprise data architect. You should excel in the design, creation, and management of analytical data infrastructure. You will be responsible for designing and implementing scalable processes to publish data and build solutions to reconcile data for integrity and accuracy of data sets used for analysis and reporting. You should have broad understanding of RDBMS, ETL, Data Integration, Data Warehousing, Data Governance and Data Lakes. Experience with Python, R, or Spark is highly preferred and will put you at the top of the list.

Key job responsibilities

In this role, you will have the opportunity to use your skills in the following areas:

• Create and support data pipelines built on Amazon and AWS technologies including Spark, Cradle, DataCraft, Glue, Kinesis, and Redshift/Spectrum
• Develop and improve the current data architecture, data quality, monitoring and data availability
• Collaborate with BI Engineers to continually improve ongoing reporting and analysis processes, simplifying self-service support for customers
• Design, implement, and support platforms that provide business teams ad-hoc access to large datasets (ex. data visualization tools for non-tech business users)
• Participate in strategic and tactical planning discussions that drive the DE team’s work

Basic Qualifications

• 3+ years of data engineering experience
• 4+ years of SQL experience
• Experience with data modeling, warehousing and building ETL pipelines

Preferred Qualifications

• Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
• Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Veterans, military spouses, and people with disabilities are encouraged to apply.