Data Engineer II, CloudTune

Amazon; Toronto; On-site; CAD 80,000 - 120,000; Full time

Job summary

A leading technology firm is seeking a Data Engineer to build and maintain scalable data platforms to drive automation within its operations. The role requires 3+ years of data engineering experience and a strong background in AWS technologies. Responsibilities include designing ETL/ELT pipelines and collaborating with teams to enhance data structures. This position offers the opportunity to innovate and significantly impact the efficiency of operations across the organization.

Qualifications

• 3+ years of data engineering experience.
• Experience with data modeling and warehousing.
• Proficient in programming with at least one language.

Responsibilities

• Design and support scalable platforms for data access.
• Build automated ETL/ELT pipelines using SQL and AWS tools.
• Collaborate with Data Scientists to build necessary data structures.

Skills

Data modeling

Building ETL pipelines

Data mining

Software programming

SQL queries

Tools

AWS (Redshift, S3, Glue, EMR)

Python

Job description

The CloudTune team within Amazon's Intelligent Cloud Control organization is seeking an expert Data Engineer to build and operate the data foundation that powers our end-to-end automation vision. Our goal is to invent new software and data systems that remove human decision-making from SDO’s scaling and cost controllership processes across Amazon's entire retail and digital businesses.

As a Data Engineer in CloudTune, you will be working with an extremely large, complex, and dynamic data environment that integrates capacity, traffic forecasting, and financial data. You will be responsible for designing, implementing, and operating stable, scalable, and low-cost solutions to flow massive datasets from production systems into our analytical and machine learning platforms. This work directly enables the ML models and control systems that provision Amazon’s services optimally for availability, customer experience, and cost—creating an enormous impact on company-wide efficiency. You should be passionate about leveraging huge data sets to drive sophisticated, algorithmic automation.

Key Job Responsibilities

• Design, implement, and support a scalable platform providing high-integrity, ad-hoc access to petabyte-scale capacity and financial datasets.
• Build robust, automated, and fault-tolerant data integration (ETL/ELT) pipelines using SQL, Python, and AWS services (e.g., Redshift, Glue, S3, EMR).
• Interface with Data Scientists and Software Engineers to define and build the data structures necessary to train and deploy advanced machine learning models for forecasting and optimization.
• Implement data structures and modeling best practices to simplify, enhance the accessibility, and improve the usability of complex, heterogeneous datasets.
• Continually improve ongoing data processes, automating or simplifying self-service support for engineers and scientists.

About the Team

CloudTune is part of Amazon's Intelligent Cloud Control organization, dedicated to inventing software systems that remove human decision-making from SDO’s scaling and infrastructure spend planning. Our core mission is to drive end-to-end automation to provision Amazon's services—optimizing simultaneously for a great customer experience, high availability, and reduced cost. The solutions we build eliminate vast quantities of undifferentiated and tedious work, creating an enormous impact for tens of thousands of Amazon developers across the company. We are a high-leverage team focused on innovative, large-scale systems that define the future of Amazon's growth and efficiency.

Basic Qualifications

• 3+ years of data engineering experience
• Experience with data modeling, warehousing and building ETL pipelines
• Experience programming with at least one software programming language
• Experience in data mining, data management, reporting, and SQL queries

Preferred Qualifications

• Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
• Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.