Lead Data Engineer — AWS Data Platform & Analytics

Lever, Inc.; Chicago, Northern (IL, KY); Hybrid; USD 145,000 - 165,000; Full time

Benefits offered by this job

Bonus program

Thrive Program

Wellbeing days

Job summary

Coates Group is seeking an experienced data engineer to design, build, and lead the evolution of our AWS-based data platform. You will shape scalable analytics foundations, enabling enterprise reporting and future AI capabilities.

You will implement production-grade data pipelines, define standards, and provide hands-on technical leadership to a growing team of data engineers and cross-functional partners. This role mixes architecture, coding, and collaboration.

Qualifications

• 5+ years of experience in data engineering with scalable systems and platforms.
• Experience building or evolving enterprise data platforms and architectures.
• Hands-on experience with AWS data stack (S3, Glue, Spark, Athena, Redshift).
• Strong Python and SQL for production-grade data pipelines and transformation workflows.
• Experience implementing workflow orchestration, preferably Airflow.
• Experience with infrastructure-as-code and automated deployment using Terraform or AWS CDK.
• Familiarity with modern data warehousing and lakehouse concepts (Snowflake/Redshift/Databricks).
• This role will be 3 days in office in the West Loop and 2 days remote.

Responsibilities

• Architect and evolve a scalable, cost-efficient AWS data platform that enables enterprise analytics, reporting, and future AI capabilities
• Design and implement reliable, production-grade data pipelines and processing frameworks for batch and near real-time data
• Define enterprise standards for data architecture, modeling, observability, reliability, and platform performance
• Lead foundational technical decisions across tooling, infrastructure, data design, scalability, and operational efficiency
• Implement and maintain infrastructure-as-code, CI/CD pipelines, and automated deployment practices across the data platform
• Enable high-quality, accessible, and governed data products through scalable semantic layers, curated datasets, and transformation standards
• Provide hands-on technical leadership, mentoring, and architectural direction for a growing team of data engineers and cross-functional stakeholders

Skills

Data engineering

AWS data ecosystem

Python

SQL

Airflow

Terraform / AWS CDK

Data lake / lakehouse

Data governance

Leadership

Tools

Terraform

AWS CDK

Airflow

Snowflake

Redshift

Databricks

S3

Glue

Spark

Athena

Job description

Coates Group is seeking an experienced data engineer to design, build, and lead the evolution of our AWS-based data platform. You will shape scalable analytics foundations, enabling enterprise reporting and future AI capabilities.

You will implement production-grade data pipelines, define standards, and provide hands-on technical leadership to a growing team of data engineers and cross-functional partners. This role mixes architecture, coding, and collaboration.