Data Platform Lead — AWS, Analytics & AI Readiness

Coatesgroup; Chicago (IL); Hybrid; USD 120,000 - 170,000; Full time

Benefits offered by this job

Annual bonus program

Thrive Program

Wellness days

Give Back Day

Flexible work options

Job summary

Coates Group is seeking a Senior Data Engineer to design and lead the evolution of its next-generation AWS data platform. You will drive scalable data architectures, enable analytics, and support AI capabilities through hands-on leadership.

The role requires 5+ years in data engineering, strong Python/SQL, and experience with AWS data tools. The position blends 3 days in the West Loop office with 2 days remote, offering a dynamic, collaborative environment.

Qualifications

• Experience designing scalable data architectures that support enterprise analytics.
• Ability to balance tradeoffs between scalability, complexity, performance and cost.
• Establish engineering standards, governance processes, and reliable platform guidance.
• Strong understanding of CI/CD, modern software engineering practices, and production support.
• Experience delivering accessible, high-quality data products for analytics and reporting.
• Ability to collaborate across technical and business stakeholders while providing hands-on leadership.
• Exposure to streaming technologies (Kafka/Kinesis), dbt, multi-cloud environments and ML workflows is advantageous.

Responsibilities

• Architect and evolve a scalable, cost-efficient AWS data platform for analytics and future AI capabilities.
• Design and implement data pipelines for batch and near real-time processing.
• Define enterprise standards for data architecture, modeling, observability, reliability, and performance.
• Lead foundational technical decisions across tooling, infrastructure, data design, scalability and efficiency.
• Implement and maintain infrastructure-as-code, CI/CD pipelines, and automated deployment practices.
• Provide scalable semantic layers and curated datasets to enable governed data products.
• Mentor and provide architectural direction for a growing team of data engineers.

Skills

Data engineering

AWS data services

Python

SQL

CI/CD pipelines

Terraform

Airflow

Tools

S3

Glue

Spark

Athena

Redshift

Snowflake

Databricks

Job description

Coates Group is seeking a Senior Data Engineer to design and lead the evolution of its next-generation AWS data platform. You will drive scalable data architectures, enable analytics, and support AI capabilities through hands-on leadership.

The role requires 5+ years in data engineering, strong Python/SQL, and experience with AWS data tools. The position blends 3 days in the West Loop office with 2 days remote, offering a dynamic, collaborative environment.