Lead Data Platform Engineer — AWS, Scalable Analytics

Coates Group; Chicago (IL); On-site; USD 145,000 - 165,000; Full time

Benefits offered by this job

Annual bonus program

Flexible work options (Thrive Program)

Global Wellness paid day off

Give Back Day

Job summary

Coates Group is seeking a senior data engineer to design and lead a next‑gen AWS data platform. You will drive enterprise analytics, governance, and AI-ready data pipelines, collaborating with cross‑functional teams to deliver scalable architectures.

The role emphasizes hands‑on leadership, architectural direction, and a focus on data quality, security, and performance across the organization.

Qualifications

• 6+ years of experience in data engineering with scalable system and platform design.
• Proven experience modernizing enterprise data platforms and architectures.
• Hands-on AWS data ecosystem experience with data lake/lakehouse (S3, Glue, Spark, Athena, Redshift).
• Strong Python and SQL for production-grade data pipelines and transformations.
• Experience with workflow orchestration, preferably Airflow.
• Experience with infrastructure-as-code using Terraform or AWS CDK.
• Familiarity with data warehousing and lakehouse concepts (Snowflake, Redshift, Databricks).

Responsibilities

• Architect and evolve a scalable, cost-efficient AWS data platform for analytics and AI capabilities.
• Design and implement reliable data pipelines for batch and near real-time data.
• Define enterprise standards for data architecture, modeling and performance.
• Lead technical decisions across tooling, infrastructure, data design and scalability.
• Implement CI/CD and automated deployment practices across the data platform.
• Enable accessible, governed data products through scalable datasets and semantic layers.
• Provide hands-on leadership and direction for a growing data engineering team.

Skills

AWS data ecosystem

Python

SQL

Data pipelines

Airflow

Terraform

AWS CDK

Snowflake/Redshift/Databricks

Tools

Airflow

Terraform

AWS CDK

Snowflake

Redshift

Databricks

Job description

Coates Group is seeking a senior data engineer to design and lead a next‑gen AWS data platform. You will drive enterprise analytics, governance, and AI-ready data pipelines, collaborating with cross‑functional teams to deliver scalable architectures.

The role emphasizes hands‑on leadership, architectural direction, and a focus on data quality, security, and performance across the organization.