Lead Data Platform Engineer — AWS, Analytics & AI

Coates Group; Chicago (IL); Hybrid; USD 145,000 - 165,000; Full time

Benefits offered by this job

Annual bonus program

Thrive Program

Flexible work options

Wellness days

Job summary

Coates Group is seeking a senior Data Platform Architect to design and lead the evolution of our next-generation AWS data platform. You will establish scalable foundations for data integration, governance, and analytics, enabling enterprise reporting and future AI capabilities.

The role combines hands-on engineering with architectural leadership, mentoring a growing team of data engineers and collaborating across business and technical stakeholders.

Qualifications

• 5+ years of experience in data engineering with strong expertise in scalable system and platform design
• Proven experience building, modernising, or significantly evolving enterprise data platforms and architectures
• Deep hands-on experience within the AWS data ecosystem, including production-scale data lake or lakehouse environments utilizing technologies such as S3, Glue, Spark, Athena, and/or Redshift
• Strong proficiency in Python and SQL with experience developing production-grade data pipelines and transformation workflows
• Experience implementing workflow orchestration solutions, preferably Airflow
• Experience with infrastructure-as-code and automated deployment practices using tools such as Terraform or AWS CDK
• Familiarity with modern data warehousing and lakehouse concepts, including dimensional modelling and platforms such as Snowflake, Redshift, or Databricks

Responsibilities

• Architect and evolve a scalable, cost-efficient AWS data platform that enables enterprise analytics, reporting, and future AI capabilities
• Design and implement reliable, production-grade data pipelines and processing frameworks for batch and near real-time data
• Define enterprise standards for data architecture, modelling, observability, reliability, and platform performance
• Lead foundational technical decisions across tooling, infrastructure, data design, scalability, and operational efficiency
• Implement and maintain infrastructure-as-code, CI/CD pipelines, and automated deployment practices across the data platform
• Enable high-quality, accessible, and governed data products through scalable semantic layers, curated datasets, and transformation standards
• Provide hands-on technical leadership, mentoring, and architectural direction for a growing team of data engineers and cross-functional stakeholders

Skills

Python

SQL

Data modeling

Data governance

CI/CD

Stakeholder collaboration

Streaming data (Kafka/Kinesis)

Tools

Airflow

dbt

Terraform

AWS CDK

Snowflake

Redshift

Databricks

S3

Glue

Spark

Job description

Coates Group is seeking a senior Data Platform Architect to design and lead the evolution of our next-generation AWS data platform. You will establish scalable foundations for data integration, governance, and analytics, enabling enterprise reporting and future AI capabilities.

The role combines hands-on engineering with architectural leadership, mentoring a growing team of data engineers and collaborating across business and technical stakeholders.