Platform Engineer Sr. - AWS / Airflow

thoughtworksreferral; Chicago (IL); On-site; USD 140,000 - 210,000; Full time

Job summary

Thoughtworks is seeking a Senior Platform Engineer to design and optimize an AWS-centric platform infrastructure that enables high-scale software delivery and robust data workflows. You will focus on developer experience, tooling, automation, security, and scalability, with ownership of Terraform automation and MWAA integration.

You will lead the creation of secure, highly available platform components, collaborate with data and engineering teams, and mentor juniors while shaping strategic

Qualifications

• Strong background in AWS-based platform design and security.
• Experience with EKS, performance tuning, and cost optimization.
• Hands-on data workflows with Apache Airflow, MWAA, and dbt CI/CD.

Responsibilities

• Lead design and management of scalable AWS platform infra.
• Build automated CI/CD pipelines with Harness and GitHub for data environments.
• Manage containers ( Docker, Kubernetes, EKS ) and IaC via Terraform.
• Troubleshoot and drive root-cause analysis for platform stability.
• Mentor engineers and advance DevOps/GitOps practices.

Skills

AWS & Cloud Architecture

Data Orchestration

Automation & IaC

Containers & Microservices

Coding & Observability

Tools

Terraform

Harness CI/CD

GitHub

Docker

Kubernetes

Amazon EKS

dbt

Prometheus

Grafana

Datadog

NewRelic

Job description

As a Senior Platform Engineer, you will design, develop, and optimize the AWS-centric platform infrastructure that enables high-scale software delivery and reliable data workflows . Your primary focus will be on enhancing the Developer Experience by creating and improving tools, systems, and processes using modern solutions like Harness CI/CD and GitHub . You will collaborate closely with engineering and data teams, providing technical guidance and fostering best practices in automation, security, and scalability. As a senior engineer, you will take ownership of critical platform components, including Terraform automation and Managed Workflows for Apache Airflow (MWAA), and contribute significantly to strategic decisions, ensuring alignment with both business and technical objectives.

Job responsibilities

• Lead the design, implementation, and management of a secure, highly available, and scalable AWS platform infrastructure, proactively executing strategies to balance cost, reliability, and performance across all cloud services.
• Architect, maintain, and optimize automated CI/CD pipelines using Harness and GitHub for fast feedback loops, including designing robust deployment processes specifically for data environments (dbt CI/CD and Apache Airflow/AWS MWAA).
• Manage and optimize containerized environments (Docker, Kubernetes, Amazon EKS) and drive the adoption of Infrastructure as Code (IaC) using Terraform for scalable resource management and provisioning.
• Ensure platform stability by troubleshooting complex issues, performing detailed root cause analysis, and driving effective corrective actions.
• Advance DevOps and GitOps practices across the organization while mentoring junior engineers and providing technical guidance to cross-functional teams.

Job qualifications

Technical Skills

• Core AWS & Cloud Architecture: Solid background in structuring secure, highly scalable cloud architectures with a strict focus on AWS (including serverless, advanced networking, and best practices).
• Requires mastery of Amazon EKS, alongside advanced knowledge in performance tuning, cost optimization, and platform scaling.
• Data Orchestration & Workflows: Extensive hands-on experience in managing and deploying complex data workflows, requiring deep knowledge of Apache Airflow, AWS MWAA, and dbt (Data Build Tool), including proven experience implementing dbt CI/CD pipelines.
• Automation, IaC & Delivery: Advanced proficiency in building Infrastructure as Code (IaC), primarily Terraform, combined with expertise in designing and integrating enterprise automation pipelines using Harness CI/CD and GitHub.
• Containers & Microservices: Deep technical understanding of containerization (Docker, Kubernetes) and modern software ecosystems, including strong specialization in microservices architecture, RESTful APIs, and NoSQL databases.
• Coding & Observability: Strong foundation in programming and scripting languages (such as Python, Go, or Bash), coupled with expert-level experience implementing observability and monitoring tools (e.g., Prometheus, Grafana, Datadog, NewRelic).

Professional Skills

• Exceptional communication skills, capable of influencing technical and non-technical stakeholders (including data engineering and development teams).
• Proven leadership and mentoring abilities within cross-functional teams.
• Strong problem-solving skills with a focus on innovative and sustainable solutions.
• Ability to take strategic ownership and drive continuous improvement initiatives.
• Proficiency in presenting technical recommendations with well-reasoned arguments.

Other things to know

Learning & Development

There is no one-size-fits-all career path at Thoughtworks: however you want to develop your career is entirely up to you. But we also balance autonomy with the strength of our cultivation culture. This means your career is supported by interactive tools, numerous development programs and teammates who want to help you grow. We see value in helping each other be our best and that extends to empowering our employees in their career journeys.

Responsible Use of AI in Recruitment

At Thoughtworks, we use AI tools to support our recruitment team with administrative tasks such as drafting communications, scheduling interviews and writing job descriptions.

Crucially, our AI tools do not screen, assess, rank or make hiring decisions. Every application is reviewed by our team and all selection decisions are made exclusively by our interviewers and hiring managers.

We are committed to fairness and responsible AI. We actively manage our AI systems by testing, monitoring for biased outcomes and implementing mitigation measures. We hold our third-party vendors to these same high standards through a rigorous governance process. For additional information, please see our full Thoughtworks AI Policy for Recruitment .

EEO

Thoughtworks is an equal-opportunity employer. We are committed to providing equal employment opportunities to all qua