Senior Cloud Platform Engineer - Spark & Airflow Lead

Fidelity Investments; Merrimack (NH); On-site; USD 140,000 - 190,000; Full time

Job summary

Fidelity Investments in the United States is seeking a hands-on Lead Cloud Platform Engineer to implement, scale, and operate cloud-native infrastructure powering large-scale data processing. You will lead production-grade platforms built on Apache Spark and Airflow in AWS, optimize Spark workloads, manage Kubernetes-based execution, and drive observability, security, and reliability across the platform.

The role emphasizes mentoring engineers, CI/CD, and collaboration across teams, with a focus

Qualifications

• 8+ years in software, platform, or cloud engineering.
• Hands-on production experience with Spark and Airflow.
• Experience operating large-scale distributed systems in AWS.

Responsibilities

• Implement and operate cloud-native platform services.
• Lead Spark and Airflow deployments and tuning.
• Maintain observability, monitoring, and SLOs.
• Mentor engineers and drive reliability.

Skills

Spark expertise

Airflow expertise

Kubernetes

AWS cloud

Python/Java/Go

CI/CD

Observability

Troubleshooting

Leadership

Security networking

Education

Bachelor’s or Master’s in CS or related

Tools

Docker

GitHub Copilot

LLMs

Job description

Fidelity Investments in the United States is seeking a hands-on Lead Cloud Platform Engineer to implement, scale, and operate cloud-native infrastructure powering large-scale data processing. You will lead production-grade platforms built on Apache Spark and Airflow in AWS, optimize Spark workloads, manage Kubernetes-based execution, and drive observability, security, and reliability across the platform.

The role emphasizes mentoring engineers, CI/CD, and collaboration across teams, with a focus