Lead Cloud Platform Engineer - Spark & Airflow Expert

Soteria Reinsurance Ltd.; Merrimack (NH); On-site; USD 140,000 - 190,000; Full time

Job summary

Soteria Reinsurance Ltd. is seeking a hands-on Lead Cloud Platform Engineer to build, scale, and operate a cloud-native execution platform for large-scale data processing.

You’ll own Spark pipelines, Airflow orchestration, and distributed systems in AWS, with emphasis on reliability, observability, and security. The role requires deep production experience, strong debugging skills, and leadership to mentor engineers while driving operational excellence across planning, delivery, and cross-team

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years in software, platform, or cloud engineering roles, with production distributed systems experience.
• Strong expertise in Spark and Airflow in production.
• Experience with AWS cloud services and Kubernetes-based environments.

Responsibilities

• Lead implementation and operation of cloud-native platform services for distributed data systems.
• Scale fault-tolerant, high-throughput systems and own Spark data pipelines and Airflow DAGs.
• Tune workloads, troubleshoot jobs, and optimize Kubernetes-based execution environments.
• Define and manage SLIs/SLOs and build observability with metrics and dashboards.

Skills

Distributed systems

Leadership / mentoring

Troubleshooting

Python

Education

Bachelor’s or Master’s in Computer Science or related field

Tools

Apache Spark

Apache Airflow

Kubernetes (EKS)

AWS (EC2, S3, Lambda, RDS)

Docker

Job description

Soteria Reinsurance Ltd. is seeking a hands-on Lead Cloud Platform Engineer to build, scale, and operate a cloud-native execution platform for large-scale data processing.

You’ll own Spark pipelines, Airflow orchestration, and distributed systems in AWS, with emphasis on reliability, observability, and security. The role requires deep production experience, strong debugging skills, and leadership to mentor engineers while driving operational excellence across planning, delivery, and cross-team