Senior Platform Engineer - Cloud Data Infra

TechWish; New York (NY); On-site; USD 140,000 - 200,000; Full time

Job summary

Fractal is seeking Platform Engineers to develop and optimize the infrastructure powering enterprise analytics platforms. You will manage dbt and Airflow instances, Kubernetes clusters, and CI/CD pipelines, ensuring secure, scalable cloud-native data stack operations across production environments.

You'll collaborate with data engineers to optimize pipelines, implement IaC, monitor health with Prometheus/Grafana, and support incident response while adhering to InfoSec policies.

Qualifications

• 6-10 years of platform/infrastructure engineering experience
• 3+ years with Kubernetes and container orchestration
• 3+ years with AWS or similar cloud platforms
• 2+ years managing data infrastructure (Airflow, dbt, or similar)
• Expert-level Kubernetes administration and orchestration
• Advanced AWS knowledge: EC2, S3, RDS, Lambda, VPC, IAM, CloudWatch
• Proficiency in Infrastructure as Code: Terraform, CloudFormation, or Ansible
• Strong Python and Bash scripting skills
• Experience with dbt and Airflow infrastructure and scaling
• Knowledge of networking concepts: proxies, load balancers, DNS, VPNs
• Understanding of security best practices: SSO, OIDC, IAM, encryption
• Monitoring and logging tools: Prometheus, Grafana, CloudWatch, ELK stack

Responsibilities

• Develop, deploy, and maintain dbt and Airflow instances in production
• Manage Kubernetes clusters and containerized applications
• Implement and maintain CI/CD pipelines for data applications
• Handle system upgrades, version migrations, and maintenance windows
• Troubleshoot and resolve infrastructure issues affecting pipeline execution
• Implement monitoring, alerting, and logging for infrastructure health
• Manage infrastructure as code (IaC) using Terraform or CloudFormation
• Provide security hardening and ensure compliance with InfoSec policies
• Support ML compute infrastructure and scaling requirements
• Collaborate with data engineers on pipeline optimization and troubleshooting
• Document infrastructure architecture, procedures, and runbooks
• Participate in on-call rotation for infrastructure support and incident response

Skills

Kubernetes

AWS

Airflow

dbt

Terraform

CloudFormation

Ansible

Python

Bash

Networking

Security best practices

Prometheus

Grafana

CloudWatch

Education

Bachelor's degree in Computer Science or related field

Masters degree preferred

Tools

Terraform

CloudFormation

Ansible

Job description

Fractal is seeking Platform Engineers to develop and optimize the infrastructure powering enterprise analytics platforms. You will manage dbt and Airflow instances, Kubernetes clusters, and CI/CD pipelines, ensuring secure, scalable cloud-native data stack operations across production environments.

You'll collaborate with data engineers to optimize pipelines, implement IaC, monitor health with Prometheus/Grafana, and support incident response while adhering to InfoSec policies.