Senior Platform Engineer: Workflow Orchestration at Scale

Socket.dev; Houston, San Francisco (TX, CA); On-site; USD 120,000 - 190,000; Full time

Job summary

Bot Auto in Houston, TX is hiring a Senior Software Engineer to architect, deploy, and operate our workflow orchestration platforms (Argo Workflows, Airflow) that power simulation, ML training, data pipelines, and CI/CD. You will shape internal platforms and abstractions on top of orchestration engines for reliability and cost-efficiency.

You will work across Kubernetes environments (AWS and on-prem), partner with ML, data, and infrastructure teams, mentor engineers, and establish best practices

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience.
• 5+ years of hands-on experience in platform engineering, infrastructure, DevOps, or SRE roles.
• Significant experience with workflow orchestration platforms such as Argo Workflows, Airflow, or comparable systems.
• Strong software development skills in Python, Go, Java, or JavaScript/TypeScript.
• Solid understanding of Kubernetes and distributed systems.

Responsibilities

• Architect, deploy, and operate workflow orchestration platforms (e.g., Argo Workflows, Airflow, or a hybrid) supporting simulation, machine learning and model training, data pipelines, CI/CD, and other general-purpose workloads.
• Build internal platforms, abstractions, SDKs, and self-service tooling on top of orchestration engines to make authoring, running, and monitoring workflows simple and reliable for engineers.
• Operate workflow platforms at scale on Kubernetes across cloud (AWS) and on-prem data center environments, handling scheduling, autoscaling, GPU and heterogeneous resources, and cross-cluster orchestration.
• Ensure reliability, performance, and cost efficiency of workloads through observability, queuing and prioritization, retries, and resource optimization.
• Partner with ML, simulation, data, and infrastructure teams to understand workload requirements and deliver fit-for-purpose pipelines.
• Integrate workflow platforms with storage, data streaming and event systems, artifact and model registries, and CI/CD tooling.
• Establish best practices, templates, and documentation for workflow authoring and operations; mentor engineers across the company.
• Handle user-impacting issues promptly with clear communication — mitigate in the short term and follow up with durable long-term solutions.

Skills

Python

Go

Java

JavaScript/TypeScript

Kubernetes

Distributed systems

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Argo Workflows

Airflow

Terraform

Pulumi

OpenTofu

Ansible

Job description

Bot Auto in Houston, TX is hiring a Senior Software Engineer to architect, deploy, and operate our workflow orchestration platforms (Argo Workflows, Airflow) that power simulation, ML training, data pipelines, and CI/CD. You will shape internal platforms and abstractions on top of orchestration engines for reliability and cost-efficiency.

You will work across Kubernetes environments (AWS and on-prem), partner with ML, data, and infrastructure teams, mentor engineers, and establish best practices