Data Infrastructure Engineer II — Scale AI Workloads

Feedinkoo: Remote Jobs; United States; Hybride; USD 109 000 - 160 000; Plein temps

Avantages offerts par ce poste

Competitive base salary

Discretionary bonus and equity

Excellent health benefits (medical, Rx

Life insurance & disability

FSA/HSA

Tuition reimbursement

ESPP

Mental health resources

Parental leave

401(k) match

Generous PTO

Office lunches & hybrid/remote options

Résumé du poste

CoreWeave is seeking a Software Engineer II for the Data Infrastructure team to enhance reliability, scalability, and performance of the data platform. You will design and maintain storage and compute systems powering analytics and AI workloads, owning the data lake and clustered compute environments.

You will build observability, monitoring, and automation that improves deployment, capacity planning, and operational efficiency while collaborating with data science, DevOps, and security teams.

Qualifications

• 2+ years of Kubernetes & Helm experience.
• 3+ years programming in Go, Rust, Python, C++, C#, or Java.
• 3+ years scripting in Python or Bash.
• Solid understanding of data storage and distributed compute.
• Experience with Prometheus, Alertmanager, Grafana.
• Experience administering Spark/Ray/Kafka/Flink on Kubernetes is preferred.
• Familiarity with large-scale observability and performance frameworks a plus.
• Automation for deployment, monitoring, and capacity management.
• Strong problem-solving skills and collaborative approach.

Responsabilités

• Design, develop, and maintain storage and compute systems for analytics and AI workloads.
• Own and optimize data lake and clustered compute environments for availability, security, and performance.
• Develop observability, monitoring, and alerting frameworks to preempt issues.
• Implement deployment and capacity-automation tasks to improve reliability.
• Collaborate with data science, DevOps, and security teams to align with requirements and security standards.
• Participate in capacity planning and performance tuning for scale.
• Maintain documentation of architecture, procedures, and best practices.
• Stay current with new technologies to continuously improve the data platform.

Connaissances

Kubernetes & Helm

Programming languages

Scripting (Python/Bash)

Distributed systems

Monitoring (Prometheus/Grafana)

Big data on Kubernetes

Observability frameworks

Automation

Problem solving & collaboration

Outils

Spark on Kubernetes

Ray on Kubernetes

Kafka on Kubernetes

Flink on Kubernetes

Description du poste

CoreWeave is seeking a Software Engineer II for the Data Infrastructure team to enhance reliability, scalability, and performance of the data platform. You will design and maintain storage and compute systems powering analytics and AI workloads, owning the data lake and clustered compute environments.

You will build observability, monitoring, and automation that improves deployment, capacity planning, and operational efficiency while collaborating with data science, DevOps, and security teams.