AI Data Infrastructure Engineer – Petabyte-Scale Storage

Cohere; New York (NY); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Inclusive work culture

Weekly lunch stipend

Full health and dental benefits

100% Parental Leave top-up

Personal enrichment benefits

Remote-flexible working

6 weeks of vacation

Job summary

Cohere in New York is seeking a Software Engineer for Data Infrastructure. You will work on high-performance storage solutions for demanding AI workloads. Ideal candidates have 4+ years in data storage systems, strong Python skills, and Kubernetes experience. The role offers an inclusive culture, health benefits, remote flexibility, and 6 weeks of vacation. Join a leading team in shaping AI's future with cutting-edge technology.

Qualifications

• 4+ years of experience working on data storage infrastructure.
• Strong command of Python programming.
• Experience with Kubernetes, focusing on storage aspects.
• Ability to transform unstructured data into efficient datasets.

Responsibilities

• Build and maintain the high-performance data layer for training.
• Work on petabyte-scale storage infrastructure.

Skills

Data storage infrastructure

Python

Kubernetes

Distributed data processing

AI enthusiasm

Tools

Apache Beam

Spark

Flink

BigQuery

Airflow

dbt

Job description

Cohere in New York is seeking a Software Engineer for Data Infrastructure. You will work on high-performance storage solutions for demanding AI workloads. Ideal candidates have 4+ years in data storage systems, strong Python skills, and Kubernetes experience. The role offers an inclusive culture, health benefits, remote flexibility, and 6 weeks of vacation. Join a leading team in shaping AI's future with cutting-edge technology.