Data Infrastructure Engineer for Scalable AI Data Pipelines

United States Digital Space LLC; United States; Remote; USD 110,000 - 160,000; Full time

Benefits offered by this job

Fast-growing environment

Asynchronous culture

Competitive salary

Impactful work

Remote-first team

Job summary

United States Digital Space LLC seeks a senior Software Engineer to join the AI data team, owning data collection and ingestion for model training. You will help build petabyte-scale datasets by tightly integrating infrastructure, engineering, and research.

You’ll extend the GCP-based ingestion pipeline with Terraform, collaborate with scientists, and shape the dataset roadmap powering our consumer and enterprise products.

Qualifications

• BS/MS/PhD in Computer Science or related field.
• 5+ years of industry experience in software development.
• Proficiency with bash/Python scripting in Linux environments.
• Proficiency in Docker and Infrastructure-as-Code concepts and professional experience with at least one major Cloud Provider (we use GCP).

Responsibilities

• Be scrappy to find new sources of audio data and bring it into our ingestion pipeline.
• Operate and extend the cloud infrastructure for our ingestion pipeline, currently running on GCP and managed with Terraform.
• Collaborate closely with our Scientists to shift cost/throughput/quality frontier, delivering richer data at bigger scale and lower cost to power our next-generation models.
• Collaborate with others on the AI Team and the company Leadership to craft the AI Team's dataset roadmap to power the company's next-generation consumer and enterprise products.

Skills

5+ years experience

Python scripting

Bash

Docker

Cloud (GCP)

Infrastructure as Code

Education

BS/MS/PhD in Computer Science

Tools

Terraform

Job description

United States Digital Space LLC seeks a senior Software Engineer to join the AI data team, owning data collection and ingestion for model training. You will help build petabyte-scale datasets by tightly integrating infrastructure, engineering, and research.

You’ll extend the GCP-based ingestion pipeline with Terraform, collaborate with scientists, and shape the dataset roadmap powering our consumer and enterprise products.