Data Pipelines Engineer for Scalable AI Datasets

United States Digital Space LLC; United States; Remote; USD 140,000 - 180,000; Full time

Benefits offered by this job

Competitive salaries

Asynchronous culture

Remote work

Impactful product

Job summary

United States Digital Space LLC is seeking a software engineer to own data collection supporting model training. You will build high-quality datasets at petabyte scale and manage the ingestion pipeline in a cloud-first environment.

You will work with AI researchers to optimize cost, throughput, and quality, and help define the data roadmap for future consumer and enterprise AI products. This is a fully remote role with global team collaboration.

Qualifications

• BS/MS/PhD in Computer Science or a related field is required or preferred.
• 5+ years of industry software development experience.
• Proficiency with bash/Python scripting in Linux environments.
• Proficiency with Docker and Infrastructure-as-Code concepts; experience with GCP.
• Experience with web crawlers and large-scale data processing workflows is a plus.
• Strong written and verbal communication skills.

Responsibilities

• Be scrappy to find new sources of audio data and bring it into our ingestion pipeline.
• Operate and extend the cloud infrastructure for our ingestion pipeline (GCP/Terraform).
• Collaborate with Scientists to improve cost/throughput/quality for larger data at lower cost.
• Help craft the dataset roadmap for next-gen consumer and enterprise products.

Skills

bash/Python scripting

Docker

Infrastructure as Code

GCP cloud

Terraform

Web crawlers

Large-scale data processing

Strong communication

Education

BS/MS/PhD in Computer Science or related field

Tools

Docker

Terraform

Job description

United States Digital Space LLC is seeking a software engineer to own data collection supporting model training. You will build high-quality datasets at petabyte scale and manage the ingestion pipeline in a cloud-first environment.

You will work with AI researchers to optimize cost, throughput, and quality, and help define the data roadmap for future consumer and enterprise AI products. This is a fully remote role with global team collaboration.