Data Ingestion & Infrastructure Engineer for Scalable AI Data

United States Digital Space LLC; Birmingham; On-site; GBP 70,000 - 120,000; Full time

Benefits offered by this job

Competitive salaries

Asynchronous culture

Impactful work in AI/Data

Job summary

United States Digital Space LLC is expanding its AI data team and seeks a Software Engineer to own data collection and support model training at scale. You will help build high-quality datasets at petabyte-scale, integrating infrastructure, engineering, and research work to enable next-generation products.

The role emphasizes data ingestion, cloud infrastructure, and collaboration with scientists to optimize data throughput and quality while controlling costs.

Qualifications

• BS/MS/PhD in Computer Science or a related field.
• 5+ years of industry experience in software development.
• Proficiency with bash/Python scripting in Linux environments.
• Proficiency in Docker and Infrastructure-as-Code concepts and professional experience with at least one major Cloud Provider (GCP).
• Experience with web crawlers, large-scale data processing workflows is a plus.
• Ability to handle multiple tasks and adapt to changing priorities.
• Strong communication skills, both written and verbal.

Responsibilities

• Be scrappy to find new sources of audio data and bring it into our ingestion pipeline.
• Operate and extend the cloud infrastructure for our ingestion pipeline, currently running on GCP and managed with Terraform.
• Collaborate closely with our Scientists to shift the cost/throughput/quality frontier, delivering richer data at bigger scale and lower cost to power our next-generation models.
• Collaborate with others on the AI Team and the company Leadership to craft the AI Team's dataset roadmap to power the company's next-generation consumer and enterprise products.

Skills

Python scripting

Bash

Linux

Docker

Terraform / IaC

GCP

Data ingestion pipelines

Communications

Education

BS/MS/PhD in Computer Science or related field

Tools

Docker

Terraform

GCP

Job description

United States Digital Space LLC is expanding its AI data team and seeks a Software Engineer to own data collection and support model training at scale. You will help build high-quality datasets at petabyte-scale, integrating infrastructure, engineering, and research work to enable next-generation products.

The role emphasizes data ingestion, cloud infrastructure, and collaboration with scientists to optimize data throughput and quality while controlling costs.