Data Infra Engineer for AI Dataset Pipelines

Speechify; United States; Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Fast-growing environment

Entrepreneurial-minded team

Hands-off management

Impact in AI/audio tech

Competitive salaries

Asynchronous culture

Job summary

Speechify, a distributed AI/audio company, is hiring a Software Engineer for the Data side of our AI team to own data collection and support model training operations. You will build high-quality datasets at petabyte scale by tightly integrating infrastructure, engineering, and research work.

You will ingested data sources, manage the ingestion pipeline on GCP using Terraform, and collaborate with scientists to improve data quality and cost efficiency for next-generation products.

Qualifications

• BS/MS/PhD in Computer Science or a related field.
• 5+ years of industry experience in software development.
• Proficiency with bash/Python scripting in Linux environments.
• Proficiency in Docker and Infrastructure-as-Code concepts and professional experience with at least one major Cloud Provider (we use GCP).
• Experience with web crawlers and large-scale data processing workflows is a plus.
• Ability to handle multiple tasks and adapt to changing priorities.
• Strong communication skills, both written and verbal.

Responsibilities

• Be scrappy to find new sources of audio data and bring it into our ingestion pipeline.
• Operate and extend the cloud infrastructure for our ingestion pipeline, currently running on GCP and managed with Terraform.
• Collaborate closely with our Scientists to shift the cost/throughput/quality frontier, delivering richer data at bigger scale and lower cost.
• Collaborate with others on the AI Team and Speechify Leadership to craft the AI Team’s dataset roadmap to power Speechify’s next-generation products.

Skills

Bash scripting

Python scripting

Large-scale data processing

Web crawlers

Cloud infrastructure

Docker

Terraform

GCP experience

Multitasking & adaptability

Strong communication

Education

BS/MS/PhD in Computer Science or related field

Tools

Terraform

Docker

GCP

Job description

Speechify, a distributed AI/audio company, is hiring a Software Engineer for the Data side of our AI team to own data collection and support model training operations. You will build high-quality datasets at petabyte scale by tightly integrating infrastructure, engineering, and research work.

You will ingested data sources, manage the ingestion pipeline on GCP using Terraform, and collaborate with scientists to improve data quality and cost efficiency for next-generation products.