Senior Backend Engineer: Scalable Data Unification

Udio; New York (NY); On-site; USD 180,000 - 220,000; Full time

Benefits offered by this job

Highly competitive salary

Equity

Flexible time off

Excellent health insurance

401(k) with employer matching

Manhattan office location

Job summary

Udio is seeking a Senior Backend Engineer to unify large, heterogeneous datasets powering generative audio models. You will build scalable ingestion and data-linkage systems to produce a canonical asset used company-wide, collaborating with ML researchers and product teams.

The role requires Python mastery and experience with BigQuery, Dataflow/Beam, TFRecords, and Ray. You will design and implement high-throughput workflows, refine matching rules, and ensure data quality across diverse sources,

Qualifications

• Experience with large, heterogeneous datasets from multiple providers.
• Strong background in entity resolution, deduplication, and data unification.
• Proficiency in Python for efficient data processing.
• Familiarity with BigQuery, Dataflow/Beam, and similar batch-processing frameworks.
• Ability to design matching and decision strategies balancing accuracy and efficiency.

Responsibilities

• Build high-throughput bulk ingestion workflows to integrate datasets from multiple providers.
• Design scalable entity-resolution solutions including linking, deduplication, clustering, and conflict arbitration.
• Create and refine matching logic and similarity functions for high accuracy.
• Define data quality indicators such as overlap metrics and match precision/recall.
• Prepare training-ready datasets in formats like TFRecords for ML research.
• Develop components using Dataflow (Beam) and manage large analytical workloads in BigQuery.
• Leverage Ray to accelerate large-scale experiments and data preparation.
• Collaborate with ML researchers to evolve linkage strategies for new sources.

Skills

Python

Entity resolution

Data linking

Data deduplication

Bulk ingestion

Distributed systems

Tools

BigQuery

Dataflow/Beam

TFRecords

Ray

JAX

Job description

Udio is seeking a Senior Backend Engineer to unify large, heterogeneous datasets powering generative audio models. You will build scalable ingestion and data-linkage systems to produce a canonical asset used company-wide, collaborating with ML researchers and product teams.

The role requires Python mastery and experience with BigQuery, Dataflow/Beam, TFRecords, and Ray. You will design and implement high-throughput workflows, refine matching rules, and ensure data quality across diverse sources,