Tech Lead, Data & Inference Engineer — AI Platform

Catalyst Labs; Manhattan Beach (CA); Hybrid; USD 125,000 - 180,000; Full time

Job summary

A leading talent agency is seeking a Tech Lead, Data & Inference Engineer to oversee the design and scaling of a comprehensive data platform. This full-time role involves building scalable data pipelines and ensuring reliability and performance. The ideal candidate should have 6 to 12 years of experience in data architecture and deep expertise in relevant technologies. Strong mentorship and collaboration skills are essential. Join a team driving innovation in applied AI and data processing in a hybrid environment.

Qualifications

• Excellent written and verbal communication skills.
• Proactive and collaborative mindset.
• Experience in hybrid or distributed environments.
• Ability to teach, mentor, and document technical decisions.

Responsibilities

• Lead the design and development of a data platform from ingestion to insights.
• Build and maintain scalable batch and streaming pipelines.
• Take ownership of reliability, cost, and service level objectives.
• Guide architectural decisions across the data pipeline stack.
• Mentor engineers and promote data driven best practices.

Skills

SQL (query optimization on large datasets)

Python

Data architecture

Pipeline design

Distributed data technologies (Spark, Flink, Kafka)

Orchestration tools (Airflow, Dagster, Prefect)

Kubernetes

Cloud infrastructure (AWS, GCP, Azure)

Education

Bachelors or Masters degree in Computer Science, Computer Engineering, Electrical Engineering, or Mathematics

Tools

dbt

DuckDB

Job description

A leading talent agency is seeking a Tech Lead, Data & Inference Engineer to oversee the design and scaling of a comprehensive data platform. This full-time role involves building scalable data pipelines and ensuring reliability and performance. The ideal candidate should have 6 to 12 years of experience in data architecture and deep expertise in relevant technologies. Strong mentorship and collaboration skills are essential. Join a team driving innovation in applied AI and data processing in a hybrid environment.