Tech Lead, Data & Inference Engineer: Scale AI Pipelines

Catalyst Labs; New Jersey; Hybrid; USD 130,000 - 180,000; Full time

Job summary

A talent agency specializing in AI is seeking a Tech Lead, Data & Inference Engineer. This role involves leading the design and development of a data platform, ensuring high data quality, and mentoring engineers. The ideal candidate has 6-12 years of experience in building production-grade data systems, excellent SQL and Python skills, and familiarity with distributed technologies like Spark and Kafka. A Bachelor's or Master's in a relevant field is required, and hands-on experience in a high-growth startup is a bonus.

Qualifications

• 6 to 12 years of experience building and scaling production-grade data systems.
• Deep expertise in data architecture, modeling, and pipeline design.
• Hands-on experience with distributed data technologies.

Responsibilities

• Lead the design, development, and scaling of an end-to-end data platform.
• Build and maintain scalable batch and streaming pipelines.
• Ensure data quality and support for real-time and batch-oriented use cases.

Skills

Excellent written and verbal communication

Proactive and collaborative mindset

Strong ownership and accountability

Ability to teach and mentor

Expert SQL skills

Proficiency in Python

Education

Bachelor's or Master's degree in Computer Science

Tools

Spark

Flink

Kafka

Airflow

Dagster

Prefect

Kubernetes

AWS

GCP

Azure

Job description

A talent agency specializing in AI is seeking a Tech Lead, Data & Inference Engineer. This role involves leading the design and development of a data platform, ensuring high data quality, and mentoring engineers. The ideal candidate has 6-12 years of experience in building production-grade data systems, excellent SQL and Python skills, and familiarity with distributed technologies like Spark and Kafka. A Bachelor's or Master's in a relevant field is required, and hands-on experience in a high-growth startup is a bonus.