Tech Lead, Data & Inference Engineer: Scale AI Pipelines

Catalyst Labs; Illinois; Hybrid; USD 120,000 - 160,000; Full time

Job summary

A leading talent agency is seeking a Tech Lead, Data & Inference Engineer to design and scale an end-to-end data platform. The role involves building reliable data pipelines, guiding architectural decisions, and mentoring engineering teams. Candidates should have 6 to 12 years of experience in data systems, strong skills in SQL and Python, and a Bachelor's or Master's degree in a relevant field. Experience with distributed technologies and cloud platforms is essential. This position offers full-time work in a hybrid environment.

Qualifications

• 6 to 12 years of experience building production-grade data systems.
• Hands-on experience with distributed data technologies.
• Exposure to high-growth startup environments.

Responsibilities

• Lead the design and scaling of a data platform from ingestion to insights.
• Build scalable batch and streaming data pipelines.
• Mentor engineers and promote best practices.

Skills

Expert SQL skills

Python skills

Distributed data technologies (Spark, Flink, Kafka)

Modern orchestration tools (Airflow, Dagster, Prefect)

Strong communication skills

Education

Bachelor's or Master's degree in Computer Science or related field

Tools

Kubernetes

AWS

GCP

Azure

Job description

A leading talent agency is seeking a Tech Lead, Data & Inference Engineer to design and scale an end-to-end data platform. The role involves building reliable data pipelines, guiding architectural decisions, and mentoring engineering teams. Candidates should have 6 to 12 years of experience in data systems, strong skills in SQL and Python, and a Bachelor's or Master's degree in a relevant field. Experience with distributed technologies and cloud platforms is essential. This position offers full-time work in a hybrid environment.