Tech Lead, Data Platform & Inference

Catalyst Labs; United (PA); Hybrid; USD 140,000 - 180,000; Full time

Job summary

A leading talent agency seeks a Tech Lead, Data & Inference Engineer. The role involves designing and scaling a data platform, mentoring engineers, and optimizing data pipelines. Ideal candidates will have 6-12 years of experience in data system development, strong skills in SQL and Python, and familiarity with distributed data technologies like Spark and Kubernetes. The position is hybrid and offers competitive compensation including bonuses and equity.

Qualifications

• 6 to 12 years of experience building and scaling production-grade data systems.
• Strong SQL and Python skills focused on large datasets.
• Experience with distributed data technologies and modern orchestration tools.

Responsibilities

• Lead end-to-end data platform design and development.
• Build and maintain scalable batch and streaming pipelines.
• Mentor engineers and promote data-driven best practices.

Skills

Data architecture

SQL optimization

Python

Pipeline design

Mentoring

Education

Bachelor's or Master's degree in Computer Science or related field

Tools

Spark

Flink

Kafka

Airflow

Kubernetes

Job description

A leading talent agency seeks a Tech Lead, Data & Inference Engineer. The role involves designing and scaling a data platform, mentoring engineers, and optimizing data pipelines. Ideal candidates will have 6-12 years of experience in data system development, strong skills in SQL and Python, and familiarity with distributed data technologies like Spark and Kubernetes. The position is hybrid and offers competitive compensation including bonuses and equity.