Data Engineering Team Lead: Real-Time ML Pipelines

Smadex; United States; On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits plans

Learning and training opportunities

Possibility of traveling to Barcelona HQ

Job summary

Smadex, a leading ad-tech company, is looking for a Data Engineering Team Lead to manage and scale specialized sub-teams in Austin, TX, or New York, NY. Your role involves overseeing data quality and feature engineering while designing robust data pipelines to enable real-time machine learning features.

Candidates should have over 6 years of experience in data engineering, a strong technical background in Spark, and excellent leadership skills. The position offers a comprehensive compensation package, medical benefits, and career growth opportunities.

Qualifications

• 6+ years of experience in software or data engineering with leadership roles.
• Proven track record of designing and optimizing complex batch and streaming pipelines.
• Strong ability to debug complex distributed systems.

Responsibilities

• Lead and scale two specialized sub-teams regarding data quality and feature engineering.
• Design scalable data pipelines bridging big data storage and real-time machine learning inference.
• Establish rigorous standards for data observability.

Skills

Big Data Expertise

Advanced SQL knowledge

Leadership experience

Communication skills in English

Deep Technical Mastery

Education

Master's degree in Computer Science, Engineering, or Applied Mathematics

Tools

Apache Spark

AWS

Docker

Kubernetes

SQL

Job description

Smadex, a leading ad-tech company, is looking for a Data Engineering Team Lead to manage and scale specialized sub-teams in Austin, TX, or New York, NY. Your role involves overseeing data quality and feature engineering while designing robust data pipelines to enable real-time machine learning features.

Candidates should have over 6 years of experience in data engineering, a strong technical background in Spark, and excellent leadership skills. The position offers a comprehensive compensation package, medical benefits, and career growth opportunities.