Data Engineering Team Lead

Smadex; Austin (TX); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Competitive compensation

Medical/dental/vision plans

Career growth opportunities

Travel to Barcelona HQ

Job summary

Smadex is seeking a Data Engineering Team Lead to oversee two sub-teams and architect scalable data pipelines for real-time ML inference. The role is based in Austin, TX or New York, NY and offers opportunities to drive data quality and governance at scale.

You will lead data quality and feature engineering initiatives, coordinate with infrastructure, and collaborate with executive leadership to ensure operational excellence and impactful data products.

Qualifications

• 6+ years in software or data engineering with 2+ years in leadership.
• Advanced Spark and SQL skills and AWS experience.
• Strong debugging and communication skills.
• Master's degree or equivalent preferred.

Responsibilities

• Leading two sub-teams (Data Quality and Feature Engineering).
• Designing scalable data pipelines for real-time ML inference.
• Establishing data quality frameworks.
• Enforcing data governance.
• Overseeing feature store development.
• Coordinating pipeline strategies with infrastructure.
• Ensuring operational excellence.
• Collaborating with executive leadership.

Skills

Leadership

Spark

SQL

AWS

Debugging

Communication

Education

Master's degree

Tools

Docker

Kubernetes

Airflow

Git

Jira

Notion

Jenkins

MySQL

Redis

Job description

Smadex is seeking a Data Engineering Team Lead with expertise in big data architectures and leadership experience. The role is full-time, based in Austin, TX or New York, NY.

• Leading two sub-teams (Data Quality and Feature Engineering)
• Designing scalable data pipelines for real-time ML inference
• Establishing data quality frameworks
• Enforcing data governance
• Overseeing feature store development
• Coordinating pipeline strategies with infrastructure
• Ensuring operational excellence
• Collaborating with executive leadership

• 6+ years in software or data engineering with 2+ years in leadership
• Advanced Spark and SQL skills
• AWS experience
• Strong debugging and communication skills

• Preferred experience includes AdTech, RTB/DSP ecosystems, feature stores, containerization (Docker, Kubernetes), and a master's degree in a relevant field.

• Python, Scala, Bash, Spark, MySQL, Redis, AWS, Jenkins, Docker, Airflow, Git, Jira, and Notion.

• Competitive compensation, medical/dental/vision plans, career growth opportunities, and potential travel to Barcelona HQ.

Visa sponsorship is not provided.