Lead Data Engineering: Real-Time ML Pipelines & Quality

Smadex; Austin (TX); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Competitive compensation

Medical/dental/vision plans

Career growth opportunities

Travel to Barcelona HQ

Job summary

Smadex is seeking a Data Engineering Team Lead to oversee two sub-teams and architect scalable data pipelines for real-time ML inference. The role is based in Austin, TX or New York, NY and offers opportunities to drive data quality and governance at scale.

You will lead data quality and feature engineering initiatives, coordinate with infrastructure, and collaborate with executive leadership to ensure operational excellence and impactful data products.

Qualifications

• 6+ years in software or data engineering with 2+ years in leadership.
• Advanced Spark and SQL skills and AWS experience.
• Strong debugging and communication skills.
• Master's degree or equivalent preferred.

Responsibilities

• Leading two sub-teams (Data Quality and Feature Engineering).
• Designing scalable data pipelines for real-time ML inference.
• Establishing data quality frameworks.
• Enforcing data governance.
• Overseeing feature store development.
• Coordinating pipeline strategies with infrastructure.
• Ensuring operational excellence.
• Collaborating with executive leadership.

Skills

Leadership

Spark

SQL

AWS

Debugging

Communication

Education

Master's degree

Tools

Docker

Kubernetes

Airflow

Git

Jira

Notion

Jenkins

MySQL

Redis

Job description

Smadex is seeking a Data Engineering Team Lead to oversee two sub-teams and architect scalable data pipelines for real-time ML inference. The role is based in Austin, TX or New York, NY and offers opportunities to drive data quality and governance at scale.

You will lead data quality and feature engineering initiatives, coordinate with infrastructure, and collaborate with executive leadership to ensure operational excellence and impactful data products.