Lead Data Engineer, Real-Time Data & ML Pipelines

Entravision; New York (NY); On-site; USD 300,000 - 400,000; Full time

Benefits offered by this job

Travel to Barcelona HQ

Competitive US market pay

Medical, dental, and vision benefits

Learning & training opportunities

Exposure to global publishers/partners

Career growth opportunities

Job summary

Smadex is seeking a Data Engineering Team Lead in New York, NY, or Austin, TX, to drive a high-throughput data platform powering real-time bidding and ML features. You will lead Data Quality and Feature Engineering teams, architect robust data pipelines, and align tech strategy with business goals.

The role requires 6+ years in data/software engineering with leadership, strong Spark, and AWS expertise, plus excellent English communication.

Qualifications

• 6+ years in software or data engineering with 2+ years in leadership.
• Advanced Spark expertise and code-review ability.
• Experience designing batch and streaming pipelines with Spark.
• Strong SQL skills and AWS cloud experience (EMR, EC2, Athena, S3).
• Proven debugging and root-cause analysis for production systems.
• Excellent English communication for stakeholders.

Responsibilities

• Lead Data Engineering group and two sub-teams: Data Quality and Feature Engineering.
• Architect scalable data pipelines for real-time bidding and ML features.
• Define the technical roadmap and mentor engineers; ensure ops excellence.
• Oversee data quality, observability, and automated testing.
• Coordinate DAGs and data workflows using Apache Airflow.
• Own Feature Store and Spark pipelines feeding ML models.
• Collaborate with CTO/CDO on tech strategy and product integration.
• Ensure governance around data privacy, security, and lifecycle.

Skills

Leadership

Spark

Big Data

SQL

AWS

Communication

Education

Master’s degree in Computer Science, Engineering, or Applied Mathematics

Tools

Docker

Kubernetes

Airflow

Redis

Jenkins

Job description

Smadex is seeking a Data Engineering Team Lead in New York, NY, or Austin, TX, to drive a high-throughput data platform powering real-time bidding and ML features. You will lead Data Quality and Feature Engineering teams, architect robust data pipelines, and align tech strategy with business goals.

The role requires 6+ years in data/software engineering with leadership, strong Spark, and AWS expertise, plus excellent English communication.