Data Engineering Manager: AI-Driven Data Platform Lead

Epsilon; Irving (TX); On-site; USD 105,000 - 195,000; Full time

Benefits offered by this job

Flexible Time Off

Paid Holidays

Parental Leave

401(k) plan

Health coverage

Tuition assistance

Job summary

Epsilon is seeking a Data Engineer Manager to shape the architectural vision for data and AI initiatives. You will guide data mesh adoption, champion scalable pipelines, and collaborate with stakeholders to translate complex requirements into high-performance solutions.

You will mentor engineers, design end-to-end data platforms on AWS/Azure, and drive best practices in security, governance, and DevOps across data teams.

Qualifications

• 6+ years of IT experience with 5+ years in engineering focusing on data/AI.
• Experience designing identity graphs in paid and owned audiences.
• Expertise in Solution Architecture including diagrams and specs for complex systems.
• Hands-on with modern data platforms (Databricks, Snowflake) incl. lakehouse patterns and MLflow.
• Proficiency on major clouds (AWS and/or Azure) including data services.
• Proven ability to design/optimize robust data pipelines (ETL/ELT, streaming).
• Strong Python skills for data engineering and automation.
• Expert SQL for data manipulation and optimization.
• Java experience desirable for enterprise integration.
• Understanding of AI/ML concepts and MLOps in production.
• Experience with API/message queues/event-driven architectures.
• Excellent communication and stakeholder presentation skills.

Responsibilities

• End-to-end design of scalable, fault-tolerant data/AI solutions with CI/CD and DevOps practices.
• Assess existing systems to identify gaps and modernization opportunities.
• Champion data mesh architecture and data products for decentralized ownership.
• Define AI/ML pipelines for training, inference, and monitoring.
• Design solutions in AWS/Azure with security and cost efficiency.
• Drive adoption of Databricks and Snowflake for data engineering and analytics.
• Oversee robust data pipelines for batch, streaming, and real-time data.
• Architect integration of new and existing systems and APIs.
• Provide technical leadership and mentorship to engineering teams.
• Collaborate with product, analytics, and leadership to align requirements.
• Evaluate new data/AI/cloud technologies and recommend investments.
• Incorporate security, governance, and compliance into designs.

Skills

IT experience

Identity graphs

Solution architecture

Databricks & Snowflake

AWS & Azure

Data pipelines

Python

SQL

Java

AI/ML concepts

Integration patterns

Communication skills

Tools

Databricks

Snowflake

AWS

Azure

Job description

Epsilon is seeking a Data Engineer Manager to shape the architectural vision for data and AI initiatives. You will guide data mesh adoption, champion scalable pipelines, and collaborate with stakeholders to translate complex requirements into high-performance solutions.

You will mentor engineers, design end-to-end data platforms on AWS/Azure, and drive best practices in security, governance, and DevOps across data teams.