Data Engineering Manager — AI-Driven Data Platform

Red Ventures; New York (NY); Hybrid; USD 130,000 - 200,000; Full time

Benefits offered by this job

Health Insurance Coverage

Life Insurance

Disability Insurance

Flexible Spending Accounts

Holiday Pay

401(k) with match

Employee Assistance Program

Parental Bonding Benefit Program

Flexible PTO

Job summary

Red Ventures’ Home Client Services group seeks a Data Engineering Manager to lead a team of 2-4 data engineers building the data platform powering the home services business. You will translate business strategy into executable plans on a modern lakehouse stack and serve as a credible technical contact for clients and internal stakeholders.

You will coach engineers, own end-to-end platform delivery, enforce governance, and drive AI-forward practices while partnering with business teams to

Qualifications

• 3+ years managing a data engineering team, plus at least 5 years of hands-on data engineering experience before or alongside that management experience
• 4+ years of hands-on Databricks experience, including Unity Catalog, Delta Lake, and workflow orchestration
• 4+ years working on cloud technologies: AWS preferred, Azure or GCP experience welcome
• Strong hands-on coding experience with Python and PySpark in a distributed computing context
• Strong background in code-first data transformation workflows, scalable data modeling, and data quality best practices
• Deep expertise in data governance, including data quality standards, lineage, access control, and documentation, and a track record of holding a team accountable to those standards
• Experience with pipeline observability and monitoring practices: knows what it takes to run reliable data products in production, including alerting, backfill management, and failure triage
• Experience with GitHub and CI/CD processes in a collaborative engineering environment
• Excellent communication skills up, down, and across the organization, with the ability to translate complex technical concepts for both technical and non-technical audiences and a proven track record of doing so in client-facing or external partnership contexts
• Fluency in how AI is reshaping data engineering, demonstrated comfort with agentic tooling, and a track record of building AI into the stack and approaching the work differently
• Consistently engages data engineering early in the process, understands how data is used and created across the organization, and knows how to activate a strong existing team to deliver more

Responsibilities

• Lead a team of 2-4 Data Engineers to design and build data pipelines from various sources to a target data warehouse using real-time and batch loading on a modern cloud stack
• Provide servant leadership, support performance reviews, give actionable feedback, and invest in engineers' career growth
• Own end-to-end data platform design and delivery—from ingestion to outgestion, scheduling, alerting, and monitoring
• Build relationships with business, client, and technical stakeholders to translate strategy into a technical roadmap and push back when needed
• Establish and enforce data governance, data quality, lineage, access control, metadata, and end-to-end workflows
• Drive platform reliability, scalability, performance, cost optimization, and proactive monitoring
• Lead proofs-of-concept to validate and improve processes and approaches
• Champion AI integration into the data stack and AI-forward tooling practices
• Engage early with stakeholders to surface value opportunities and involve data engineering before requirements lock

Skills

Team leadership

Databricks

Cloud platforms (AWS)

Python

PySpark

Data governance

Observability

GitHub & CI/CD

Communication

AI integration

Stakeholder engagement

Tools

Databricks Unity Catalog

Delta Lake

Workflow orchestration

AWS

Azure

GCP

Python

PySpark

GitHub

CI/CD

Job description

Red Ventures’ Home Client Services group seeks a Data Engineering Manager to lead a team of 2-4 data engineers building the data platform powering the home services business. You will translate business strategy into executable plans on a modern lakehouse stack and serve as a credible technical contact for clients and internal stakeholders.

You will coach engineers, own end-to-end platform delivery, enforce governance, and drive AI-forward practices while partnering with business teams to