Lead Data Engineer – Databricks Lakehouse, Unlimited PTO

V4C.ai; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Unlimited PTO

Health Care Plan (Medical, Dental &amp

Vision

Retirement Plan (401k, IRA)

Life Insurance (Basic, Voluntary & AD&

AD&D

Family Leave (Maternity, Paternity)

Short Term & Long Term Disability

Training & Development

Job summary

V4C is seeking a Lead Data Engineer to drive production Lakehouse pipelines on customer engagements, partnering with Databricks field teams. You will own a workstream, guide design decisions, and ensure high-quality data products across batch and streaming workloads.

Seven-plus years in data engineering with leadership, deep Python/SQL/Spark/Delta Lake skills, and hands-on experience with AWS/Azure/GCP are required. Strong client communication and cost-aware optimization are essential.

Qualifications

• 7+ years of data engineering with leadership experience.
• Proficiency in Python, SQL, Spark, and Delta Lake.
• Experience with cloud data platforms (AWS/Azure/GCP).

Responsibilities

• Lead engineering on customer engagements from design through production handover.
• Build and optimize batch and streaming pipelines using PySpark, SQL, and Delta Lake on Databricks.
• Implement Medallion architecture across cloud ecosystems and set layer conventions.
• Own performance and cost: benchmark Spark jobs, tune SQL, right-size compute.
• Implement data quality and validation as code, including Lakeflow expectations and CI testing.
• Mentor mid-level and junior engineers through code reviews and design feedback.
• Collaborate with Data Architect on design decisions and escalate issues.

Skills

Python

SQL

Apache Spark

Delta Lake

Databricks

AWS

Azure

GCP

CI/CD

Git

Data modeling

Client communication

Tools

Databricks

dbt

Airflow

Unity Catalog

Lakeflow

Job description

V4C is seeking a Lead Data Engineer to drive production Lakehouse pipelines on customer engagements, partnering with Databricks field teams. You will own a workstream, guide design decisions, and ensure high-quality data products across batch and streaming workloads.

Seven-plus years in data engineering with leadership, deep Python/SQL/Spark/Delta Lake skills, and hands-on experience with AWS/Azure/GCP are required. Strong client communication and cost-aware optimization are essential.