Data Engineering Manager: Lakehouse & Databricks Lead

Ledgent Technology; San Diego (CA); On-site; USD 162,000 - 198,000; Full time

Job summary

Ledgent Technology seeks a senior leader to oversee a Data Engineering and Tech Lead team, delivering enterprise-scale data initiatives. The role focuses on architecture decisions, Databricks/Spark pipelines, and cloud data platforms, with mentoring responsibilities and cross-unit coordination.

This is a leadership role rather than a hands-on IC position, requiring strategic delivery across multiple business units and stakeholder alignment in a modern Lakehouse environment.

Qualifications

• 10+ years' experience managing Data Engineering and leading Technology Teams.
• 7+ years with SQL Server and cloud/on-prem data ecosystems.
• 7+ years with cloud-native data platforms (GCP, Azure, AWS) with data warehouses (BigQuery, Snowflake, Databricks).
• Expertise in Databricks and the Spark ecosystem, PySpark pipelines and modern data architecture.
• Advanced Python and PySpark, strong SQL, and modern ELT/ETL tools.

Responsibilities

• Lead a team of about 10-13 Data Engineers and Tech Leads; own delivery of enterprise-scale data initiatives.
• Make technical decisions, guide architecture, remove roadblocks, and mentor engineers.
• Ensure projects are delivered successfully across multiple business units.

Skills

Data leadership

Databricks

PySpark

SQL Server

Cloud platforms

Python

BigQuery

Snowflake

ETL tools

Education

Bachelor's degree in computer science, MIS or related degree

Tools

Databricks

Spark

Job description

Ledgent Technology seeks a senior leader to oversee a Data Engineering and Tech Lead team, delivering enterprise-scale data initiatives. The role focuses on architecture decisions, Databricks/Spark pipelines, and cloud data platforms, with mentoring responsibilities and cross-unit coordination.

This is a leadership role rather than a hands-on IC position, requiring strategic delivery across multiple business units and stakeholder alignment in a modern Lakehouse environment.