Senior Data Engineering Leader - AI Enablement & Lakehouse

Diligente Technologies; San Jose (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Diligente Technologies in San Jose, CA, seeks a Senior Manager, Data Engineering to lead a high-performing team and drive scalable cloud data platforms and AI-enabled analytics.

You will shape lakehouse architectures, DataOps, data governance, and robust data pipelines using Databricks, Snowflake, AWS Redshift and BigQuery, enabling data-driven decisions. This hands-on leadership role requires deep SQL and cloud data platform expertise plus strong cross-functional collaboration.

Qualifications

• 10+ years of experience in Data Engineering, Data Architecture, or related fields.
• 5+ years of experience leading and developing technical teams.
• Strong hands-on experience with SQL and modern cloud data platforms.

Responsibilities

• Architect and implement scalable cloud-based Lakehouse/Warehouse solutions.
• Design, optimize, and govern enterprise data models and semantic layers.
• Build and maintain high-performance batch and real-time data pipelines.
• Establish data quality frameworks, monitoring, and validation processes.
• Implement DataOps and CI/CD pipelines for automated deployments.
• Establish data governance including cataloging, lineage, and metadata management.
• Design strong data security and access controls.

Skills

Data Engineering

Data Architecture

SQL

Cloud Data Platforms

Databricks

Snowflake

AWS Redshift

BigQuery

ETL/ELT

DataOps

Data Modeling

Data Governance

Data Security

CI/CD

Leadership

Mentoring

Cross-functional Collaboration

Tools

Alteryx

Informatica

Job description

Diligente Technologies in San Jose, CA, seeks a Senior Manager, Data Engineering to lead a high-performing team and drive scalable cloud data platforms and AI-enabled analytics.

You will shape lakehouse architectures, DataOps, data governance, and robust data pipelines using Databricks, Snowflake, AWS Redshift and BigQuery, enabling data-driven decisions. This hands-on leadership role requires deep SQL and cloud data platform expertise plus strong cross-functional collaboration.