Senior Data Engineering Leader — Lakehouse & AI Platforms

Lumentum Operations LLC; San Jose (CA); On-site; USD 134,750 - 192,500; Full time

Job summary

Lumentum Operations LLC in San Jose, CA, seeks a Senior Manager of Data Engineering to architect scalable cloud lakehouse/warehouse solutions and lead a team of data engineers. You will drive data models, quality, security, and governance while delivering real-time and batch data pipelines for AI, analytics, and automation workloads.

The role requires 10+ years in data engineering and 5+ years of leadership, with hands-on experience across Databricks, Snowflake, Redshift, and BigQuery.

Qualifications

• 10+ years of experience in data engineering, data architecture, or related fields.
• 5+ years leading and developing technical teams.
• Strong expertise in SQL, cloud data platforms, and distributed data processing frameworks.
• Hands-on experience with modern cloud data platforms and ETL/ELT tools.

Responsibilities

• Architect and implement scalable cloud-based lakehouse/warehouse solutions (Databricks/AWS).
• Design and optimize enterprise data models.
• Build and maintain high-performance batch and real-time data pipelines (ETL/ELT, streaming).
• Implement data quality frameworks and monitoring.
• Establish CI/CD pipelines and DataOps best practices for automated deployment.
• Implement data governance standards including cataloging, lineage, and metadata management.
• Design strong security controls and access management.
• Lead and mentor a team of data engineers, setting technical standards and best practices.

Skills

SQL

Data modeling

Data governance

Leadership

Cross-functional collaboration

Data quality

Tools

Databricks

Snowflake

Redshift

BigQuery

Alteryx

Informatica

Job description

Lumentum Operations LLC in San Jose, CA, seeks a Senior Manager of Data Engineering to architect scalable cloud lakehouse/warehouse solutions and lead a team of data engineers. You will drive data models, quality, security, and governance while delivering real-time and batch data pipelines for AI, analytics, and automation workloads.

The role requires 10+ years in data engineering and 5+ years of leadership, with hands-on experience across Databricks, Snowflake, Redshift, and BigQuery.