Lead Data Platform Engineer — Hybrid, Azure & Hadoop Expert

Mphasis; California; Hybrid; USD 63,000 - 135,000; Full time

Job summary

Mphasis in Ontario, CA is seeking an experienced Lead Data Platform Engineer to drive the design, build, and optimization of our enterprise data platform. You will lead technical strategy, guide engineering best practices, and collaborate with cross-functional teams to deliver scalable, secure data solutions across Hadoop, Hive, Spark, and Azure—including Databricks.

You will oversee architecture, develop pipelines with Azure Data services, enforce data governance, and mentor engineers.

Qualifications

• 8+ years of experience in data engineering or data platform roles, with 3+ years in a technical lead or architect capacity.

Responsibilities

• Lead the architecture, development, and enhancement of large-scale data platforms supporting analytics, machine learning, and operational workloads.
• Design and optimize big data solutions leveraging Hadoop ecosystem technologies (HDFS, Hive, Spark, Oozie, Ranger, Airflow).
• Develop and manage data pipelines and transformations using Azure Data services (Data Lake Storage, Data Factory, Synapse, Databricks).
• Implement and enforce robust data governance, security, and quality frameworks across all data layers.
• Partner with data engineering, analytics, product, and infrastructure teams to translate business needs into scalable designs.
• Drive performance tuning, capacity planning, and cost optimization across on-premise and cloud data platforms.
• Mentor and guide data engineers; establish engineering standards and best practices.
• Oversee CI/CD practices, deployment, and monitoring for data workflows.
• Evaluate emerging technologies and contribute to long-term platform strategy.

Skills

HDFS

Hive

Spark

Oozie

Ranger

Airflow

Python

SQL

Data modeling

DevOps

Tools

Azure Data Lake Storage

Azure Data Factory

Azure Synapse

Azure Functions

Key Vault

Databricks

Delta Lake

Unity Catalog

Job description

Mphasis in Ontario, CA is seeking an experienced Lead Data Platform Engineer to drive the design, build, and optimization of our enterprise data platform. You will lead technical strategy, guide engineering best practices, and collaborate with cross-functional teams to deliver scalable, secure data solutions across Hadoop, Hive, Spark, and Azure—including Databricks.

You will oversee architecture, develop pipelines with Azure Data services, enforce data governance, and mentor engineers.