Data Engineer & Platform Lead (Onsite) – Spark & Airflow

Ztek Consulting; Irvine (CA); On-site; USD 120,000 - 150,000; Full time

Job summary

Ztek Consulting in Irvine, CA is seeking an experienced data engineering lead to coordinate across onshore, nearshore, and offshore teams. The role focuses on building robust data platforms, tuning Spark workloads, and ensuring reliable workflow orchestration with Airflow/Astronomer.

You will drive CI/CD, IaC, and automation practices, manage platforms, and coordinate stakeholder expectations to deliver scalable data solutions on time.

Qualifications

• Strong experience with Databricks, Apache Spark, and performance tuning.
• Expertise in Apache Airflow/Astronomer for workflow orchestration and DAG design.
• Deep understanding of Data Engineering, ETL/ELT, and large-scale data platforms.
• Experience with CI/CD, DevOps, Infrastructure as Code (IaC), and automation.
• Strong platform management, monitoring, and incident management experience.
• Excellent leadership and stakeholder management skills.

Responsibilities

• This role requires coordination between onshore, nearshore, and offshore teams

Job description

Ztek Consulting in Irvine, CA is seeking an experienced data engineering lead to coordinate across onshore, nearshore, and offshore teams. The role focuses on building robust data platforms, tuning Spark workloads, and ensuring reliable workflow orchestration with Airflow/Astronomer.

You will drive CI/CD, IaC, and automation practices, manage platforms, and coordinate stakeholder expectations to deliver scalable data solutions on time.