Lead Data Engineer — Databricks & Data Warehousing

Tech Mirrors; San Jose (CA); On-site; USD 130,000 - 160,000; Full time

Job summary

Tech Mirrors is seeking a Lead Data Engineer to drive data architecture and pipeline development in San Jose, CA. The role involves optimizing data solutions using Databricks, Apache Spark, and Azure technologies and collaborating with stakeholders to meet analytical needs.

The ideal candidate will have over 8 years of experience in data engineering and require strong expertise in data warehousing solutions. This is an onsite contract position for a duration of 6+ months.

Qualifications

• 8+ years of experience in data engineering and big data processing.
• Strong expertise in Databricks, Spark (PySpark/SQL), and Delta Lake architecture.
• Proven experience in designing and managing data warehouses.

Responsibilities

• Design, build, and optimize scalable data pipelines using Databricks and Apache Spark.
• Architect data warehousing solutions for cloud platforms.
• Collaborate to understand data needs and develop analytical solutions.

Skills

Databricks

Data Warehousing

Apache Spark

Azure Data Factory

Snowflake

SQL

Kafka

Job description

Tech Mirrors is seeking a Lead Data Engineer to drive data architecture and pipeline development in San Jose, CA. The role involves optimizing data solutions using Databricks, Apache Spark, and Azure technologies and collaborating with stakeholders to meet analytical needs.

The ideal candidate will have over 8 years of experience in data engineering and require strong expertise in data warehousing solutions. This is an onsite contract position for a duration of 6+ months.