Senior Databricks Data Engineer - Spark & AWS (Onsite)

Tavant; Glendale (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

Tavant in Glendale, CA seeks a Senior Data Engineer to own and operate the Core Data platform on Databricks, delivering reliable batch and streaming Spark pipelines and governance across AWS, Kubernetes, and Airflow.

You will collaborate with technologists to translate requirements into scalable data solutions, explain Spark architecture to stakeholders, and optimize data-driven decision-making processes. This role is onsite in Glendale with hybrid collaboration.

Qualifications

• Databricks experience required.
• Advanced SQL with performance tuning.
• Experience building and maintaining data pipelines and workflows.

Responsibilities

• Design, write, test, and deploy data pipelines using PySpark, Scala, SQL, Python.
• Meet with stakeholders to translate requirements into scalable data platform solutions.
• Understand Databricks platform and tooling to diagnose errors and automate updates.
• Explain Spark architecture and pipeline behavior to stakeholders.
• Provide solution architecture across AWS, Databricks, Kubernetes, and Airflow.

Skills

Databricks

SQL

Pipelines & workflows

Spark architecture

Communication

Education

Bachelor’s Degree in CS/IS or related

Tools

Databricks tooling

Airflow (MWAA)

AWS

Kubernetes

Docker

Snowflake

Job description

Tavant in Glendale, CA seeks a Senior Data Engineer to own and operate the Core Data platform on Databricks, delivering reliable batch and streaming Spark pipelines and governance across AWS, Kubernetes, and Airflow.

You will collaborate with technologists to translate requirements into scalable data solutions, explain Spark architecture to stakeholders, and optimize data-driven decision-making processes. This role is onsite in Glendale with hybrid collaboration.