Senior Databricks Data Engineer | Spark, Airflow, AWS

Staffingine LLC

Glendale (CA)

On-site

USD 120,000 - 180,000

Full time

8 days ago

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Staffingine LLC in Glendale, CA is seeking an experienced Data Engineer to design, build, and deploy robust data pipelines using PySpark, Scala, SQL, Python, and Databricks, with AWS and Kubernetes considerations. You will collaborate with engineers, product managers, and stakeholders, ensure data quality and governance, and participate in agile ceremonies to deliver scalable data platform solutions.

The role emphasizes hands-on pipeline development, platform administration, and cross-team

Qualifications

5+ years of data engineering experience building large-scale pipelines.
Deep hands-on Databricks and Spark (batch and streaming).
Strong SQL with performance tuning and Python proficiency.
Experience with Airflow MWAA and containerized deployments.
AWS-focused data platform knowledge and governance concepts.
Knowledge of Kubernetes, Docker, and data security/compliance.

Responsibilities

Design, write, test, and deploy data pipelines using PySpark, Scala, SQL, Python.
Collaborate with stakeholders to translate requirements into scalable solutions.
Governance: Unity Catalog, ACLs, data discovery, lineage, privacy tooling.
Maintain platform health, cost, and performance; monitor pipelines and logs.
Support CI/CD and DevOps practices for data workflows.
Explain Spark architecture to non-technical stakeholders.