Senior Data Engineer: Databricks & Spark, Hybrid CA

Software Resources, Inc.; Glendale (CA); Hybrid; USD 124,000 - 128,000; Full time

Benefits offered by this job

Medical, dental, vision

401(k) with company match

Short-term disability

Life insurance with AD&D

Job summary

Software Resources, Inc. seeks a Senior Data Engineer to design, build, and operate scalable data solutions in a hybrid Glendale, CA setting. You will own the Core Data platform, deliver batch and streaming Spark pipelines, and enable governance across AWS, Kubernetes, and Airflow.

You will develop pipelines with PySpark, Scala, SQL, Python, and Kotlin, while ensuring reliability, cost awareness, and cross-team collaboration. This 12+ month role offers impactful work in a data-driven environment.

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, or related field, or equivalent experience.
• 5+ years of data engineering experience and hands-on Databricks and Apache Spark.
• Experience with Databricks governance, Unity Catalog, ACLs, lineage, and auditing tooling.
• Strong Python development and SQL performance tuning abilities.
• Experience with CI/CD and DevOps practices using Git-based workflows.

Responsibilities

• Design, build, and optimize batch and streaming data pipelines using PySpark/Scala/SQL.
• Manage Databricks platform governance and Unity Catalog.
• Collaborate with stakeholders to translate requirements into scalable data platform solutions.
• Ensure platform reliability through monitoring, automation, and cost awareness.
• Provide solution architecture across AWS, Databricks, Kubernetes, and Airflow.

Skills

Advanced Python

Databricks governance

Spark architecture

SQL

Architecture discussions

Education

Bachelor’s in CS/IT or related

Master’s degree a plus

Tools

Terraform

Airflow MWAA

Docker

Kubernetes

AWS

Git-based workflows

Job description

Software Resources, Inc. seeks a Senior Data Engineer to design, build, and operate scalable data solutions in a hybrid Glendale, CA setting. You will own the Core Data platform, deliver batch and streaming Spark pipelines, and enable governance across AWS, Kubernetes, and Airflow.

You will develop pipelines with PySpark, Scala, SQL, Python, and Kotlin, while ensuring reliability, cost awareness, and cross-team collaboration. This 12+ month role offers impactful work in a data-driven environment.