Senior Data Engineer - Databricks, Spark, Hybrid

Creative Solutions Services, LLC; Glendale (CA); On-site; USD 124,000 - 128,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

401(k) with company match

Short-term disability

Life insurance with AD&D

Job summary

Software Resources is seeking a Senior Data Engineer in Glendale, CA to design, build, and optimize scalable data solutions. You will own and operate the Core Data platform on Databricks, delivering reliable batch and streaming pipelines, governance, and cross-platform integrations across AWS, Kubernetes, and Airflow.

The role requires 5+ years in data engineering, deep Databricks/Spark experience, and strong Python/SQL skills.

Qualifications

• 5+ years of data engineering experience
• Deep hands-on Databricks and Apache Spark (batch and streaming)
• Proficiency with Python and SQL with performance tuning

Responsibilities

• Build and maintain batch and streaming data pipelines on Databricks
• Design, write, test, and deploy scalable data pipelines using PySpark/Scala/SQL
• Provide solution architecture across AWS, Databricks, Kubernetes, and Airflow
• Collaborate with stakeholders to gather requirements and translate them into scalable data solutions
• Maintain platform governance, security, and data quality
• Document platform changes and pipeline configurations

Skills

Databricks

Python

Terraform

AWS

Education

Bachelor's Degree in Computer Science or related field

Tools

Databricks tooling

Kubernetes

Job description

Software Resources is seeking a Senior Data Engineer in Glendale, CA to design, build, and optimize scalable data solutions. You will own and operate the Core Data platform on Databricks, delivering reliable batch and streaming pipelines, governance, and cross-platform integrations across AWS, Kubernetes, and Airflow.

The role requires 5+ years in data engineering, deep Databricks/Spark experience, and strong Python/SQL skills.