Senior Databricks & Cloud Analytics Engineer

System One; Magna (UT); Hybrid; USD 120,000 - 180,000; Full time

Job summary

System One is seeking a Senior Data Engineer to design, build, and optimize enterprise data platforms and cloud analytics solutions from Salt Lake City. The role emphasizes hands-on work with Databricks, Spark, Python, SQL, and Scala to deliver scalable data pipelines.

You will manage Databricks ecosystem components, implement ETL/ELT with Azure Data Factory, and collaborate in Agile teams while mentoring junior engineers. Hybrid onsite/remote work offered.

Qualifications

• Bachelor's degree in CS/IS/Engineering or equivalent experience.
• 6+ years designing and supporting enterprise data platforms or cloud data solutions.
• Hands-on Databricks, Spark, Python, SQL, and Scala experience.
• Strong SQL development and query tuning.
• Experience with Azure Data Factory.
• Knowledge of Kafka or similar event streaming systems.
• Familiarity with Git, Linux, and scripting.
• Terraform and CI/CD (Azure DevOps, GitHub Actions).
• Experience in Agile methodologies.

Responsibilities

• Design and support enterprise data platforms and cloud analytics.
• Build scalable data pipelines with Databricks, PySpark, Python, SQL, and Scala.
• Manage Databricks components (Workspaces, Delta Lake, Unity Catalog, Delta Live Tables, Databricks SQL, MLflow, Databricks Jobs).
• Optimize SQL queries and performance through tuning.
• Design ETL/ELT using cloud platforms like Azure Data Factory.
• Work with Kafka and REST API integrations.
• Use ADLS Gen2 and other cloud storage.
• Collaborate in Linux environments with shell scripting and Git.
• Participate in Agile teams (Scrum/Kanban/SAFe).
• Provide technical mentoring and leadership within data engineering teams.

Skills

Databricks

Apache Spark

PySpark

Python

SQL

Scala

Git

Linux

Agile

Terraform

CI/CD

Education

Bachelor's degree in Computer Science, Information Systems, Engineering

Tools

Azure Data Factory

Kafka

Azure DevOps

GitHub Actions

Terraform

Azure Data Lake Storage

Job description

System One is seeking a Senior Data Engineer to design, build, and optimize enterprise data platforms and cloud analytics solutions from Salt Lake City. The role emphasizes hands-on work with Databricks, Spark, Python, SQL, and Scala to deliver scalable data pipelines.

You will manage Databricks ecosystem components, implement ETL/ELT with Azure Data Factory, and collaborate in Agile teams while mentoring junior engineers. Hybrid onsite/remote work offered.