Senior Data Engineer – Databricks & Cloud Analytics Expert

System One; Salt Lake City (UT); Hybrid; USD 140,000 - 190,000; Full time

Job summary

System One in Salt Lake City, Utah, is seeking a Senior Data Engineer to design and implement enterprise data platforms and cloud analytics solutions. You will work with Databricks, Spark, Python, SQL, and Scala to build scalable pipelines in a hybrid on-site/remote environment.

This role involves managing Databricks components, optimizing queries, and designing ETL/ELT processes on Azure Data Factory, while collaborating in Agile teams and mentoring data engineering members.

Qualifications

• Bachelor's degree or equivalent professional experience.
• 6+ years designing and supporting enterprise data platforms or cloud data solutions.
• Hands-on with Databricks, Spark, Python, SQL, and Scala.
• Strong SQL development and performance tuning.
• ETL/ELT design on Azure Data Factory.
• Knowledge of Kafka or similar event streaming systems.
• Familiarity with cloud data storage (ADLS Gen2).
• Git version control proficiency; Linux scripting.
• Experience with Agile methodologies; mentoring.

Responsibilities

• Design, develop, and support enterprise data platforms and cloud analytics.
• Build scalable data pipelines using Databricks, Spark, Python, SQL, and Scala.
• Manage Databricks components: Workspaces, Delta Lake, Unity Catalog, Delta Live Tables, Databricks SQL, MLflow, Jobs.
• Optimize SQL queries and tune performance.
• Design ETL/ELT processes on Azure Data Factory.
• Work with Kafka and REST APIs for data integration.
• Use ADLS Gen2 and other cloud storage; collaborate in Linux environments.
• Use Git for version control; participate in Agile teams.
• Provide mentoring and leadership within data engineering teams.

Skills

Databricks

Apache Spark

Python

SQL

Scala

Agile

Mentoring

Git

Linux

Terraform

Azure DevOps

GitHub Actions

Delta Lake

Delta Live Tables

Kafka

Azure Data Factory

ADLS Gen2

Education

Bachelor's degree or equivalent experience

Tools

Databricks

Apache Spark

Python

SQL

Scala

Azure Data Factory

Kafka

Git

Linux

Terraform

Azure DevOps

GitHub Actions

Delta Lake

Delta Live Tables

ADLS Gen2

Job description

System One in Salt Lake City, Utah, is seeking a Senior Data Engineer to design and implement enterprise data platforms and cloud analytics solutions. You will work with Databricks, Spark, Python, SQL, and Scala to build scalable pipelines in a hybrid on-site/remote environment.

This role involves managing Databricks components, optimizing queries, and designing ETL/ELT processes on Azure Data Factory, while collaborating in Agile teams and mentoring data engineering members.