Senior Data Engineer — Databricks & Cloud Analytics

Smith Johnson Group; Reno (NV); On-site; USD 120,000 - 180,000; Full time

Job summary

Smith Johnson Group is seeking a Senior Data Engineer to design, build and support secure, scalable enterprise data platforms using cloud and big data technologies. You’ll leverage Databricks, Apache Spark, Delta Lake, Azure Data Factory and Kafka to deliver high-performance data pipelines, analytics, and AI-ready data models within an Agile, collaborative environment.

The role emphasizes mentorship, continuous improvement, and partnership with architects, product owners, and clients to

Qualifications

• Bachelor's degree in CS, IS, Engineering, or related field
• 6+ years designing, developing, and supporting enterprise data platforms or cloud analytics solutions
• Hands-on with Databricks, Spark, Python, SQL, and Scala
• Experience with ETL/ELT design on Azure cloud or comparable platforms
• Experience with Kafka, ADLS Gen2, and REST APIs or data integration tools

Responsibilities

• Design, develop, test, deploy, and maintain enterprise data engineering solutions using modern cloud and big data technologies
• Design and implement scalable ETL/ELT pipelines utilizing Databricks, Apache Spark (PySpark), Delta Lake, and Azure Data Factory
• Build high-performance data ingestion, transformation, and integration frameworks supporting enterprise analytics and reporting
• Develop, optimize, and maintain complex SQL queries, stored procedures, and data transformation processes
• Design and implement scalable data models supporting BI, analytics, and AI initiatives
• Build and integrate RESTful APIs, event-driven architectures, and legacy SOAP services to facilitate data exchange
• Develop and maintain streaming and messaging solutions using Apache Kafka
• Monitor, troubleshoot, and optimize production data pipelines; perform root cause analysis and long-term improvements
• Implement data quality, governance, security, and performance best practices across platforms
• Collaborate with Solution Architects, Product Owners, Business Analysts, and cross-functional teams to translate requirements into technical solutions
• Participate in Agile ceremonies and produce technical docs, deployment artifacts, runbooks
• Mentor junior engineers and contribute to engineering standards and best practices

Skills

Databricks

Apache Spark (PySpark)

Python

SQL

Scala

Education

Bachelor's degree in Computer Science/Information Systems/Engineering or related field

Tools

Azure Data Factory

Azure Data Lake Storage (ADLS Gen2)

Kafka

Delta Lake

Databricks Unity Catalog

MLflow

Git

Linux

Job description

Smith Johnson Group is seeking a Senior Data Engineer to design, build and support secure, scalable enterprise data platforms using cloud and big data technologies. You’ll leverage Databricks, Apache Spark, Delta Lake, Azure Data Factory and Kafka to deliver high-performance data pipelines, analytics, and AI-ready data models within an Agile, collaborative environment.

The role emphasizes mentorship, continuous improvement, and partnership with architects, product owners, and clients to