Senior Databricks Data Engineer – Scala & Spark (Onsite MA)

Themesoft Inc; Quincy (MA); On-site; USD 140,000 - 170,000; Full time

Job summary

The Data Engineer - Databricks, Scala role at Themesoft Inc. in Quincy, MA requires 8+ years of data engineering experience with Databricks and Spark. Onsite, 6-12+ month engagement, focusing on data pipelines, streaming, and warehouse-style data processing.

Deep hands-on knowledge of Scala, PySpark/SQL, and Databricks components is essential for building robust data workflows and optimizing performance.

Qualifications

• 8+ years of data engineering with Databricks and Spark.
• 8+ years in hands-on Databricks solutions using scala and spark.
• Experience with data pipelines, SQL and processing frameworks.

Responsibilities

• Provide data ingestion, streaming and transformation solutions using Databricks.
• Develop and optimize Spark jobs and data transformations.

Skills

Databricks

Scala

Spark

SQL

Data pipelines

ETL/ELT

Data warehousing

Tools

Azure

AKS

Docker

Kubernetes

Job description

The Data Engineer - Databricks, Scala role at Themesoft Inc. in Quincy, MA requires 8+ years of data engineering experience with Databricks and Spark. Onsite, 6-12+ month engagement, focusing on data pipelines, streaming, and warehouse-style data processing.

Deep hands-on knowledge of Scala, PySpark/SQL, and Databricks components is essential for building robust data workflows and optimizing performance.