Senior Databricks Engineer — Remote USA

Concentrix Corporation; Town of Texas (WI); Hybrid; USD 106,000 - 140,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401(k) retirement plan

Paid time off and holidays

Paid learning days

Job summary

Concentrix Corporation is seeking a Sr. Databricks Engineer to design and implement end-to-end data solutions on the Databricks platform.

You will drive data ingestion, transformation, and model delivery while guiding a team of data engineers, ensuring governance, performance, and cost optimization across cloud environments. The role requires deep expertise in Python, SQL, Delta Lake, and streaming architectures, with focus on enterprise-grade data solutions and CI/CD practices.

Qualifications

• We require 10+ years in data engineering, analytics, or warehousing.
• Minimum 5+ years working with Databricks in production workloads.
• 5+ years Python with PySpark, Spark SQL, or pandas API on Spark.
• 3+ years in Azure data services (ADLS Gen2, Data Factory, Key Vault).
• Strong SQL, data modeling, and governance skills using Unity Catalog.

Responsibilities

• Design, develop, and maintain batch and streaming pipelines on Databricks lakehouse.
• Lead engineering standards for pipelines and mentor junior engineers.
• orchestrate data workflows with Lakeflow/Databricks Workflows and CI/CD.
• Ensure data governance, security, and lineage in Unity Catalog.
• Optimize Delta tables, Spark workloads, and cost across compute options.
• Collaborate with business and IT to meet performance goals.

Skills

Python

SQL

Delta Lake

Spark

Unity Catalog

Structured Streaming

Auto Loader

Event Hubs / Kafka

CI/CD

Databricks

Education

Bachelor’s degree in Computer Science or related field

Tools

Databricks

Azure Data Factory

Terraform

Power BI

Job description

Concentrix Corporation is seeking a Sr. Databricks Engineer to design and implement end-to-end data solutions on the Databricks platform.

You will drive data ingestion, transformation, and model delivery while guiding a team of data engineers, ensuring governance, performance, and cost optimization across cloud environments. The role requires deep expertise in Python, SQL, Delta Lake, and streaming architectures, with focus on enterprise-grade data solutions and CI/CD practices.