Senior Databricks Data Engineer — Pipeline & Lakehouse Lead

Concentrix CVG Customer Management Group Inc.; Town of Texas (WI); Hybrid; USD 106,000 - 140,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) retirement plan

Paid time off and holidays

Paid learning days

Job summary

Concentrix is seeking a Sr. Databricks Engineer to lead end-to-end data solutions on the Databricks platform across Azure, AWS, or GCP. You will design and optimize data pipelines, mentor engineers, and collaborate with stakeholders to deliver insights and AI-ready data products.

The role requires extensive experience with Python, PySpark, and Delta Lake, with emphasis on governance via Unity Catalog and scalable data modeling. Remote work from the US is supported under a full-time schedule.

Qualifications

• 10+ years of professional data engineering experience.
• 5+ years with Databricks in data engineering roles.
• 5+ years of Python experience (PySpark preferred).
• 3+ years of Azure data services experience.

Responsibilities

• Design, develop, and maintain batch and streaming pipelines on Databricks lakehouse.
• Automate data ingestion using Azure services and Lakeflow tooling.
• Build pipelines with Lakeflow and Databricks Workflows for reliability.
• Develop data models with medallion architecture and SCD handling.
• Govern data with Unity Catalog and implement security controls.
• Optimize performance and cost of Delta tables and Spark workloads.
• Lead CI/CD and testing for data pipelines and Databricks SQL queries.
• Mentor engineers and collaborate with stakeholders to meet goals.

Skills

Python

SQL

Databricks

Azure

PySpark

Delta Lake

Unity Catalog

CI/CD

Power BI

Education

Bachelor's degree in CS/IS/Data Engineering

Tools

Azure Data Factory

Event Hubs

Lakeflow

Databricks Lakehouse

Terraform

Job description

Concentrix is seeking a Sr. Databricks Engineer to lead end-to-end data solutions on the Databricks platform across Azure, AWS, or GCP. You will design and optimize data pipelines, mentor engineers, and collaborate with stakeholders to deliver insights and AI-ready data products.

The role requires extensive experience with Python, PySpark, and Delta Lake, with emphasis on governance via Unity Catalog and scalable data modeling. Remote work from the US is supported under a full-time schedule.