Senior Databricks Engineer — Remote Data Pipelines Lead

Concentrix; Des Moines (IA); Remote; USD 106,000 - 152,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) retirement plan

Paid time off and holidays

Paid learning days

Employee assistance program

Job summary

Concentrix is seeking a Senior Databricks Engineer to own end-to-end data pipelines and governance across cloud platforms. You will design, implement, and optimize batch and streaming processes using Databricks, PySpark, and SQL to support analytics, reporting, and AI/ML use cases.

Lead engineering standards, mentor peers, and collaborate with business stakeholders to deliver scalable data solutions on Azure, AWS, or GCP within a remote-friendly US footprint.

Qualifications

• 10+ years of professional experience in data engineering, analytics, or data warehousing.
• 5+ years with Databricks in data engineering.
• 3+ years on Azure including ADLS Gen2, Data Factory, Key Vault, Entra ID.

Responsibilities

• Design, develop, and maintain batch and streaming data pipelines.
• Automate data ingestion using Auto Loader and Azure services.
• Build scalable lakehouse data models and perform data transformations.

Skills

Databricks

Python

PySpark

SQL

Data engineering

Azure/AWS/GCP

Data governance

Tools

Lakeflow

Delta Live Tables

Unity Catalog

Azure Data Factory

GitHub Actions

Job description

Concentrix is seeking a Senior Databricks Engineer to own end-to-end data pipelines and governance across cloud platforms. You will design, implement, and optimize batch and streaming processes using Databricks, PySpark, and SQL to support analytics, reporting, and AI/ML use cases.

Lead engineering standards, mentor peers, and collaborate with business stakeholders to deliver scalable data solutions on Azure, AWS, or GCP within a remote-friendly US footprint.