Senior Databricks Engineer — Remote Data Pipelines

Concentrix Corporation; Town of Texas (WI); Hybrid; USD 92,000 - 120,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) retirement plan

Paid time off and holidays

Paid learning days

Job summary

Concentrix Corporation is seeking a Databricks Engineer to design and maintain data pipelines on the Databricks lakehouse platform across Azure, AWS, or GCP. You will leverage Python, PySpark, and SQL to ingest, transform, model, and orchestrate data workflows, delivering scalable data solutions with governance and CI/CD practices.

You will collaborate with cross‑functional teams to meet performance targets and business needs, while adhering to best practices for data quality and security in a

Qualifications

• 6+ years of professional experience in data engineering or data warehousing.
• 3+ years of hands‑on Databricks experience in a data engineering capacity.
• 3+ years of Python experience with PySpark and Spark SQL.
• 2+ years of data engineering on Microsoft Azure (ADLS Gen2, Data Factory).

Responsibilities

• Build and maintain batch and streaming data pipelines for ETL/ELT into the Databricks lakehouse on Azure.
• Implement data ingestion using Auto Loader, Lakeflow Connect, and Azure Data Factory.
• Develop pipelines with Lakeflow Spark Declarative Pipelines and data quality expectations.
• Perform data transformation with PySpark and Spark SQL for analytics readiness.
• Configure, schedule, and monitor data workflows with Lakeflow Jobs.
• Apply Unity Catalog permissions and governance standards to data assets.
• Write tests and deploy pipelines through CI/CD using Git folders.
• Collaborate with stakeholders to ensure data solutions meet business goals.

Skills

Python programming

SQL

PySpark

Data modeling

Education

Bachelor’s degree in computer science or related field

Tools

Databricks

Azure Data Factory

ADLS Gen2

Git

CI/CD

Delta Lake

Unity Catalog

Job description

Concentrix Corporation is seeking a Databricks Engineer to design and maintain data pipelines on the Databricks lakehouse platform across Azure, AWS, or GCP. You will leverage Python, PySpark, and SQL to ingest, transform, model, and orchestrate data workflows, delivering scalable data solutions with governance and CI/CD practices.

You will collaborate with cross‑functional teams to meet performance targets and business needs, while adhering to best practices for data quality and security in a