Remote Databricks Platform Engineer

Concentrix; United States; Remote; USD 92,000 - 120,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401(k) retirement plan

Paid time off and holidays

Paid learning days

Job summary

Concentrix is seeking a Databricks Engineer to build and maintain data pipelines on the Databricks lakehouse across Azure, AWS, or GCP. You will use Python, PySpark, and SQL to ingest, transform, and orchestrate pipelines, working under the Senior Data Engineer guidance.

This remote US-based role requires 6+ years in data engineering and 3+ years with Databricks, plus Azure data services experience. Competitive salary, incentives, and comprehensive benefits are offered.

Qualifications

• 6+ years in data engineering, analytics, or data warehousing.
• 3+ years with Databricks in data engineering.
• 3+ years Python with PySpark, Spark SQL, or pandas API on Spark.
• 2+ years on Microsoft Azure (ADLS Gen2, Data Factory, Key Vault).

Responsibilities

• Build and maintain batch and streaming data pipelines for ETL/ELT into the Databricks lakehouse on Azure.
• Ingest data using Auto Loader, Lakeflow Connect, and Azure Data Factory.
• Develop pipelines with Lakeflow Spark Declarative Pipelines and data quality expectations.
• Transform data with PySpark and Spark SQL for analytics readiness.
• Configure, schedule, and monitor data workflows with Lakeflow Jobs.
• Apply governance with Unity Catalog and write CI/CD pipelines.

Skills

Python

SQL

Delta Lake

Unity Catalog

Git

CI/CD

Data testing

Education

Bachelor's degree in CS or related

Tools

Databricks

Azure Data Factory

Lakeflow

Lakeflow Declarative Pipelines

Job description

Concentrix is seeking a Databricks Engineer to build and maintain data pipelines on the Databricks lakehouse across Azure, AWS, or GCP. You will use Python, PySpark, and SQL to ingest, transform, and orchestrate pipelines, working under the Senior Data Engineer guidance.

This remote US-based role requires 6+ years in data engineering and 3+ years with Databricks, plus Azure data services experience. Competitive salary, incentives, and comprehensive benefits are offered.