Databricks Data Engineer - End-to-End CDC Pipelines (Azure)

CRG

United States

On-site

USD 90,000 - 94,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

CRG is seeking a highly skilled Databricks Data Engineer to design, build, and optimize scalable data solutions within an Azure environment. You will implement end-to-end pipelines using Databricks, PySpark, and Kafka streaming, with a focus on CDC and real-time processing.

The role requires hands-on expertise to contribute immediately, collaborating with architects and product owners across Agile teams. You will drive data quality, performance, and scalability across diverse data sources.

Qualifications

  • Hands-on Databricks experience with day-one contribution.
  • End-to-end data pipelines with CDC capabilities.
  • Strong PySpark and SQL proficiency; Python a plus.

Responsibilities

  • Design, build, and optimize ETL/ELT pipelines using Databricks and PySpark.
  • Develop scalable data solutions on Azure with Delta Lake and Kafka streaming.
  • Implement CDC for incremental data processing and real-time needs.
  • Understand existing codebases to deliver improvements quickly.
  • Collaborate with architects, developers, and product owners in Agile/Scrum.
  • Automate workflows using Databricks Workflows and CI/CD (GitHub).

Skills

Databricks
PySpark
SQL
Python
Azure
CDC
Kafka

Tools

Delta Lake
Unity Catalog
GitHub

Job description

CRG is seeking a highly skilled Databricks Data Engineer to design, build, and optimize scalable data solutions within an Azure environment. You will implement end-to-end pipelines using Databricks, PySpark, and Kafka streaming, with a focus on CDC and real-time processing.

The role requires hands-on expertise to contribute immediately, collaborating with architects and product owners across Agile teams. You will drive data quality, performance, and scalability across diverse data sources.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Data Engineer - Azure, CDC Pipelines, PySpark
Databricks Data Engineer - Azure, CDC Pipelines, PySpark

CloudBigD • Phoenix (AZ)

On-site
USD 81,000 - 115,000
Databricks Data Engineer: Azure CDC Pipelines
Databricks Data Engineer: Azure CDC Pipelines

Valiant Technologies LLC • Phoenix (AZ)

On-site
USD 81,000 - 115,000
Azure Databricks Data Engineer - CDC & Spark Expert
Azure Databricks Data Engineer - CDC & Spark Expert

Quantum Technologies. LLC • Phoenix (AZ)

On-site
USD 81,000 - 115,000
Databricks Data Engineer
Databricks Data Engineer

CRG • United States

On-site
USD 90,000 - 94,000
Senior Data Engineer: Scalable Azure Databricks Pipelines
Senior Data Engineer: Scalable Azure Databricks Pipelines

Care Access • United States

Remote
USD 120,000 - 180,000
PTO
Medical insurance
Dental insurance
+7
Databricks Data Engineer
Databricks Data Engineer

CloudBigD • Phoenix (AZ)

On-site
USD 81,000 - 115,000
Databricks Data Engineer
Databricks Data Engineer

Quantum Technologies. LLC • Phoenix (AZ)

On-site
USD 81,000 - 115,000
Databricks Data Engineer
Databricks Data Engineer

Valiant Technologies LLC • Phoenix (AZ)

On-site
USD 81,000 - 115,000
Sr Azure Databricks Engineer
Sr Azure Databricks Engineer

ITMC Systems, Inc • United States

Remote
USD 140,000 - 190,000
Databricks Data Engineer: Pipelines, CI/CD & Production
Databricks Data Engineer: Pipelines, CI/CD & Production

Topcoder • California

On-site
USD 120,000 - 170,000