Senior Azure Databricks Engineer: Scalable Data Pipelines

Cloud Analytics Technologies, LLC

Houston (TX)

On-site

USD 110,000 - 170,000

Full time

3 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Cloud Analytics Technologies, LLC seeks a Specialist with 7 years of experience in designing and developing scalable data solutions using AzureDatabricks. You will lead the design and optimization of data pipelines for enterprise‑level analytics, leveraging Azure Databricks with other Azure data services and ensuring data quality and reliability.

The role requires strong PySpark and Python coding skills, experience with ETL workflows, and collaboration across cross‑functional teams to align data

Qualifications

7 years of experience designing scalable data solutions on AzureDatabricks.
Hands‑on expertise in building data pipelines, ETL workflows and analytics.
Proficient in PySpark, Python and cloud data services; able to optimize performance and cost.

Responsibilities

Lead design, development and optimization of scalable datapipelines using AzureDatabricks.
Write clean PySpark and Python code for data ingestion, transformation, and analytics.
Troubleshoot pipelines, ensure high availability and data quality; collaborate with stakeholders.

Skills

Azure Databricks

PySpark

Python

Education

Bachelor's degree in a related field

Tools

Databricks

Job description

The role requires strong PySpark and Python coding skills, experience with ETL workflows, and collaboration across cross‑functional teams to align data

Get your free, confidential resume review.

or drag and drop your file here.