Azure Data Engineer: Create Scalable Data Pipelines

Quantum Technologies LLC

Raleigh (NC)

On-site

USD 110,000 - 160,000

Full time

25 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Quantum Technologies. LLC in Raleigh, NC is seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based solutions using Microsoft Azure.

You will work with Azure Data Factory, Databricks, Synapse, and Purview to build robust data architectures, implement data governance, and optimize performance and cost. Strong SQL, PySpark, and Python skills are essential in delivering enterprise-wide data solutions.

Qualifications

  • Experience designing scalable data pipelines in Azure.
  • Strong SQL and data modeling skills.
  • Familiarity with lakehouse architectures and data governance.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL/ELT workflows with Azure Data Factory.
  • Develop data processing using Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for warehousing and analytics.
  • Write complex SQL queries and optimize performance.
  • Implement lakehouse architectures with Azure Data Lake Storage Gen2.
  • Integrate data from multiple sources and ensure data quality.
  • Develop batch and real-time data processing solutions.
  • Monitor, log, and handle errors; ensure security best practices.

Skills

Python
PySpark
SQL

Tools

Azure Data Factory
Azure Databricks
Azure Synapse Analytics
Microsoft Purview

Job description

Quantum Technologies. LLC in Raleigh, NC is seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based solutions using Microsoft Azure.

You will work with Azure Data Factory, Databricks, Synapse, and Purview to build robust data architectures, implement data governance, and optimize performance and cost. Strong SQL, PySpark, and Python skills are essential in delivering enterprise-wide data solutions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer – ETL, Databricks & Data Lake Architect
Azure Data Engineer – ETL, Databricks & Data Lake Architect

Quantum Technologies. LLC • Atlanta (GA)

On-site
USD 120,000 - 150,000
Azure Data Engineer: Build Scalable Cloud Data Pipelines
Azure Data Engineer: Build Scalable Cloud Data Pipelines

Valiant Technologies LLC • Raleigh (NC)

On-site
USD 110,000 - 150,000
Azure Data Engineer — Pipelines, Databricks & Power BI
Azure Data Engineer — Pipelines, Databricks & Power BI

Quantum Technologies. LLC • Columbia Township (MO)

On-site
USD 90,000 - 130,000
Azure Data Engineer — Lead Data Pipelines & Databricks
Azure Data Engineer — Lead Data Pipelines & Databricks

Quantum Technologies LLC • Pennsylvania

On-site
USD 91,000 - 124,000
Azure Data Engineer: ETL, Databricks & Synapse
Azure Data Engineer: ETL, Databricks & Synapse

Quantum Technologies. LLC • Austin (TX)

On-site
USD 120,000 - 180,000
Azure Data Engineer — Pipelines, Data Lakes & Cloud ETL
Azure Data Engineer — Pipelines, Data Lakes & Cloud ETL

Quantum Technologies. LLC • Grand Rapids (MI)

On-site
USD 120,000 - 170,000
Senior Azure Data Engineer: Pipelines & Databricks
Senior Azure Data Engineer: Pipelines & Databricks

Quantum Technologies LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Cloud Data Engineer: Spark, Snowflake & Azure Pipelines
Cloud Data Engineer: Spark, Snowflake & Azure Pipelines

Quantum Technologies. LLC • San Jose (CA)

On-site
USD 120,000 - 180,000
Azure Data Engineer & Architect: Build Scalable Pipelines
Azure Data Engineer & Architect: Build Scalable Pipelines

Atyeti • Princeton (NJ)

On-site
USD 100,000 - 130,000
Azure Data Architect - Enterprise Data Strategy & Pipelines
Azure Data Architect - Enterprise Data Strategy & Pipelines

Quantum Technologies. LLC • Atlanta (GA)

On-site
USD 140,000 - 190,000