Azure Data Engineer: Build Scalable Cloud Data Pipelines

Valiant Technologies LLC

Raleigh (NC)

On-site

USD 110,000 - 150,000

Full time

25 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Valiant Technologies LLC is seeking an experienced Azure Data Engineer in Raleigh, NC to design, develop, and maintain scalable data pipelines and cloud-based data solutions using Microsoft Azure technologies.

You will work with Azure Data Factory, Databricks, Synapse, and lakehouse architectures, applying strong SQL, Python, and PySpark skills while ensuring data quality and governance across data sources.

Qualifications

  • Experience designing scalable data pipelines on Azure.
  • Strong SQL, Python, and PySpark programming.
  • Familiarity with data governance and Purview.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL/ELT workflows with Azure Data Factory.
  • Develop data processing with Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for warehousing and analytics.
  • Develop complex SQL queries and stored procedures; optimize performance.
  • Implement data lake/lakehouse architectures with ADLS Gen2.
  • Integrate data from relational DBs, APIs, and cloud platforms.
  • Implement data quality, validation, transformation, and governance.
  • Develop batch and real-time data processing solutions.
  • Optimize pipelines for performance, scalability, cost.
  • Implement monitoring, logging, error-handling.
  • Collaborate with data architects, analysts, business stakeholders.
  • Follow security best practices for data access and encryption.

Skills

Python
PySpark
SQL

Tools

Lakehouse
Delta Lake
Medallion Architecture
Microsoft Purview

Job description

Valiant Technologies LLC is seeking an experienced Azure Data Engineer in Raleigh, NC to design, develop, and maintain scalable data pipelines and cloud-based data solutions using Microsoft Azure technologies.

You will work with Azure Data Factory, Databricks, Synapse, and lakehouse architectures, applying strong SQL, Python, and PySpark skills while ensuring data quality and governance across data sources.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer: Create Scalable Data Pipelines
Azure Data Engineer: Create Scalable Data Pipelines

Quantum Technologies LLC • Raleigh (NC)

On-site
USD 110,000 - 160,000
Azure Data Engineer — Build Scalable Cloud Data Pipelines
Azure Data Engineer — Build Scalable Cloud Data Pipelines

Valiant Technologies LLC • Dallas (TX)

On-site
USD 89,000 - 126,000
Azure Data Architect | Cloud Data Engineering Lead
Azure Data Architect | Cloud Data Engineering Lead

Valiant Technologies LLC • Minnesota

On-site
USD 120,000 - 150,000
Azure Data Engineer: ETL, Data Factory & Analytics
Azure Data Engineer: ETL, Data Factory & Analytics

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 110,000 - 160,000
Senior Azure Data Engineer: Pipelines, Databricks & SQL
Senior Azure Data Engineer: Pipelines, Databricks & SQL

Valiant Technologies LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Azure Data Engineer: Pipelines, Data Lakes & CDC
Azure Data Engineer: Pipelines, Data Lakes & CDC

Valiant Technologies LLC • Grand Rapids (MI)

On-site
USD 110,000 - 150,000
Azure Data Engineer: Cloud Data Pipelines & Spark Pro
Azure Data Engineer: Cloud Data Pipelines & Spark Pro

Valiant Technologies LLC • Austin (TX)

On-site
USD 110,000 - 160,000
Data Engineer - Cloud Pipelines, ETL & Data Warehousing
Data Engineer - Cloud Pipelines, ETL & Data Warehousing

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 110,000 - 160,000
Senior Data Analyst - Azure Data Platform & AI Insights
Senior Data Analyst - Azure Data Platform & AI Insights

Valiant Technologies LLC • Raleigh (NC)

On-site
USD 89,000 - 126,000
Azure Databricks Engineer - Scalable Data Pipelines & Lakehouse
Azure Databricks Engineer - Scalable Data Pipelines & Lakehouse

Valiant Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 170,000