Azure Data Engineer

Quantum Technologies. LLC

Raleigh (NC)

On-site

USD 110,000 - 160,000

Full time

4 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Quantum Technologies. LLC in Raleigh, NC is seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based solutions using Microsoft Azure.

You will work with Azure Data Factory, Databricks, Synapse, and Purview to build robust data architectures, implement data governance, and optimize performance and cost. Strong SQL, PySpark, and Python skills are essential in delivering enterprise-wide data solutions.

Qualifications

  • Experience designing scalable data pipelines in Azure.
  • Strong SQL and data modeling skills.
  • Familiarity with lakehouse architectures and data governance.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL/ELT workflows with Azure Data Factory.
  • Develop data processing using Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for warehousing and analytics.
  • Write complex SQL queries and optimize performance.
  • Implement lakehouse architectures with Azure Data Lake Storage Gen2.
  • Integrate data from multiple sources and ensure data quality.
  • Develop batch and real-time data processing solutions.
  • Monitor, log, and handle errors; ensure security best practices.

Skills

Python
PySpark
SQL

Tools

Azure Data Factory
Azure Databricks
Azure Synapse Analytics
Microsoft Purview

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:

We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based data solutions using Microsoft Azure technologies. The ideal candidate should have strong expertise in data integration, ETL/ELT development, big data processing, and modern data architecture.

Key Responsibilities :
  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL/ELT workflows using Azure Data Factory.
  • Develop data processing solutions using Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for data warehousing and analytical workloads.
  • Develop complex SQL queries, stored procedures, and performance optimization strategies.
  • Implement data lake and lakehouse architectures using Azure Data Lake Storage Gen2.
  • Integrate data from multiple sources, including relational databases, APIs, and cloud platforms.
  • Implement data quality, validation, transformation, and governance processes.
  • Develop and maintain batch and real-time data processing solutions.
  • Optimize data pipelines for performance, scalability, and cost efficiency.
  • Implement monitoring, logging, and error-handling mechanisms.
  • Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.
  • Follow security best practices for data access, encryption, and compliance.
Required Technical Skills
  • Programming: Python, PySpark, SQL
  • Data Architecture: Lakehouse, Delta Lake, Medallion Architecture
  • Data Governance: Microsoft Purview

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer
Azure Data Engineer

Robotic Technologies Automation • Raleigh (NC)

On-site
USD 110,000 - 160,000
Azure Data Engineer
Azure Data Engineer

Valiant Technologies LLC • Raleigh (NC)

On-site
USD 110,000 - 150,000
Azure Data Engineer
Azure Data Engineer

Ethereum Technologies • Raleigh (NC)

On-site
USD 120,000 - 150,000
None
Azure Data Engineer
Azure Data Engineer

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 110,000 - 160,000
Azure Data Engineer
Azure Data Engineer

Ethereum Technologies LLC • Atlanta (GA)

On-site
USD 90,000 - 130,000
Azure Data Engineer
Azure Data Engineer

Quantum Technologies LLC • Atlanta (GA)

On-site
USD 120,000 - 150,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Quantum Technologies. LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Valiant Technologies LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Robotic Technologies Automation • Houston (TX)

On-site
USD 120,000 - 170,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Ethereum Technologies • Houston (TX)

On-site
USD 120,000 - 180,000