Azure Data Engineer

Valiant Technologies LLC

Raleigh (NC)

On-site

USD 110,000 - 150,000

Full time

5 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Valiant Technologies LLC is seeking an experienced Azure Data Engineer in Raleigh, NC to design, develop, and maintain scalable data pipelines and cloud-based data solutions using Microsoft Azure technologies.

You will work with Azure Data Factory, Databricks, Synapse, and lakehouse architectures, applying strong SQL, Python, and PySpark skills while ensuring data quality and governance across data sources.

Qualifications

  • Experience designing scalable data pipelines on Azure.
  • Strong SQL, Python, and PySpark programming.
  • Familiarity with data governance and Purview.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL/ELT workflows with Azure Data Factory.
  • Develop data processing with Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for warehousing and analytics.
  • Develop complex SQL queries and stored procedures; optimize performance.
  • Implement data lake/lakehouse architectures with ADLS Gen2.
  • Integrate data from relational DBs, APIs, and cloud platforms.
  • Implement data quality, validation, transformation, and governance.
  • Develop batch and real-time data processing solutions.
  • Optimize pipelines for performance, scalability, cost.
  • Implement monitoring, logging, error-handling.
  • Collaborate with data architects, analysts, business stakeholders.
  • Follow security best practices for data access and encryption.

Skills

Python
PySpark
SQL

Tools

Lakehouse
Delta Lake
Medallion Architecture
Microsoft Purview

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:

We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based data solutions using Microsoft Azure technologies. The ideal candidate should have strong expertise in data integration, ETL/ELT development, big data processing, and modern data architecture.

Key Responsibilities :
  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL/ELT workflows using Azure Data Factory.
  • Develop data processing solutions using Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for data warehousing and analytical workloads.
  • Develop complex SQL queries, stored procedures, and performance optimization strategies.
  • Implement data lake and lakehouse architectures using Azure Data Lake Storage Gen2.
  • Integrate data from multiple sources, including relational databases, APIs, and cloud platforms.
  • Implement data quality, validation, transformation, and governance processes.
  • Develop and maintain batch and real-time data processing solutions.
  • Optimize data pipelines for performance, scalability, and cost efficiency.
  • Implement monitoring, logging, and error-handling mechanisms.
  • Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.
  • Follow security best practices for data access, encryption, and compliance.
Required Technical Skills
  • Programming: Python, PySpark, SQL
  • Data Architecture: Lakehouse, Delta Lake, Medallion Architecture
  • Data Governance: Microsoft Purview

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer
Azure Data Engineer

Robotic Technologies Automation • Raleigh (NC)

On-site
USD 110,000 - 160,000
Azure Data Engineer
Azure Data Engineer

Quantum Technologies. LLC • Raleigh (NC)

On-site
USD 110,000 - 160,000
Azure Data Engineer
Azure Data Engineer

Ethereum Technologies • Raleigh (NC)

On-site
USD 120,000 - 150,000
None
Azure Data Engineer
Azure Data Engineer

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 110,000 - 160,000
Azure Data Engineer
Azure Data Engineer

Ethereum Technologies LLC • Atlanta (GA)

On-site
USD 90,000 - 130,000
Azure Data Engineer
Azure Data Engineer

Quantum Technologies LLC • Atlanta (GA)

On-site
USD 120,000 - 150,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Quantum Technologies. LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Valiant Technologies LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Robotic Technologies Automation • Houston (TX)

On-site
USD 120,000 - 170,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Ethereum Technologies • Houston (TX)

On-site
USD 120,000 - 180,000