Azure Data Engineer

Robotics Technologies

Raleigh (NC)

On-site

USD 110,000 - 150,000

Full time

22 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Robotics Technologies LLC is seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based data solutions using Microsoft Azure technologies. The role requires strong expertise in ETL/ELT, Databricks, Synapse, and governance.

You will build reliable data platforms, integrate diverse data sources, and optimize performance and costs while ensuring security and compliance.

Qualifications

  • Proficient in Python, PySpark and SQL.
  • Experience designing data pipelines and ETL/ELT in cloud.
  • Strong knowledge of data lakehouse architectures and governance.

Responsibilities

  • Design and maintain scalable data pipelines on Azure.
  • Develop ETL/ELT workflows with Azure Data Factory.
  • Build data processing with Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for warehousing and analytics.
  • Write optimized SQL queries and stored procedures.
  • Implement data lakehouse using Azure Data Lake Storage Gen2.
  • Integrate data from multiple sources and APIs.
  • Establish data quality, validation, and governance processes.
  • Support batch and real-time processing needs.
  • Optimize pipelines for performance, cost, and reliability.
  • Set up monitoring, logging, and error handling.
  • Collaborate with data architects, analysts, and stakeholders.
  • Adhere to security best practices for data access and compliance.

Skills

Python
PySpark
SQL

Tools

Lakehouse
Delta Lake
Medallion Architecture
Microsoft Purview

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:

We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based data solutions using Microsoft Azure technologies. The ideal candidate should have strong expertise in data integration, ETL/ELT development, big data processing, and modern data architecture.

Key Responsibilities :
  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL/ELT workflows using Azure Data Factory.
  • Develop data processing solutions using Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for data warehousing and analytical workloads.
  • Develop complex SQL queries, stored procedures, and performance optimization strategies.
  • Implement data lake and lakehouse architectures using Azure Data Lake Storage Gen2.
  • Integrate data from multiple sources, including relational databases, APIs, and cloud platforms.
  • Implement data quality, validation, transformation, and governance processes.
  • Develop and maintain batch and real-time data processing solutions.
  • Optimize data pipelines for performance, scalability, and cost efficiency.
  • Implement monitoring, logging, and error-handling mechanisms.
  • Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.
  • Follow security best practices for data access, encryption, and compliance.
Required Technical Skills
  • Programming: Python, PySpark, SQL
  • Data Architecture: Lakehouse, Delta Lake, Medallion Architecture
  • Data Governance: Microsoft Purview

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer
Azure Data Engineer

Quantum Technologies LLC • Raleigh (NC)

On-site
USD 110,000 - 160,000
Azure Data Engineer
Azure Data Engineer

Robotic Process Automation LLC • Raleigh (NC)

On-site
USD 110,000 - 160,000
Azure Data Engineer
Azure Data Engineer

Ethereum Technologies LLC • Raleigh (NC)

On-site
USD 120,000 - 150,000
None
Azure Data Engineer
Azure Data Engineer

Valiant Technologies LLC • Raleigh (NC)

On-site
USD 110,000 - 150,000
Azure Data Engineer
Azure Data Engineer

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 110,000 - 160,000
Azure Data Engineer
Azure Data Engineer

Quantum Technologies LLC • Atlanta (GA)

On-site
USD 120,000 - 150,000
Azure Data Engineer
Azure Data Engineer

Ethereum Technologies LLC • Atlanta (GA)

On-site
USD 90,000 - 130,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Robotic Process Automation LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Ethereum Technologies LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Valiant Technologies LLC • Houston (TX)

On-site
USD 120,000 - 170,000