Azure Data Engineer

Robotics Technologies

Raleigh (NC)

On-site

USD 89,000 - 126,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Robotics Technologies is seeking an Azure Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. You will focus on ETL/ELT, analytics-ready warehousing, lake and lakehouse architectures, governance, and operational monitoring for batch and real-time processing.

Responsibilities include designing pipelines with Azure Data Factory, developing processing solutions with PySpark and Databricks, leveraging Azure Synapse for analytics

Qualifications

  • Experience designing scalable data pipelines on Microsoft Azure.
  • Proficiency with Azure Data Factory, Databricks and Synapse for data warehousing and analytics.
  • Strong Python and SQL skills for data processing and governance.
  • Knowledge of data lake and lakehouse architectures (Delta Lake, Medallion) and related patterns.
  • Familiarity with DevOps practices (CI/CD) and data governance tools.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL/ELT workflows using Azure Data Factory.
  • Develop data processing solutions using Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for data warehousing and analytics workloads.
  • Create complex SQL queries and stored procedures, including performance tuning.
  • Implement data lake and lakehouse architectures using Azure Data Lake Storage Gen2.
  • Integrate data from multiple sources including databases, APIs, and cloud platforms.
  • Implement data quality, validation, transformation, and governance processes.
  • Develop and maintain batch and real-time data processing solutions.
  • Optimize pipelines for performance, scalability, and cost efficiency.
  • Establish monitoring, logging, and error-handling mechanisms.
  • Collaborate with data architects, analysts, and stakeholders to deliver data solutions.
  • Follow security best practices for data access, encryption, and compliance.

Tools

Azure Data Factory
Azure Databricks
PySpark
Azure Synapse Analytics
Azure Data Lake Storage Gen2
Python
SQL
Azure SQL Database
SQL Server
Lakehouse
Delta Lake
Medallion Architecture
Azure DevOps
Git
CI/CD
Microsoft Purview
Azure Event Hubs
Stream Analytics

Job description

Robotics Technologies is seeking an Azure Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. The role focuses on ETL/ELT, analytics-ready warehousing, lake and lakehouse architectures, governance, and operational monitoring for batch and real-time processing.

Responsibilities
  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL/ELT workflows using Azure Data Factory.
  • Develop data processing solutions using Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for data warehousing and analytical workloads.
  • Create complex SQL queries and stored procedures, including performance optimization.
  • Implement data lake and lakehouse architectures using Azure Data Lake Storage Gen2.
  • Integrate data from multiple sources, including relational databases, APIs, and cloud platforms.
  • Implement data quality, validation, transformation, and governance processes.
  • Develop and maintain batch and real-time data processing solutions.
  • Optimize pipelines for performance, scalability, and cost efficiency.
  • Implement monitoring, logging, and error-handling mechanisms.
  • Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.
  • Follow security best practices for data access, encryption, and compliance.
Requirements
  • Cloud Platform: Microsoft Azure
  • Data Integration: Azure Data Factory (ADF)
  • Big Data: Azure Databricks, Apache Spark, PySpark
  • Data Warehousing: Azure Synapse Analytics
  • Storage: Azure Data Lake Storage Gen2
  • Programming: Python, PySpark, SQL
  • Databases: Azure SQL Database, SQL Server
  • Data Architecture: Lakehouse, Delta Lake, Medallion Architecture
  • DevOps: Azure DevOps, Git, CI/CD
  • Data Governance: Microsoft Purview
  • Streaming: Azure Event Hubs, Stream Analytics
Additional Details

Location: Raleigh, NC (onsite)

Compensation: USD 78 per hour

Core Technologies: Microsoft Azure, Azure Data Factory (ADF), Azure Databricks, Apache Spark, PySpark, Azure Synapse Analytics, Azure Data Lake Storage Gen2, Python, SQL, Azure SQL Database, SQL Server, Lakehouse, Delta Lake, Medallion Architecture, Azure DevOps, Git, CI/CD, Microsoft Purview, Azure Event Hubs, Stream Analytics

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer
Azure Data Engineer

Robotics Technologies • Cupertino (CA)

On-site
USD 94,000 - 134,000
Data Engineer – Databricks & ADF (ETL)
Data Engineer – Databricks & ADF (ETL)

Robotics Technologies • Dallas (TX)

On-site
USD 91,000 - 124,000
Azure Data Engineer: Lakehouse & Real-Time Data Pipelines
Azure Data Engineer: Lakehouse & Real-Time Data Pipelines

Robotics Technologies • Raleigh (NC)

On-site
USD 89,000 - 126,000
Data Engineer
Data Engineer

Robotics Technologies • San Jose (CA)

On-site
USD 120,000 - 180,000
Azure Data Engineer: Scalable Pipelines & Lakehouse
Azure Data Engineer: Scalable Pipelines & Lakehouse

Robotics Technologies • Raleigh (NC)

On-site
USD 110,000 - 150,000
Azure Data Engineer - Cloud Analytics & DevOps
Azure Data Engineer - Cloud Analytics & DevOps

Robotics Technologies LLC • Sunnyvale (CA)

On-site
USD 74,000 - 105,000
Azure Data Engineer
Azure Data Engineer

Quantum Technologies LLC • Raleigh (NC)

On-site
USD 110,000 - 160,000
Azure Data Engineer
Azure Data Engineer

Robotic Process Automation LLC • Raleigh (NC)

On-site
USD 110,000 - 160,000
Azure Data Engineer
Azure Data Engineer

Valiant Technologies LLC • Raleigh (NC)

On-site
USD 110,000 - 150,000
Azure Data Engineer
Azure Data Engineer

CloudBigD • Raleigh (NC)

On-site
USD 110,000 - 160,000