Azure Data Engineer: Lakehouse & Real-Time Data Pipelines

Robotics Technologies

Raleigh (NC)

On-site

USD 89,000 - 126,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Robotics Technologies is seeking an Azure Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. You will focus on ETL/ELT, analytics-ready warehousing, lake and lakehouse architectures, governance, and operational monitoring for batch and real-time processing.

Responsibilities include designing pipelines with Azure Data Factory, developing processing solutions with PySpark and Databricks, leveraging Azure Synapse for analytics

Qualifications

  • Experience designing scalable data pipelines on Microsoft Azure.
  • Proficiency with Azure Data Factory, Databricks and Synapse for data warehousing and analytics.
  • Strong Python and SQL skills for data processing and governance.
  • Knowledge of data lake and lakehouse architectures (Delta Lake, Medallion) and related patterns.
  • Familiarity with DevOps practices (CI/CD) and data governance tools.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL/ELT workflows using Azure Data Factory.
  • Develop data processing solutions using Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for data warehousing and analytics workloads.
  • Create complex SQL queries and stored procedures, including performance tuning.
  • Implement data lake and lakehouse architectures using Azure Data Lake Storage Gen2.
  • Integrate data from multiple sources including databases, APIs, and cloud platforms.
  • Implement data quality, validation, transformation, and governance processes.
  • Develop and maintain batch and real-time data processing solutions.
  • Optimize pipelines for performance, scalability, and cost efficiency.
  • Establish monitoring, logging, and error-handling mechanisms.
  • Collaborate with data architects, analysts, and stakeholders to deliver data solutions.
  • Follow security best practices for data access, encryption, and compliance.

Tools

Azure Data Factory
Azure Databricks
PySpark
Azure Synapse Analytics
Azure Data Lake Storage Gen2
Python
SQL
Azure SQL Database
SQL Server
Lakehouse
Delta Lake
Medallion Architecture
Azure DevOps
Git
CI/CD
Microsoft Purview
Azure Event Hubs
Stream Analytics

Job description

Robotics Technologies is seeking an Azure Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. You will focus on ETL/ELT, analytics-ready warehousing, lake and lakehouse architectures, governance, and operational monitoring for batch and real-time processing.

Responsibilities include designing pipelines with Azure Data Factory, developing processing solutions with PySpark and Databricks, leveraging Azure Synapse for analytics

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer: Scalable Pipelines & Lakehouse
Azure Data Engineer: Scalable Pipelines & Lakehouse

Robotics Technologies • Raleigh (NC)

On-site
USD 110,000 - 150,000
Azure Data Engineer: Scale Data Pipelines & Lakehouse
Azure Data Engineer: Scale Data Pipelines & Lakehouse

Robotic Process Automation LLC • Raleigh (NC)

On-site
USD 110,000 - 160,000
Azure Databricks Data Engineer - Lakehouse & Pipelines
Azure Databricks Data Engineer - Lakehouse & Pipelines

Robotic Process Automation LLC • Dallas (TX)

On-site
USD 120,000 - 160,000
Azure Data Engineer: Build Scalable Pipelines & Lakehouse
Azure Data Engineer: Build Scalable Pipelines & Lakehouse

CloudBigD • Raleigh (NC)

On-site
USD 110,000 - 160,000
Azure Data Engineer
Azure Data Engineer

Robotics Technologies • Raleigh (NC)

On-site
USD 89,000 - 126,000
Azure Data Solutions Architect: Cloud Pipelines
Azure Data Solutions Architect: Cloud Pipelines

Robotic Technologies Automation • Jefferson City (MO)

On-site
USD 90,000 - 130,000
Azure Data Engineer: Streaming & Lakehouse
Azure Data Engineer: Streaming & Lakehouse

Robotic Process Automation LLC • Stamford (CT)

On-site
USD 77,000 - 110,000
Azure Data Engineer: Pipelines, Lakehouse & Synapse
Azure Data Engineer: Pipelines, Lakehouse & Synapse

Ethereum Technologies LLC • Raleigh (NC)

On-site
USD 120,000 - 150,000
None
Azure Data Engineer Lead: Pipelines, Databricks & Delta Lake
Azure Data Engineer Lead: Pipelines, Databricks & Delta Lake

Robotic Process Automation LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Azure Data Engineer: Streaming & Lakehouse (Stamford)
Azure Data Engineer: Streaming & Lakehouse (Stamford)

Robotics Technologies • Stamford (CT)

On-site
USD 140,000 - 170,000