Azure Data Engineer: Spark-Powered Pipelines

Programmers.io; Dallas (TX); Hybrid; USD 90,000 - 120,000; Full time

Job summary

Programmers.io is seeking a Data Engineer in Dallas, TX or Charlotte, NC. The role emphasizes designing and building scalable data solutions using Azure and Apache Spark.

The ideal candidate will implement robust data pipelines and collaborate with stakeholders for business intelligence needs. Applicants are expected to have a strong technical background, particularly in Azure services, and experience with data governance tools.

Qualifications

• Strong hands-on experience with Microsoft Azure and Spark.
• Proficiency in Python and SQL is essential.
• Experience in designing data pipelines and understanding of data warehousing.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure services.
• Build and optimize Spark-based data processing applications.
• Implement ETL/ELT workflows for both batch and real-time data processing.

Skills

Azure

Apache Spark

Python

SQL

Data Warehousing

CI/CD

Tools

Azure Data Factory

Databricks

Power BI

Job description

Programmers.io is seeking a Data Engineer in Dallas, TX or Charlotte, NC. The role emphasizes designing and building scalable data solutions using Azure and Apache Spark.

The ideal candidate will implement robust data pipelines and collaborate with stakeholders for business intelligence needs. Applicants are expected to have a strong technical background, particularly in Azure services, and experience with data governance tools.