Azure Data Engineer

Tech3pillars Technologies; Alaska; On-site; USD 110,000 - 170,000; Full time

Job summary

Tech3pillars Technologies in Atlanta, GA is seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data processing and analytics solutions in Azure.

You will work with Azure Synapse, Spark, PySpark, and Data Lake architectures, and support Fabric integrations across development and production environments. Strong communication and teamwork are essential in this onsite role.

Qualifications

• Experience with Azure Synapse Analytics and Microsoft Fabric exposure.
• Deep knowledge of Spark architecture and distributed processing concepts.
• Strong Data Lake design experience including Medallion Architecture (Bronze/Silver/Gold).
• Hands-on PySpark and Spark SQL for data transformation and processing.
• Excellent communication and collaboration across cross-functional teams.
• Adaptable to Dev and Production support models and diverse environments.

Responsibilities

• Design, develop, and maintain scalable data engineering pipelines and solutions using Azure services.
• Work with Azure Synapse Analytics for data processing, analytics, and warehousing.
• Develop data transformations using PySpark and Spark SQL.
• Apply deep knowledge of Spark architecture for large-scale processing.
• Design Data Lake architectures with Bronze, Silver, and Gold layers.
• Support Fabric-based data solutions integration across environments.

Skills

Azure Synapse

Spark architecture

Data Lake design

Medallion Architecture

PySpark

Spark SQL

Fabric exposure

Data pipelines

Communication

Cross-functional

Job description

Job Title:

Azure Data Engineer

Location:

Atlanta, GA (onsite)

Job Summary

We are seeking an experienced Azure Data Engineer with strong hands-on expertise in Azure Synapse Analytics, Apache Spark, PySpark, Spark SQL, and Data Lake architecture. The ideal candidate will be responsible for designing, developing, optimizing, and supporting scalable data processing and analytics solutions in Azure environments.

The candidate should have a good understanding or exposure to Microsoft Fabric and be comfortable working across development and production support environments.

Key Responsibilities

• Design, develop, and maintain scalable data engineering pipelines and solutions using Azure services.
• Work extensively with Azure Synapse Analytics for data processing, analytics, and data warehousing.
• Develop data transformation and processing solutions using PySpark and Spark SQL.
• Apply strong knowledge of Apache Spark architecture, distributed computing, and large-scale data processing.
• Design and implement Data Lake architectures, including the Medallion Architecture (Bronze, Silver, and Gold layers).
• Work with Microsoft Fabric and support the adoption or integration of Fabric-based data solutions.

Key Skills & Experience:

• Strong hands-on experience with Azure Synapse Analytics, along with a good understanding or exposure to Microsoft Fabric
• Deep understanding of Apache Spark architecture and distributed data processing concepts
• Strong knowledge of Data Lake architecture, including Medallion Architecture
• Hands-on experience in PySpark and Spark SQL for data transformation and processing
• Solid communication skills with the ability to work effectively with cross-functional teams
• Strong problem-solving and troubleshooting skills in data engineering environments
• Should have worked in diverse environment with IT/Business/ Onsite offshore Model and also need to easily adapt on Development and Support models.