Sr. Azure Data Engineer (Remote)

Augmented Ally It Solutions; United States; Remote; USD 140,000 - 170,000; Full time

Job summary

Augmented Ally IT Solutions is seeking a Senior Azure Data Engineer for a remote role with an evening shift. You will design and optimize scalable data platforms using Azure Synapse, ADF, Databricks, and ADLS while collaborating with stakeholders in an Agile environment.

The ideal candidate has 5+ years of data engineering experience, strong Python, PySpark, and SQL skills, and a proven track record building data warehouses and lakehouses.

Qualifications

• 5+ years of data engineering and ETL/ELT experience.
• Proven Azure data ecosystem expertise.
• Experience with Azure Synapse, ADF, and Databricks.
• Strong Python, PySpark, and SQL skills.

Responsibilities

• Design and implement end-to-end data pipelines on Azure Synapse, ADF, and Databricks.
• Build scalable pipelines for batch and near real-time processing on Azure.
• Develop data transformations using PySpark, Spark SQL, and Python.
• Architect Azure-based data warehouses and lakehouses with ADLS.
• Ensure data quality, security, and performance across pipelines.
• Collaborate with stakeholders to translate business needs into data solutions.
• Apply best practices for cost-effective, enterprise-grade data platforms.
• Provide operational support and participate in Agile ceremonies.

Skills

PySpark

Spark SQL

Python

SQL

Azure Synapse Analytics

Azure Data Factory

Azure Databricks

Data Warehousing

Lakehouse Architecture

Agile/Scrum

Data Modeling

Tools

Azure DevOps

CI/CD pipelines

Power BI

Job description

Sr. Azure Data Engineer

Remote | Evening Shift

Experience: 5-10+ years

Job Overview

Augmented Ally IT Solutions India is seeking a skilled and experienced Senior Data Engineer with strong expertise in the Microsoft Azure data ecosystem. This role is ideal for a data engineering professional who excels in designing, building, and optimizing scalable data platforms using Azure Synapse Analytics, Azure Data Factory (ADF), and Azure Databricks. You will work closely with business and technology stakeholders in an Agile environment to deliver secure, high-performance, and data-driven enterprise solutions.

Key Responsibilities

• Design, develop, and implement end-to-end data engineering and ETL/ELT solutions using Azure Synapse Analytics, Azure Data Factory (ADF), and Azure Databricks.
• Build and maintain scalable data pipelines for batch and near real-time processing on Azure.
• Develop and optimize data transformations using PySpark, Spark SQL, and Python.
• Architect and manage Azure-based data warehouses and lakehouse solutions leveraging Azure Data Lake Storage (ADLS).
• Ensure data quality, reliability, security, and performance across data pipelines and analytical workloads.
• Collaborate with cross-functional teams to translate business requirements into technical data solutions.
• Apply Azure and data engineering best practices to design enterprise-grade, cost-effective solutions.
• Perform performance tuning, troubleshooting, and optimization of data pipelines and queries.
• Provide operational support for data platforms, ensuring system stability and timely issue resolution.
• Participate in Agile ceremonies and contribute to a culture of collaboration, continuous improvement, and knowledge sharing.

Required Qualifications

• Experience: 5+ years of experience in data engineering, ETL/ELT, and large-scale data platforms.
• Azure Expertise: Hands-on experience with:
• Azure Synapse Analytics (dedicated & serverless SQL pools)
• Azure Data Factory (ADF) for orchestration and pipeline development
• Azure Databricks for data processing and analytics
• Programming Skills: Strong proficiency in Python, PySpark, and SQL.
• Data Architecture: Solid understanding of data warehousing, lakehouse architectures, and enterprise data modeling.
• Cloud Knowledge: Experience designing and implementing secure, scalable solutions on Microsoft Azure.
• Agile Experience: Proven experience working in Agile/Scrum environments.
• Analytical Skills: Strong problem-solving abilities with attention to detail.
• Domain Knowledge: Experience in the Utility or Energy sector is a plus.
• Soft Skills: Excellent communication, stakeholder management, and collaboration skills.

Nice to Have

• Experience with Azure DevOps, CI/CD pipelines, and infrastructure-as-code.
• Knowledge of data governance, security, and compliance within Azure.
• Experience with Power BI or other Azure-integrated analytics tools