Azure Data Engineer (ADF, Synapse, SQL/Python)

EPAM Systems; Kuala Lumpur; Presencial; MYR 120 000 - 180 000; Tempo integral

Resumo da oferta

EPAM Systems is seeking an Azure Data Engineer to build and optimize scalable data pipelines using Azure Data Factory and Azure Synapse. You will leverage SQL and Python to transform complex datasets, design analytics-ready data models, and orchestrate automated workflows.

You will partner with business teams to deliver high-quality, trusted reporting solutions, and mentor junior engineers while contributing to team knowledge sharing and best practices.

Qualificações

• Experience with Azure Data Factory for building, scheduling and monitoring pipelines.
• Experience with Azure Synapse for data integration and analytics workloads.
• ETL/ELT background including ingestion, transformation and incremental processing.
• Strong SQL skills for data transformation, validation and performance tuning.
• Python skills for data processing and automation.
• Knowledge of dimensional data modeling and Lakehouse concepts.
• Proficient in English communication.

Responsabilidades

• Develop, maintain and support ETL/ELT solutions.
• Build and optimize data ingestion and transformation pipelines using Azure Data Factory and Azure Synapse.
• Design and implement data models to support analytics and reporting use cases.
• Use SQL and Python to transform, validate and analyze large datasets.
• Orchestrate workflows, scheduling and monitoring to ensure reliable pipeline execution.
• Apply best practices across development, testing and deployment.
• Create and maintain technical documentation.
• Mentor junior engineers and contribute to team knowledge sharing.

Conhecimentos

SQL proficiency

Python capability

Data modeling knowledge

English communication

Ferramentas

Azure Data Factory

Azure Synapse

Databricks

Power BI

Apache Airflow

Azure (Cloud)

Descrição da oferta de emprego

We are seeking an Azure Data Engineer to build and optimize scalable data ingestion and transformation pipelines using Azure Data Factory and Azure Synapse. You will leverage SQL and Python to transform complex datasets, design analytics-ready data models, and orchestrate automated workflows. You will partner with business teams to deliver high-quality, trusted reporting solutions.

Responsibilities

• Develop, maintain and support ETL/ELT solutions
• Build and optimize data ingestion and transformation pipelines using Azure Data Factory and Azure Synapse
• Design and implement data models to support analytics and reporting use cases
• Use SQL and Python to transform, validate and analyze large datasets
• Orchestrate workflows, scheduling and monitoring to ensure reliable pipeline execution
• Apply best practices across development, testing and deployment
• Create and maintain technical documentation
• Mentor junior engineers and contribute to team knowledge sharing

Requirements

• Azure Data Factory expertise for building, scheduling and monitoring pipelines
• Azure Synapse experience for data integration and analytics workloads
• ETL/ELT Solutions background including ingestion, transformation and incremental processing
• SQL proficiency for data transformation, validation and performance tuning
• Python capability for data processing and automation
• Data modeling knowledge including dimensional modeling and Lakehouse concepts
• Cloud platform familiarity, especially Microsoft Azure
• Clear communication in English, written and spoken

Nice to have

• Experience with Databricks for Data Analytics
• Experience with Microsoft Power BI
• Experience with Apache Airflow

We offer

• By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us