Databricks Data Integration Lead

EPAM Systems; Kuala Lumpur; Presencial; MYR 180.000 - 300.000; Jornada completa

Descripción de la vacante

EPAM Systems is seeking an experienced Senior Data Integration Engineer focused on Databricks to lead enterprise data pipelines and analytics solutions. You will design and implement ETL/ELT processes, own end-to-end data ingestion and transformation on cloud platforms, and collaborate with analytics and business teams to deliver high-quality data products.

Responsibilities include mentoring junior engineers, integrating with Power BI, and documenting technical solutions while upholding

Formación

• 5+ years of experience in Data Integration with Databricks
• Strong SQL and Python proficiency; data modeling fundamentals
• Experience with Delta Lake concepts and schema evolution
• Cloud experience on Azure and AWS
• Hands-on with building data pipelines and delivering reliable data products
• Knowledge of data ingestion techniques and best practices
• Orchestration experience (Databricks Workflows; Airflow is a plus)
• Excellent English communication skills

Responsabilidades

• Develop, maintain and support ETL/ELT solutions
• Implement and manage Databricks on Azure or AWS
• Use SQL, PySpark or Scala to transform and analyze large datasets
• Own end-to-end delivery of data ingestion and transformation pipelines on Databricks
• Mentor junior engineers and collaborate with analytics teams
• Work with Power BI to deliver insights
• Create technical documentation and ensure best practices

Conocimientos

Databricks

SQL

PySpark

Scala

Azure

AWS

ETL/ELT

Data Modeling

Data Integration

Mentoring

Communication

Educación

Bachelor’s degree in Computer Science, Information Technology, or related discipline

Herramientas

Delta Lake

Databricks Workflows

ADF

Airflow

Power BI

Descripción del empleo

EPAM Systems is seeking an experienced Senior Data Integration Engineer focused on Databricks to lead enterprise data pipelines and analytics solutions. You will design and implement ETL/ELT processes, own end-to-end data ingestion and transformation on cloud platforms, and collaborate with analytics and business teams to deliver high-quality data products.

Responsibilities include mentoring junior engineers, integrating with Power BI, and documenting technical solutions while upholding