Data Engineer (Azure Databricks)

EPAM Systems; Kuala Lumpur; On-site; MYR 90,000 - 180,000; Full time

Job summary

EPAM Systems seeks a Data Engineer (Databricks) to build reliable pipelines and analytics-ready datasets on Azure for Power BI reporting and analytics use cases. You will own data flows, improve stability and data quality, and partner with BI teams to keep data trusted and usable.

You’ll ingest data from GA4, design star-schema models, and implement quality controls while coordinating with stakeholders to translate needs into data structures.

Qualifications

• Experience building ETL/ELT pipelines with Databricks (Python, PySpark, SQL).
• Background in analytics backends for BI using Azure data services.

Responsibilities

• Build and maintain ETL/ELT pipelines in Databricks.
• Ingest data from multiple sources including GA4.
• Create analytics-ready tables for Power BI dashboards.
• Design reporting-ready models (star schemas, facts, dimensions, grain, keys).
• Implement data quality checks and reconciliation.
• Operate pipelines end to end with monitoring and backfills.

Skills

Databricks

Python

PySpark

SQL

Azure

GA4 knowledge

Power BI

Data modeling

Orchestration

Data quality

Tools

Databricks

Power BI

Azure

Job description

We are seeking a Data Engineer (Databricks). You’ll build reliable pipelines and analytics-ready datasets on Azure for Power BI reporting and digital analytics use cases. You will take ownership from an external vendor, improve stability and data quality and partner with BI and product teams to keep data trusted and usable.ResponsibilitiesBuild and maintain ETL and ELT pipelines in Databricks using Python, PySpark and SQLIngest data from multiple sources including Google Analytics (GA4) using reliable patternsCreate curated, analytics-ready tables for Microsoft Power BI dashboards and self-serve analysisDesign reporting-ready models including star schemas, facts, dimensions, grain and keysImplement data quality controls including checks for accuracy, completeness, freshness and reconciliationOperate pipelines end to end including monitoring, troubleshooting, backfills and performance tuningPartner with BI developers, analysts and stakeholders to translate reporting needs into data structuresLead knowledge transfer from external teams through documentation, stabilization and handover planningRequirementsDatabricks development skill sets using Python, PySpark and SQLData engineering background supporting analytics and business intelligence back endsMicrosoft Azure experience in a data and analytics contextGoogle Analytics (GA4) knowledge including metrics, dimensions and validating data connectionsData modeling ability for reporting and consumption-layer designKnowledge of orchestration concepts, incremental loads and partitioning approachesExperience contributing to data quality practices and controlsClear communication in EnglishNo visa sponsorship is available for this roleNice to haveGoogle BigQuery experience including GA4 export datasets and cost-aware queryingFamiliarity validating Microsoft Power BI models and star schema compatibilityExposure to Azure Data Lake Storage Gen2 (ADLS Gen2), Azure Key Vault or CI/CD for data pipelinesWe offerBy choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.Employee ideas are the main driver of our business. We have a very supportive environment where your voice mattersYou will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practicesWe offer a transparent career path and an individual roadmap to engineer your future & accelerate your journeyAt EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with usLife at EPAMEPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertiseWe are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients