Senior Data Engineer (Python / Databricks / Azure)

Luxoft

Kuala Lumpur

On-site

MYR 120,000 - 240,000

Full time

47 hours ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Luxoft in Kuala Lumpur is seeking a senior data engineer to design and implement a scalable data processing and analytics platform for a premium German OEM in Asia. You will build Python-based pipelines on Databricks, develop FastAPI REST APIs, and optimize SQL data models while deploying on Azure.

You will mentor juniors and collaborate with analysts and product stakeholders to translate business needs into robust technical solutions.

Qualifications

5+ years of software/data engineering experience
Hands-on experience with Databricks
Strong SQL and data modeling skills
Experience developing APIs with FastAPI
Experience with Azure cloud services
Understanding of ETL/ELT concepts and data pipeline design
Experience with Git and CI/CD pipelines

Responsibilities

Design and develop scalable data processing solutions using Python and Databricks
Build and maintain data pipelines for ingestion, transformation, and aggregation of business data
Develop REST APIs using FastAPI to expose data and analytical services to consuming applications
Design and optimize SQL queries and data models
Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions
Deploy and maintain solutions on Microsoft Azure
Drive best practices in performance optimization, monitoring, testing, and code quality
Mentor junior engineers and contribute to architectural decisions

Skills

Python

Databricks

SQL

FastAPI

Azure

ETL/ELT

Git

CI/CD

Tools

REST APIs

Job description

Development of a sales planning and analytics platform for a premium German OEM in the Asia region, enabling data-driven business decisions through scalable data processing, integration, and API-based data consumption.

Responsibilities

Design and develop scalable data processing solutions using Python and Databricks
Build and maintain data pipelines for ingestion, transformation, and aggregation of business data
Develop REST APIs using FastAPI to expose data and analytical services to consuming applications
Design and optimize SQL queries and data models
Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions
Deploy and maintain solutions on Microsoft Azure
Drive best practices in performance optimization, monitoring, testing, and code quality
Mentor junior engineers and contribute to architectural decisions

Mandatory Skills Description