Senior Data Platform Engineer: Databricks & APIs

Luxoft; Penang; On-site; MYR 180,000 - 300,000; Full time

Job summary

Luxoft in Malaysia is seeking a Senior Data Engineer to design and build a scalable analytics platform for a premium German OEM in Asia. You will develop data pipelines, APIs with FastAPI, and data models, while collaborating with analysts, engineers, and product stakeholders.

You will deploy on Azure, optimize performance, mentor junior engineers, and contribute to architecture decisions, applying best practices in CI/CD, testing, and code quality.

Qualifications

• 5+ years of software/data engineering experience.
• Hands-on experience with Databricks.
• Strong SQL and data modeling skills.
• Experience developing APIs with FastAPI.
• Experience with Azure cloud services.
• Understanding of ETL/ELT concepts and data pipeline design.
• Experience with Git and CI/CD pipelines.

Responsibilities

• Design and develop scalable data processing solutions using Python and Databricks
• Build and maintain data pipelines for ingestion, transformation, and aggregation of business data
• Develop REST APIs using FastAPI to expose data and analytical services to consuming applications
• Design and optimize SQL queries and data models
• Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions
• Deploy and maintain solutions on Microsoft Azure
• Drive best practices in performance optimization, monitoring, testing, and code quality
• Mentor junior engineers and contribute to architectural decisions

Skills

Databricks

Python

SQL

FastAPI

Azure

ETL/ELT

CI/CD

Git

Tools

Spark/PySpark

Azure Data Factory

Azure Synapse Analytics

Job description

Luxoft in Malaysia is seeking a Senior Data Engineer to design and build a scalable analytics platform for a premium German OEM in Asia. You will develop data pipelines, APIs with FastAPI, and data models, while collaborating with analysts, engineers, and product stakeholders.

You will deploy on Azure, optimize performance, mentor junior engineers, and contribute to architecture decisions, applying best practices in CI/CD, testing, and code quality.