Senior Data Platform Engineer - Python, Databricks & Azure

Luxoft; George Town; On-site; MYR 140,000 - 200,000; Full time

Job summary

Luxoft in Penang, Malaysia, is seeking a senior data/software engineer to develop a scalable analytics platform for a premium German OEM in the Asia region. You will drive data pipelines, API services, and data models with a focus on performance and reliability.

You will deploy on Azure, collaborate with cross-functional teams, and mentor junior engineers while influencing architectural choices and best practices.

Qualifications

• Minimum 5+ years of software/data engineering experience.
• Strong Python development experience.
• Hands-on Databricks experience.
• Strong SQL and data modeling skills.
• Experience developing APIs with FastAPI.
• Experience with Azure cloud services.
• Understanding ETL/ELT concepts and data pipelines.
• Experience with Git and CI/CD pipelines.

Responsibilities

• Design and develop scalable data processing solutions using Python and Databricks; build and maintain data pipelines for ingestion, transformation, and aggregation of business data.
• Develop REST APIs using FastAPI to expose data and analytical services to consuming applications.
• Design and optimize SQL queries and data models.
• Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions.
• Deploy and maintain solutions on Microsoft Azure.
• Drive best practices in performance optimization, monitoring, testing, and code quality.
• Mentor junior engineers and contribute to architectural decisions.

Skills

5+ yrs exp

Python

Databricks

SQL/Data modeling

FastAPI

Azure

ETL/ELT

Git/CI-CD

Tools

Azure

Git

CI/CD

FastAPI

Databricks

Job description

Luxoft in Penang, Malaysia, is seeking a senior data/software engineer to develop a scalable analytics platform for a premium German OEM in the Asia region. You will drive data pipelines, API services, and data models with a focus on performance and reliability.

You will deploy on Azure, collaborate with cross-functional teams, and mentor junior engineers while influencing architectural choices and best practices.