Senior Data Backend Engineer (Python / Databricks / Azure)

Luxoft; Kuala Lumpur; On-site; MYR 180,000 - 300,000; Full time

Job summary

Luxoft seeks a senior software/data engineer to design and build a scalable analytics platform for a premium German OEM in APAC. You will develop data processing pipelines in Python, leverage Databricks, and expose analytical data via FastAPI APIs.

You will optimize SQL models, collaborate with stakeholders, and deploy on Azure, while guiding junior engineers and influencing architecture. The role focuses on data-driven decision making, scalable data ingestion, transformation, and API-based data

Qualifications

• 5+ years of software/data engineering experience.
• Strong Python development experience.
• Hands-on experience with Databricks.
• Strong SQL and data modeling skills.
• Experience developing APIs with FastAPI.
• Experience with Azure cloud services.
• Understanding of ETL/ELT concepts and data pipeline design.
• Experience with Git and CI/CD pipelines.

Responsibilities

• Design and develop scalable data processing solutions using Python and Databricks.
• Build and maintain data pipelines for ingestion, transformation, and aggregation of business data.
• Develop REST APIs using FastAPI to expose data and analytical services to consuming applications.
• Design and optimize SQL queries and data models.
• Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions.
• Deploy and maintain solutions on Microsoft Azure.
• Drive best practices in performance optimization, monitoring, testing, and code quality.
• Mentor junior engineers and contribute to architectural decisions.

Skills

5+ years experience

Python

Databricks

SQL & data modeling

FastAPI

Azure

ETL/ELT

Git & CI/CD

Mentoring

Architecture decisions

Data products (Sales/Marketing/PLM)

Machine learning workflows (exposure)

Tools

Databricks

FastAPI

Azure Data Factory

Azure Synapse Analytics

Spark/PySpark

Job description

Project description

Development of a sales planning and analytics platform for a premium German OEM in the Asia region, enabling data-driven business decisions through scalable data processing, integration, and API-based data consumption.

Responsibilities

• Design and develop scalable data processing solutions using Python and Databricks
• Build and maintain data pipelines for ingestion, transformation, and aggregation of business data
• Develop REST APIs using FastAPI to expose data and analytical services to consuming applications
• Design and optimize SQL queries and data models
• Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions
• Deploy and maintain solutions on Microsoft Azure
• Drive best practices in performance optimization, monitoring, testing, and code quality
• Mentor junior engineers and contribute to architectural decisions

SKILLS

Must have

• 5+ years of software/data engineering experience
• Strong Python development experience
• Hands-on experience with Databricks
• Strong SQL and data modeling skills
• Experience developing APIs with FastAPI
• Experience with Azure cloud services
• Understanding of ETL/ELT concepts and data pipeline design
• Experience with Git and CI/CD pipelines

Nice to have

• Experience with Azure Data Factory
• Experience with Azure Synapse Analytics
• Knowledge of Spark/PySpark
• Experience building data products for Sales, Marketing, or Business Planning
• Exposure to machine learning workflows