Senior Data Backend Engineer (Python / Databricks / Azure)

Luxoft; George Town; On-site; MYR 140,000 - 200,000; Full time

Job summary

Luxoft in Penang, Malaysia, is seeking a senior data/software engineer to develop a scalable analytics platform for a premium German OEM in the Asia region. You will drive data pipelines, API services, and data models with a focus on performance and reliability.

You will deploy on Azure, collaborate with cross-functional teams, and mentor junior engineers while influencing architectural choices and best practices.

Qualifications

• Minimum 5+ years of software/data engineering experience.
• Strong Python development experience.
• Hands-on Databricks experience.
• Strong SQL and data modeling skills.
• Experience developing APIs with FastAPI.
• Experience with Azure cloud services.
• Understanding ETL/ELT concepts and data pipelines.
• Experience with Git and CI/CD pipelines.

Responsibilities

• Design and develop scalable data processing solutions using Python and Databricks; build and maintain data pipelines for ingestion, transformation, and aggregation of business data.
• Develop REST APIs using FastAPI to expose data and analytical services to consuming applications.
• Design and optimize SQL queries and data models.
• Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions.
• Deploy and maintain solutions on Microsoft Azure.
• Drive best practices in performance optimization, monitoring, testing, and code quality.
• Mentor junior engineers and contribute to architectural decisions.

Skills

5+ yrs exp

Python

Databricks

SQL/Data modeling

FastAPI

Azure

ETL/ELT

Git/CI-CD

Tools

Azure

Git

CI/CD

FastAPI

Databricks

Job description

Project description

Development of a sales planning and analytics platform for a premium German OEM in the Asia region, enabling data-driven business decisions through scalable data processing, integration, and API-based data consumption.

Responsibilities

• -Design and develop scalable data processing solutions using Python and Databricks-Build and maintain data pipelines for ingestion, transformation, and aggregation of business data
• -Develop REST APIs using FastAPI to expose data and analytical services to consuming applications
• -Design and optimize SQL queries and data models
• -Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions
• -Deploy and maintain solutions on Microsoft Azure
• -Drive best practices in performance optimization, monitoring, testing, and code quality
• -Mentor junior engineers and contribute to architectural decisions

SKILLS

Must have

• - 5+ years of software/data engineering experience
• - Strong Python development experience
• - Hands-on experience with Databricks
• - Strong SQL and data modeling skills
• - Experience developing APIs with FastAPI
• - Experience with Azure cloud services
• - Understanding of ETL/ELT concepts and data pipeline design
• - Experience with Git and CI/CD pipelines

Nice to have

Experience with Azure Data FactoryExperience with Azure Synapse AnalyticsKnowledge of Spark/PySparkExperience building data products for Sales, Marketing, or Business PlanningExposure to machine learning workflows