Senior Data Solutions Engineer: End-to-End Pipelines on Azure

Luxoft Malaysia; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Job summary

Luxoft Malaysia is seeking a versatile Data Solutions Engineer to support the full data lifecycle—from ingestion and engineering to analytics, visualization, and API enablement. The role combines strong data engineering fundamentals with business partnerships and reporting development.

You will rotate across Data Engineering, Data Analytics, and Data Visualization initiatives as project priorities shift, leveraging cloud platforms and modern data architectures for scalable solutions.

Qualifications

• Proficient in Python and SQL for data engineering tasks.
• Experience with cloud data platforms and distributed processing.
• Familiarity with API development and self-service analytics is a plus.
• Exposure to Data Science and AI use cases is advantageous.

Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Build and optimize ETL/ELT processes.
• Develop data ingestion, transformation, and aggregation workflows.
• Ensure data quality, reliability, and performance.
• Develop solutions using cloud-based data platforms.
• Build and optimize data processing notebooks and workflows.
• Work with Data Lakes, Lakehouse architectures, and distributed data processing technologies.
• Support CI/CD and deployment activities for data solutions.
• Collaborate with business users to gather and clarify requirements.
• Translate business needs into analytical and technical solutions.
• Develop KPI calculations, reporting logic, and support data exploration for business insights.
• Build dashboards and reports to enable self-service analytics and decision-making.
• Develop and maintain APIs to expose data products and integrate with consuming applications.

Skills

Python

SQL

Databricks / Apache Spark / PySpark

Synapse Analytics

Microsoft Fabric

Tools

Databricks / Apache Spark / PySpark

Synapse Analytics

Microsoft Fabric

Job description

Luxoft Malaysia is seeking a versatile Data Solutions Engineer to support the full data lifecycle—from ingestion and engineering to analytics, visualization, and API enablement. The role combines strong data engineering fundamentals with business partnerships and reporting development.

You will rotate across Data Engineering, Data Analytics, and Data Visualization initiatives as project priorities shift, leveraging cloud platforms and modern data architectures for scalable solutions.