Senior Databricks & Data Solutions Engineer

Luxoft Malaysia; Penang; Presencial; MYR 120.000 - 180.000; Jornada completa

Descripción de la vacante

Luxoft Malaysia is seeking a versatile Data Solutions Engineer to support the complete data lifecycle—from ingestion and engineering to analytics, visualization, and API enablement. You will work closely with business stakeholders, develop reporting capabilities, and contribute across multiple data initiatives including data science and AI use cases.

The role rotates between Data Engineering, Data Analytics, and Data Visualization as priorities shift, requiring a flexible mindset and

Formación

• Proficient in Python, SQL and data processing frameworks.
• Experience with Databricks or Apache Spark (PySpark) is required.
• Ability to translate business needs into analytical data products.
• Experience building dashboards and APIs for data products.

Responsabilidades

• Design, develop, and maintain scalable data pipelines.
• Build and optimize ETL/ELT processes.
• Develop data ingestion, transformation, and aggregation workflows.
• Ensure data quality, reliability, and performance.
• Develop solutions using cloud-based data platforms.
• Build and optimize data processing notebooks and workflows.
• Work with Data Lakes, Lakehouse architectures, and distributed data processing technologies.
• Support CI/CD and deployment activities for data solutions.
• Collaborate with business users to gather and clarify requirements.
• Translate business needs into analytical and technical solutions.
• Develop KPI calculations, reporting logic, and support data exploration for business insights.
• Build dashboards and reports to enable self-service analytics and decision‑making.
• Develop and maintain APIs to expose data products and integrate with consuming applications.

Conocimientos

Python

SQL

Databricks

Spark

PySpark

FastAPI

REST API

Herramientas

Databricks

Spark

PySpark

Descripción del empleo

Luxoft Malaysia is seeking a versatile Data Solutions Engineer to support the complete data lifecycle—from ingestion and engineering to analytics, visualization, and API enablement. You will work closely with business stakeholders, develop reporting capabilities, and contribute across multiple data initiatives including data science and AI use cases.

The role rotates between Data Engineering, Data Analytics, and Data Visualization as priorities shift, requiring a flexible mindset and