Data Engineer

Luxoft; Malaysia; On-site; MYR 120,000 - 240,000; Full time

Job summary

Luxoft in Malaysia is seeking a data engineering professional to design scalable data processing solutions using Python and Databricks, and to build end-to-end data pipelines for ingestion, transformation, and analytics.

You will deploy and maintain solutions on Microsoft Azure, develop REST APIs with FastAPI, optimize SQL queries and data models, mentor junior engineers, and collaborate with analysts and stakeholders to translate business needs into robust technical designs.

Responsibilities

• Design and develop scalable data processing solutions using Python and Databricks
• Build and maintain data pipelines for ingestion, transformation, and aggregation of business data
• Develop REST APIs using FastAPI to expose data and analytical services to consuming applications
• Design and optimize SQL queries and data models
• Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions
• Deploy and maintain solutions on Microsoft Azure
• Drive best practices in performance optimization, monitoring, testing, and code quality
• Mentor junior engineers and contribute to architectural decisions

Job description

Role & responsibilities

• -Design and develop scalable data processing solutions using Python and Databricks
• -Build and maintain data pipelines for ingestion, transformation, and aggregation of business data
• -Develop REST APIs using FastAPI to expose data and analytical services to consuming applications
• -Design and optimize SQL queries and data models
• -Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions
• -Deploy and maintain solutions on Microsoft Azure
• -Drive best practices in performance optimization, monitoring, testing, and code quality
• -Mentor junior engineers and contribute to architectural decisions