Senior Data Backend Engineer (Python / Databricks / Azure)

Luxoft Germany; Schweiz; Remote; CHF 120.000 - 180.000; Vollzeit

Zusammenfassung

Luxoft seeks a senior data engineer to design scalable data processing pipelines and APIs for a premium German OEM in the Asia region. You will build ingestion/transformation workflows, expose data through FastAPI, and optimize SQL/data models in a cloud-first setup.

You will work with Python, Databricks, Azure, and Spark technologies, deploying solutions on Azure, ensuring performance and quality, and mentoring junior engineers within cross-functional squads.

Qualifikationen

• 5+ years of software/data engineering experience.
• Strong Python development experience.
• Hands-on experience with Databricks.
• Strong SQL and data modeling skills.
• Experience developing APIs with FastAPI.
• Experience with Azure cloud services.
• Understanding of ETL/ELT concepts and data pipeline design.
• Experience with Git and CI/CD pipelines.

Aufgaben

• Design and develop scalable data processing solutions using Python and Databricks.
• Build and maintain data pipelines for ingestion, transformation, and aggregation of business data.
• Develop REST APIs using FastAPI to expose data.
• Design and optimize SQL queries and data models.
• Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions.
• Deploy and maintain solutions on Microsoft Azure.
• Drive best practices in performance optimization, monitoring, testing, and code quality.
• Mentor junior engineers and contribute to architectural decisions.

Kenntnisse

Python

Databricks

SQL

Data modeling

FastAPI

Azure

ETL/ELT

Git

CI/CD

Data pipelines

Tools

Azure Data Factory

Azure Synapse Analytics

Spark/PySpark

Jobbeschreibung

Project description

Development of a sales planning and analytics platform for a premium German OEM in the Asia region, enabling data-driven business decisions through scalable data processing, integration, and API-based data consumption.

Responsibilities

• -Design and develop scalable data processing solutions using Python and Databricks-Build and maintain data pipelines for ingestion, transformation, and aggregation of business data-Develop REST APIs using FastAPI to expose data and analytical services to consuming applications-Design and optimize SQL queries and data models-Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions-Deploy and maintain solutions on Microsoft Azure-Drive best practices in performance optimization, monitoring, testing, and code quality-Mentor junior engineers and contribute to architectural decisions

SKILLS

Must have

• - 5+ years of software/data engineering experience- Strong Python development experience- Hands-on experience with Databricks- Strong SQL and data modeling skills- Experience developing APIs with FastAPI- Experience with Azure cloud services- Understanding of ETL/ELT concepts and data pipeline design- Experience with Git and CI/CD pipelines

Nice to have

Experience with Azure Data FactoryExperience with Azure Synapse AnalyticsKnowledge of Spark/PySparkExperience building data products for Sales, Marketing, or Business PlanningExposure to machine learning workflows