Senior Data Solutions Engineer

Luxoft Germany; United States; À distance; USD 90 000 - 150 000; Plein temps

Résumé du poste

Luxoft Germany is seeking a versatile Data Solutions Engineer to support the full data lifecycle—from ingestion and engineering to analytics, visualization, and API enablement. You will work closely with business stakeholders to translate needs into scalable data solutions and reporting capabilities.

The role involves designing ETL/ELT pipelines, data modeling, and building dashboards with BI tools while collaborating across data engineering, analytics, and visualization initiatives.

Qualifications

• Proficient in Python and SQL for data engineering tasks.
• Hands-on experience with Databricks or Spark/PySpark.
• Strong Azure data stack knowledge (Databricks, ADLS, Synapse).
• Experience building ETL/ELT pipelines and data models.
• API development experience (FastAPI preferred).
• Ability to create dashboards with Power BI/Tableau/Looker.

Responsabilités

• Design, build, and maintain scalable data pipelines.
• Develop and optimize ETL/ELT processes.
• Create data ingestion, transformation, and aggregation workflows.
• Ensure data quality, reliability, and performance.
• Develop cloud-based data platform solutions.
• Build notebooks/workflows for data processing.
• Work with data lakes and lakehouse architectures.
• Support CI/CD and deployment for data solutions.
• Collaborate with business users to clarify requirements.
• Translate business needs into analytical/technical solutions.
• Develop KPI calculations, reporting logic, and data exploration.
• Build dashboards and reports for self-service analytics.
• Develop and maintain APIs to expose data products.

Connaissances

Python

SQL

Databricks

PySpark

Azure

ETL/ELT

Data Modeling

API development

FastAPI

Power BI

Tableau

Looker

Flask/REST API

CI/CD

Outils

Azure Databricks

Azure Data Factory

Azure Data Lake Storage

Azure Synapse Analytics

Microsoft Fabric

Snowflake

FastAPI

Git

CI/CD pipelines

Description du poste

Project description

We are looking for a versatile Data Solutions Engineer capable of supporting the complete data lifecycle, from data ingestion and engineering to analytics, visualization, and API enablement.The ideal candidate combines strong Data Engineering fundamentals with the ability to work closely with business stakeholders, develop reporting solutions, and contribute across multiple data-related initiatives. Exposure to Data Science and AI use cases is considered an advantage.This role requires a flexible mindset, as the engineer may rotate between Data Engineering, Data Analytics, and Data Visualization initiatives depending on project priorities.

Responsibilities

• - Design, develop, and maintain scalable data pipelines.
• - Build and optimize ETL/ELT processes.
• - Develop data ingestion, transformation, and aggregation workflows.
• - Ensure data quality, reliability, and performance.
• - Develop solutions using cloud-based data platforms.
• - Build and optimize data processing notebooks and workflows.
• - Work with Data Lakes, Lakehouse architectures, and distributed data processing technologies.
• - Support CI/CD and deployment activities for data solutions.
• - Collaborate with business users to gather and clarify requirements.
• - Translate business needs into analytical and technical solutions.
• - Develop KPI calculations, reporting logic, and support data exploration for business insights.
• - Build dashboards and reports to enable self-service analytics and decision-making.
• - Develop and maintain APIs to expose data products and integrate with consuming applications.

SKILLS

Must have

• Programming:- Python- SQLData Engineering:- Databricks or Apache Spark / PySparkCloud Platform:- Microsoft AzureExamples:Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure, Synapse Analytics, Microsoft FabricData Processing:- ETL / ELT- Data Modeling- Data Pipeline DevelopmentAPIs:- FastAPI (preferred)- Flask / REST API development acceptableData VisualizationAt least one of:- Power BI- Tableau- Looker- Similar BI platform

Nice to have

Data Science & AIMachine Learning fundamentalsPredictive AnalyticsAI/ML model integrationStatistical analysisAdvanced Data PlatformAzure SynapseMicrosoft FabricAzure MLSnowflakeDevOpsAzure DevOpsGitCI/CD pipelines