Senior Data Engineer

Luxoft; United Kingdom; Remote; GBP 90,000 - 120,000; Full time

Job summary

Luxoft is seeking a Senior Data Engineer to design, develop, and optimize enterprise-scale data platforms using Snowflake, ADF, DBT, Python, and SQL. You will build robust ELT pipelines, scalable data models, and analytics-ready datasets to empower data-driven decisions.

The role emphasizes governance, data quality, and reliable data delivery, collaborating with analysts, scientists, and product stakeholders to deliver trusted data products across the organization.

Qualifications

• Must have Snowflake Data Warehouse, Azure Data Factory, DBT, Python, and Advanced SQL.
• Must have Data Modeling experience (3NF, Star Schema, Snowflake Schema).
• Experience with Apache Airflow, Prefect or Dagster and cloud platforms (Azure preferred).
• Proficiency with Git, CI/CD and data quality/governance frameworks.
• Agile/Scrum mindset and ability to collaborate with stakeholders to deliver trusted data products.

Responsibilities

• Design and develop scalable ELT pipelines using Snowflake, ADF, DBT, and Python.
• Build and maintain enterprise data models (3NF, Star, Snowflake Schema).
• Optimize Snowflake performance with query tuning and micro-partitioning.
• Develop modular data transformation frameworks using DBT (Jinja, Macros, Testing).
• Automate data ingestion and transformations with Python, Pandas, PySpark.
• Orchestrate workflows with Airflow/Prefect/Dagster; ensure CI/CD pipelines.
• Establish data quality, governance, monitoring and documentation.

Skills

Snowflake Data Warehouse

Azure Data Factory (ADF)

DBT

Python

Advanced SQL

Data Modeling (3NF, Star Schema, Snowfl

Apache Airflow / Prefect / Dagster

Cloud Platforms (Azure preferred)

Git and CI/CD

Data Quality and Governance Frameworks

Agile/Scrum Methodology

Tools

PySpark

Databricks

Microsoft Fabric

Job description

Project description

We are seeking a highly experienced Senior Data Engineer to design, develop, and optimize enterprise-scale data platforms using modern cloud technologies. The role involves building robust ELT pipelines, scalable data models, and analytics-ready datasets leveraging Snowflake, Azure Data Factory (ADF), DBT, Python, and SQL. The ideal candidate will play a key role in enabling data-driven decision making by delivering high-quality, governed, and performant data solutions.

Responsibilities

• Key Responsibilities
• Design and develop scalable ELT pipelines using Snowflake, ADF, DBT, and Python.
• Build and maintain enterprise data models including 3NF, Star Schema, and Snowflake Schema.
• Optimize Snowflake performance through query tuning, clustering, micro-partitioning, and warehouse management.
• Develop reusable and modular data transformation frameworks using DBT (Jinja, Macros, Testing, Documentation).
• Automate data ingestion, transformation, and operational processes using Python, Pandas, and PySpark.
• Implement workflow orchestration using tools such as Apache Airflow, Prefect, or Dagster.
• Establish data quality, governance, monitoring, and CI/CD best practices.
• Collaborate with Data Analysts, Data Scientists, Product Owners, and Business Stakeholders to deliver trusted data products.
• Create and maintain technical documentation, deployment procedures, and operational runbooks.Mandatory Skills

SKILLS

Must have

• Mandatory Skills
• Snowflake Data Warehouse
• Azure Data Factory (ADF)
• DBT
• Python
• Advanced SQL
• Data Modeling (3NF, Star Schema, Snowflake Schema)
• Apache Airflow / Prefect / Dagster
• Cloud Platforms (Azure preferred)
• Git and CI/CD
• Data Quality and Governance Frameworks
• Agile/Scrum Methodology

Nice to have

• PySpark
• Databricks
• Microsoft Fabric