Senior Data Engineer (immediate joiner)

Luxoft; India; On-site; INR 2,000,000 - 3,200,000; Full time

Job summary

Luxoft is seeking a highly experienced Senior Data Engineer to design and optimize enterprise-scale data platforms using Snowflake, ADF, DBT, Python, and SQL. You will build scalable ELT pipelines, data models, and analytics-ready datasets to enable data-driven decision making.

The role requires expertise in Snowflake, DBT, Python, and orchestration tools like Airflow/Prefect/Dagster, with a focus on governance, scalability, and performance.

Qualifications

• Snowflake Data Warehouse expertise.
• Experience with workflow orchestrators (Airflow/Prefect/Dagster).
• Proficient in Git and CI/CD practices.
• Strong data quality and governance framework knowledge.

Responsibilities

• Design and develop scalable ELT pipelines using Snowflake, ADF, DBT, and Python.
• Build and maintain enterprise data models including 3NF, Star Schema, and Snowflake Schema.
• Optimize Snowflake performance through query tuning, clustering, micro-partitioning, and warehouse management.
• Develop reusable data transformation frameworks using DBT (Jinja, Macros, Testing, Documentation).
• Automate data ingestion, transformation, and operational processes using Python, Pandas, and PySpark.
• Implement workflow orchestration using tools such as Apache Airflow, Prefect, or Dagster.
• Establish data quality, governance, monitoring, and CI/CD best practices.
• Collaborate with Data Analysts, Data Scientists, Product Owners, and Business Stakeholders to deliver trusted data products.
• Create and maintain technical documentation, deployment procedures, and operational runbooks.

Skills

Snowflake Data Warehouse

Apache Airflow / Prefect / Dagster

Git and CI/CD

Data Quality and Governance Frameworks

Tools

DBT

Python

SQL

Pandas

PySpark

Dagster

Prefect

Airflow

Job description

We are seeking a highly experienced Senior Data Engineer to design, develop, and optimize enterprise-scale data platforms using modern cloud technologies. The role involves building robust ELT pipelines, scalable data models, and analytics-ready datasets leveraging Snowflake, Azure Data Factory (ADF), DBT, Python, and SQL. The ideal candidate will play a key role in enabling data-driven decision making by delivering high-quality, governed, and performant data solutions.

Responsibilities

Key Responsibilities

• Design and develop scalable ELT pipelines using Snowflake, ADF, DBT, and Python.
• Build and maintain enterprise data models including 3NF, Star Schema, and Snowflake Schema.
• Optimize Snowflake performance through query tuning, clustering, micro-partitioning, and warehouse management.
• Develop reusable and modular data transformation frameworks using DBT (Jinja, Macros, Testing, Documentation).
• Automate data ingestion, transformation, and operational processes using Python, Pandas, and PySpark.
• Implement workflow orchestration using tools such as Apache Airflow, Prefect, or Dagster.
• Establish data quality, governance, monitoring, and CI/CD best practices.
• Collaborate with Data Analysts, Data Scientists, Product Owners, and Business Stakeholders to deliver trusted data products.
• Create and maintain technical documentation, deployment procedures, and operational runbooks.

Mandatory Skills Description

Mandatory Skills

• Snowflake Data Warehouse
• Apache Airflow / Prefect / Dagster
• Git and CI/CD
• Data Quality and Governance Frameworks