Data Engineer - Python & Snowflake

DXC Luxoft; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Luxoft in Bengaluru, India is seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines and analytics-ready data stores. The role requires strong hands-on expertise in Python, Snowflake, and SQL, with a focus on robust data ingestion, transformation, and processing.

You will collaborate with Data Architects, Analysts, and Data Scientists to ensure data quality, performance, and reliability across enterprise platforms.

Qualifications

• 8+ years of experience in data engineering or similar roles.
• Hands-on experience with Python for data engineering and automation.
• Strong Snowflake data warehouse experience and SQL expertise.
• Experience with data ingestion, ETL/ELT, and data modeling.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
• Build Python-based data ingestion, transformation, validation, and processing solutions.
• Optimize Snowflake queries and data structures for performance and scalability.
• Write complex SQL queries, including joins, CTEs, window functions, and procedures.
• Collaborate with Data Architects, Analysts, Data Scientists, and application teams.

Skills

Python

Snowflake

SQL

ETL/ELT

REST APIs

Git CI/CD

Data ingestion

Performance tuning

Tools

Git

CI/CD

Job description

Project description

We are looking for an experienced Data Engineer with strong hands-on expertise in Python, Snowflake, SQL, and data engineering technologies. You will be responsible for designing, developing, and maintaining scalable data pipelines and solutions supporting enterprise data and analytics platforms.

Responsibilities

• Design, develop, and maintain robust data pipelines and ETL/ELT workflows.Develop Python-based solutions for data ingestion, transformation, validation, and processing.Build and optimize data solutions using Snowflake.Write complex and performance-optimized SQL queries.Develop data pipelines to integrate data from databases, APIs, files, and other enterprise data sources.Perform data transformations and implement business rules according to functional requirements.Design and maintain data models suitable for analytical and reporting requirements.Troubleshoot pipeline failures, data-quality issues, and performance bottlenecks.Optimize Snowflake queries, data structures, and workloads for performance and scalability.Implement appropriate data-quality checks, reconciliation, logging, monitoring, and error handling.Work closely with Data Architects, Business Analysts, Data Scientists, and application teams.Participate in code reviews, testing, deployment, and production support.Follow engineering standards for secure and reliable handling of enterprise data.

SKILLS

Must have

• At least 8 years of experience working within data engineering area, preferably within banking industry.Strong hands-on experience with Python for data engineering and automation.Strong experience with Snowflake data warehouse.Advanced knowledge of SQL, including joins, CTEs, window functions, stored procedures, and query optimization.Good understanding of ETL/ELT architecture and data pipeline development.Experience with data ingestion and transformation of large datasets.Good understanding of data warehousing concepts, dimensional modelling, and data marts.Experience with REST APIs and structured/semi-structured formats such as JSON, CSV, and Parquet.Experience with Git and CI/CD practices.Strong debugging and production troubleshooting skills.

Nice to have

N/A