Data Engineer - Python & Snowflake

DXC Luxoft; Chennai; On-site; INR 420,000 - 660,000; Full time

Job summary

Luxoft is seeking an experienced Data Engineer in Chennai to design, develop, and maintain scalable data pipelines and analytics solutions. You will work on Python-based ingestion, transformation, and processing, leveraging Snowflake for data storage and performing advanced SQL optimizations.

The role requires 8+ years in data engineering, preferably in banking, and collaboration with architects, analysts, and scientists to ensure quality and scalability of data platforms.

Qualifications

• At least 8 years of experience in data engineering, preferably in banking.
• Strong hands-on experience with Python for data engineering and automation.
• Strong Snowflake data warehouse experience.
• Advanced knowledge of SQL, including joins, CTEs, window functions and optimization.
• Experience with REST APIs and JSON/CSV/Parquet data formats.
• Familiarity with Git and CI/CD practices.

Responsibilities

• Design, develop, and maintain robust data pipelines and ETL/ELT workflows.
• Develop Python-based data ingestion, transformation, validation, and processing.
• Build and optimize data solutions using Snowflake.
• Write complex and performance-optimized SQL queries.
• Develop data pipelines to integrate data from databases, APIs, files, and other sources.
• Troubleshoot pipeline failures, data-quality issues, and performance bottlenecks.
• Collaborate with Data Architects, Business Analysts, Data Scientists, and application teams.
• Follow engineering standards for secure and reliable handling of enterprise data.

Skills

Python

Snowflake

SQL

ETL/ELT

Data modeling

REST APIs

Git/CI-CD

Data pipelines

Data warehousing

Banking domain

Tools

CI/CD tooling

Job description

Project description

We are looking for an experienced Data Engineer with strong hands-on expertise in Python, Snowflake, SQL, and data engineering technologies. You will be responsible for designing, developing, and maintaining scalable data pipelines and solutions supporting enterprise data and analytics platforms.

Responsibilities

• Design, develop, and maintain robust data pipelines and ETL/ELT workflows.Develop Python-based solutions for data ingestion, transformation, validation, and processing.Build and optimize data solutions using Snowflake.Write complex and performance-optimized SQL queries.Develop data pipelines to integrate data from databases, APIs, files, and other enterprise data sources.Perform data transformations and implement business rules according to functional requirements.Design and maintain data models suitable for analytical and reporting requirements.Troubleshoot pipeline failures, data-quality issues, and performance bottlenecks.Optimize Snowflake queries, data structures, and workloads for performance and scalability.Implement appropriate data-quality checks, reconciliation, logging, monitoring, and error handling.Work closely with Data Architects, Business Analysts, Data Scientists, and application teams.Participate in code reviews, testing, deployment, and production support.Follow engineering standards for secure and reliable handling of enterprise data.

SKILLS

Must have

• At least 8 years of experience working within data engineering area, preferably within banking industry.Strong hands-on experience with Python for data engineering and automation.Strong experience with Snowflake data warehouse.Advanced knowledge of SQL, including joins, CTEs, window functions, stored procedures, and query optimization.Good understanding of ETL/ELT architecture and data pipeline development.Experience with data ingestion and transformation of large datasets.Good understanding of data warehousing concepts, dimensional modelling, and data marts.Experience with REST APIs and structured/semi-structured formats such as JSON, CSV, and Parquet.Experience with Git and CI/CD practices.Strong debugging and production troubleshooting skills.

Nice to have

N/A