Data Engineer - SQL+Python

Luxoft; Pune District; On-site; INR 2,000,000 - 4,000,000; Full time

Job summary

Luxoft in Pune, India is seeking a senior Data Engineer to design, develop, and support scalable data solutions for surveillance and regulatory reporting use cases. You will onboard new data sources, build ingestion pipelines, ensure data quality, and support governance and metadata requirements.

The role emphasizes SDLC adherence, data model design, and optimizing performance across a cloud data warehouse such as Snowflake, with Tableau-based reporting and strong collaboration with

Qualifications

• Bachelor's degree in CS/IT/Engineering or related field.
• 8+ years in data engineering with strong SQL data manipulation.
• Experience with Snowflake or cloud-based data warehousing.
• Proficiency in Tableau or similar BI tools.
• Strong data modeling, pipelines, and governance knowledge.

Responsibilities

• Onboard and integrate new surveillance and transaction data sources.
• Develop and maintain data pipelines and ingestion frameworks.
• Implement data quality rules, monitoring, and exception management.
• Optimize data processing performance and scalability.
• Support data lineage, metadata management, and governance.
• Resolve production data issues and provide operational support.
• Deliver technical documentation and follow SDLC and control standards.

Skills

SQL

Data pipelines

Tableau

Python

Data quality

Communication

Collaboration

Problem-solving

Education

Bachelor's degree in Computer Science/IT/Engineering

Tools

Snowflake

ETL tools

Qlikview/Qliksense

Job description

As part of Client Technology team, the data Engineer will work to design, develop, and support scalable data solutions that underpin strong engineering practices, implicit data controls and the functional requirements for effective surveillance and regulatory reporting use cases. The scope will focus on onboarding new data sources, developing data ingestion and transformation pipelines, implementing data quality controls, supporting lineage and metadata requirements, and enabling efficient management of transactional and non-transactional/ reference data across the platform. The role will support both strategic initiatives and ongoing operational requirements.

Responsibilities:

• Onboarding and integration of new surveillance and transaction data sources.
• Development and maintenance of data pipelines and ingestion frameworks.
• Implementation of data quality rules, monitoring, and exception management processes.
• Optimization of data processing performance and platform scalability.
• Support for data lineage, metadata management, and governance objectives.
• Resolution of data-related production issues and operational support activities.
• Delivery of technical documentation and adherence to SDLC and control standards.

Mandatory Skills Description:

Education:

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field

Experience:

• Minimum of 8 years of experience in data engineering, with a strong focus on SQL and data manipulation.
• Proven experience working with Snowflake or other cloud-based data warehousing solutions.
• Experience with Tableau
• Strong background in designing data model and building scalable data pipelines and data models.
• Solid understanding of financial instruments, investment operations, investment reporting and portfolio management concepts.
• Knowledge of investment performance measurement, risk analysis, and portfolio management concepts.

Skills:

• Expert-level proficiency in SQL, with the ability to write complex queries and optimize them for performance.
• Strong experience with ETL tools and processes.
• Familiarity with Tableau, Qlikview, Qliksense
• Familiarity with programming languages such as Python.
• Knowledge of data governance, security, and compliance best practices.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.