Data Engineer - Big Data Python

Citi; Chennai District; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

Citi is seeking an Applications Development Intermediate Programmer Analyst in Chennai, India, to contribute to design, development, and optimization of data pipelines and architectures. The role focuses on data engineering, scheduling, and governance within a financial services context.

The candidate should have 5–7 years in the financial services industry, strong Big Data tech knowledge (Cloudera, Hive, PySpark), and solid SQL/Python skills to deliver scalable data solutions with governance in

Qualifications

• 5 - 7 years of relevant experience in the Financial Service industry
• Intermediate level experience in Applications Development role
• Proficient in Big Data Technologies - Cloudera, Hive, Python, Java/PySpark
• Proficient in Data analysis and data modelling
• Good understanding of ETL concepts
• Knowledge on relational Database like Oracle, SQL Server is good to have
• Clear and concise written and verbal communication
• Problem-solving and decision-making skills
• Ability to work under pressure and meet deadlines

Responsibilities

• Pipeline & Architecture Development: Design, build, and optimize scalable data pipelines using scripting languages (Python, Bash) and SQL.
• Stakeholder Collaboration: Work with analysts and cross-functional teams to understand data requirements and deploy data platforms.
• Technical Design & Specifications: Implement scalable data models, schemas, and pipeline specs using Python, PySpark, Java, SQL.
• Data Quality & Security: Ensure data quality, integrity, and privacy; perform unit/integration tests.
• Performance Optimization: Identify bottlenecks and optimize data ingestion and processing.
• Technical Problem Solving: Resolve data pipeline failures and infrastructure issues.
• Autonomy & Execution: Manage data engineering deliverables with limited supervision.
• Risk & Compliance: Ensure data privacy and compliance with data protection regulations.

Skills

Data engineering

ETL/ELT

SQL

Python

Java/PySpark

Big Data Technologies

Education

Bachelor's degree

Tools

Cloudera

Hive

PySpark

Job description

Job Description:

The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Responsibilities:

• Pipeline & Architecture Development:Utilize deep knowledge of data engineering principles, distributed systems, and ETL/ELT procedures to design, build, and optimize scalable data pipelines and architectures. Leverage scripting languages (e.g., Python, Bash) and SQL to automate workflows and analyze/optimize data processing code.


• Stakeholder Collaboration:Collaborate with business analysts, and cross-functional technology teams to understand data requirements, recommend robust data integration solutions, and deploy/support high-performance data platforms.


• Technical Design & Specifications:Apply strong programming skills (e.g., Python, Pyspark, Java, SQL) and software engineering best practices to design and implement scalable data models, schemas, and pipeline specifications.


• Data Quality & Security:Analyze data pipelines and storage systems to ensure data quality, integrity, and security. Conduct rigorous testing (unit, integration, and end-to-end) and debugging of data workflows, ensuring compliance with data governance and privacy standards.


• Performance Optimization:Identify data bottlenecks, analyze pipeline performance, and make evaluative judgments to recommend and implement optimizations for data ingestion, processing, and storage.


• Technical Problem Solving:Resolve complex data pipeline failures, data quality anomalies, and infrastructure bottlenecks by applying technical experience in big data technologies and cloud data warehouses.


• Autonomy & Execution:Operate with a high degree of autonomy and limited direct supervision in managing data engineering deliverables and pipeline deployments. Exercise independent judgment and autonomy in selecting appropriate data technologies, designing architectures, and resolving technical challenges.


• Risk & Compliance:Appropriately assess risk when making technical and business decisions, ensuring data privacy, security, and compliance with data protection regulations (e.g., GDPR, local laws).

Qualifications:

• 5 - 7 years of relevant experience in the Financial Service industry


• Intermediate level experience in Applications Development role


• Proficient in Big DataTechnologies - Cloudera, Hive, Python, Java/PySpark


• Proficient in Data analysis and data modelling


• Good understanding of ETL concepts


• Knowledge on relational Database like Oracle, SQL Server is good to have


• Consistently demonstrates clear and concise written and verbal communication


• Demonstrated problem-solving and decision-making skills


• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements

Education:

• Bachelor’s degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.

Requirements: