Data Engineer - Big Data, Python

Citigroup Inc.; Chennai District; On-site; INR 900,000 - 1,800,000; Full time

Job summary

Citigroup Inc. in Chennai, India, seeks an Applications Development Intermediate Programmer Analyst to contribute to the design and implementation of new or revised applications with the Technology team.

You will build scalable data pipelines, apply ETL/ELT practices, and collaborate with analysts and tech teams to deliver robust data platforms, complying with governance and security standards. Qualified candidates have 5-7 years in financial services, strong data engineering skills with

Qualifications

• 5 - 7 years of relevant experience in the Financial Service industry
• Intermediate level experience in Applications Development role
• Proficient in Big Data Technologies - Cloudera, Hive, Python, Java/PySpark
• Proficient in Data analysis and data modelling
• Good understanding of ETL concepts
• Knowledge on relational Database like Oracle, SQL Server is good to have
• Consistently demonstrates clear and concise written and verbal communication
• Demonstrated problem-solving and decision-making skills
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements

Responsibilities

• Pipeline & Architecture Development: design, build, and optimize scalable data pipelines and architectures using data engineering principles
• Stakeholder Collaboration: work with business analysts and cross-functional technology teams to understand data requirements and deploy data platforms
• Technical Design & Specifications: apply programming skills to design scalable data models, schemas, and pipeline specifications
• Data Quality & Security: ensure data quality, integrity, and security; perform rigorous testing and debugging
• Performance Optimization: identify bottlenecks and implement optimizations for ingestion, processing, and storage
• Technical Problem Solving: resolve complex data pipeline issues and infrastructure bottlenecks
• Autonomy & Execution: operate with autonomy in delivering data engineering deliverables and pipeline deployments
• Risk & Compliance: assess risk and ensure data privacy and compliance with regulations

Skills

Big Data Technologies

Python

Java

PySpark

Hive

Cloudera

Data analysis

Data modelling

ETL concepts

Oracle

SQL Server

Communication

Problem solving

Education

Bachelor’s degree

Job description

The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Responsibilities

• Pipeline & Architecture Development:Utilize deep knowledge of data engineering principles, distributed systems, and ETL/ELT procedures to design, build, and optimize scalable data pipelines and architectures. Leverage scripting languages (e.g., Python, Bash) and SQL to automate workflows and analyze/optimize data processing code.
• Stakeholder Collaboration:Collaborate with business analysts, and cross-functional technology teams to understand data requirements, recommend robust data integration solutions, and deploy/support high-performance data platforms.
• Technical Design & Specifications:Apply strong programming skills (e.g., Python, Pyspark, Java, SQL) and software engineering best practices to design and implement scalable data models, schemas, and pipeline specifications.
• Data Quality & Security:Analyze data pipelines and storage systems to ensure data quality, integrity, and security. Conduct rigorous testing (unit, integration, and end-to-end) and debugging of data workflows, ensuring compliance with data governance and privacy standards.
• Performance Optimization:Identify data bottlenecks, analyze pipeline performance, and make evaluative judgments to recommend and implement optimizations for data ingestion, processing, and storage.
• Technical Problem Solving:Resolve complex data pipeline failures, data quality anomalies, and infrastructure bottlenecks by applying technical experience in big data technologies and cloud data warehouses.
• Autonomy & Execution:Operate with a high degree of autonomy and limited direct supervision in managing data engineering deliverables and pipeline deployments. Exercise independent judgment and autonomy in selecting appropriate data technologies, designing architectures, and resolving technical challenges.
• Risk & Compliance:Appropriately assess risk when making technical and business decisions, ensuring data privacy, security, and compliance with data protection regulations (e.g., GDPR, local laws).

Qualifications

• 5 - 7 years of relevant experience in the Financial Service industry
• Intermediate level experience in Applications Development role
• Proficient in Big DataTechnologies - Cloudera, Hive, Python, Java/PySpark
• Proficient in Data analysis and data modelling
• Good understanding of ETL concepts
• Knowledge on relational Database like Oracle, SQL Server is good to have
• Consistently demonstrates clear and concise written and verbal communication
• Demonstrated problem-solving and decision-making skills
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements

Education

• Bachelor’s degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

Job Family Group

Technology

Job Family

Applications Development

Time Type

Full time

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.